2026-02-24T18:20:13.990 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T18:20:14.005 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T18:20:14.083 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688 branch: wip-yuri3-testing-2026-02-19-1610-tentacle description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false flavor: default job_id: '68688' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri3-testing-2026-02-19-1610-tentacle ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 rados replica read policy: balance global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: btree bluestore block size: 96636764160 bluestore fsck on mount: true bluestore onode segment size: 0 bluestore write v2 random: true bluestore zero block detection: true crush location: root=default host=host-$id debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result - OSD_DOWN mon_bind_msgr2: false sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2026-02-19-1610-tentacle sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 6877 sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri3-testing-2026-02-19-1610-tentacle suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 targets: trial045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQHeVSiN7CqUHqrDxllnAKEkjPldQNVegkA9MljbIPMOXF4Ws3JKqfjlX9nAloTi9qyu4sK9Jnf/hMq4FQ5OCE= trial114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOjgYlDhcMVpDDg3QOjc+bUhS5mYCPOk5c5J1iXGI2Wc0GYLDfGWJSJRdztrIHpSzdU4JEmlaId5bFALtu6R6nE= trial179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGULFW0EaBE4lgocfn7NHbfH5zh0UZNaVQMA50Qa0bhW5foMqUaLZmi6HSc3IRl3nQ28psJkOoJ2Md5nmchilY= trial194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCXICk0rxqUzCYyNuL17SLiFiaomCsuBXi/rwuFEIvJlEc9R9oJdwduGHS9tTtuAnOnwvU/F0XMAESc9H5OLeMw= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_16:27:17 tube: trial user: jayaprakash verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T18:20:14.083 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa; will attempt to use it 2026-02-24T18:20:14.084 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa/tasks 2026-02-24T18:20:14.084 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-24T18:20:14.086 INFO:teuthology.task.internal:Checking packages... 2026-02-24T18:20:14.086 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '36d388f27052dd940bdbaf543bb05bdba0acc155' 2026-02-24T18:20:14.086 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-24T18:20:14.086 INFO:teuthology.packaging:ref: None 2026-02-24T18:20:14.086 INFO:teuthology.packaging:tag: None 2026-02-24T18:20:14.086 INFO:teuthology.packaging:branch: wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-24T18:20:14.086 INFO:teuthology.packaging:sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:20:14.086 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-24T18:20:14.215 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-681.g36d388f2 2026-02-24T18:20:14.216 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-24T18:20:14.228 INFO:teuthology.task.internal:no buildpackages task found 2026-02-24T18:20:14.228 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T18:20:14.240 INFO:teuthology.task.internal:Saving configuration 2026-02-24T18:20:14.253 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T18:20:14.266 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T18:20:14.343 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial045.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:39.822370', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQHeVSiN7CqUHqrDxllnAKEkjPldQNVegkA9MljbIPMOXF4Ws3JKqfjlX9nAloTi9qyu4sK9Jnf/hMq4FQ5OCE='} 2026-02-24T18:20:14.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial114.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:39.823735', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOjgYlDhcMVpDDg3QOjc+bUhS5mYCPOk5c5J1iXGI2Wc0GYLDfGWJSJRdztrIHpSzdU4JEmlaId5bFALtu6R6nE='} 2026-02-24T18:20:14.451 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial179.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:39.823387', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGULFW0EaBE4lgocfn7NHbfH5zh0UZNaVQMA50Qa0bhW5foMqUaLZmi6HSc3IRl3nQ28psJkOoJ2Md5nmchilY='} 2026-02-24T18:20:14.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial194.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:39.822981', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCXICk0rxqUzCYyNuL17SLiFiaomCsuBXi/rwuFEIvJlEc9R9oJdwduGHS9tTtuAnOnwvU/F0XMAESc9H5OLeMw='} 2026-02-24T18:20:14.508 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T18:20:14.519 INFO:teuthology.task.internal:roles: ubuntu@trial045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-24T18:20:14.519 INFO:teuthology.task.internal:roles: ubuntu@trial114.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-24T18:20:14.519 INFO:teuthology.task.internal:roles: ubuntu@trial179.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-24T18:20:14.519 INFO:teuthology.task.internal:roles: ubuntu@trial194.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-24T18:20:14.520 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T18:20:14.763 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x719b1cca6f20>, signals=[15]) 2026-02-24T18:20:14.763 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T18:20:14.772 INFO:teuthology.task.internal:Opening connections... 2026-02-24T18:20:14.772 DEBUG:teuthology.task.internal:connecting to ubuntu@trial045.front.sepia.ceph.com 2026-02-24T18:20:14.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:14.838 DEBUG:teuthology.task.internal:connecting to ubuntu@trial114.front.sepia.ceph.com 2026-02-24T18:20:14.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:14.899 DEBUG:teuthology.task.internal:connecting to ubuntu@trial179.front.sepia.ceph.com 2026-02-24T18:20:14.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:14.963 DEBUG:teuthology.task.internal:connecting to ubuntu@trial194.front.sepia.ceph.com 2026-02-24T18:20:14.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:15.024 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T18:20:15.041 DEBUG:teuthology.orchestra.run.trial045:> uname -m 2026-02-24T18:20:15.058 INFO:teuthology.orchestra.run.trial045.stdout:x86_64 2026-02-24T18:20:15.058 DEBUG:teuthology.orchestra.run.trial045:> cat /etc/os-release 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:NAME="CentOS Stream" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:VERSION="9" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:ID="centos" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:VERSION_ID="9" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:15.113 INFO:teuthology.orchestra.run.trial045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:15.114 INFO:teuthology.lock.ops:Updating trial045.front.sepia.ceph.com on lock server 2026-02-24T18:20:15.186 DEBUG:teuthology.orchestra.run.trial114:> uname -m 2026-02-24T18:20:15.202 INFO:teuthology.orchestra.run.trial114.stdout:x86_64 2026-02-24T18:20:15.202 DEBUG:teuthology.orchestra.run.trial114:> cat /etc/os-release 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:NAME="CentOS Stream" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:VERSION="9" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:ID="centos" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:VERSION_ID="9" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:15.258 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:15.259 INFO:teuthology.lock.ops:Updating trial114.front.sepia.ceph.com on lock server 2026-02-24T18:20:15.338 DEBUG:teuthology.orchestra.run.trial179:> uname -m 2026-02-24T18:20:15.353 INFO:teuthology.orchestra.run.trial179.stdout:x86_64 2026-02-24T18:20:15.353 DEBUG:teuthology.orchestra.run.trial179:> cat /etc/os-release 2026-02-24T18:20:15.408 INFO:teuthology.orchestra.run.trial179.stdout:NAME="CentOS Stream" 2026-02-24T18:20:15.408 INFO:teuthology.orchestra.run.trial179.stdout:VERSION="9" 2026-02-24T18:20:15.408 INFO:teuthology.orchestra.run.trial179.stdout:ID="centos" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:VERSION_ID="9" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:15.409 INFO:teuthology.orchestra.run.trial179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:15.409 INFO:teuthology.lock.ops:Updating trial179.front.sepia.ceph.com on lock server 2026-02-24T18:20:15.488 DEBUG:teuthology.orchestra.run.trial194:> uname -m 2026-02-24T18:20:15.503 INFO:teuthology.orchestra.run.trial194.stdout:x86_64 2026-02-24T18:20:15.504 DEBUG:teuthology.orchestra.run.trial194:> cat /etc/os-release 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:NAME="CentOS Stream" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:VERSION="9" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:ID="centos" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:VERSION_ID="9" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:15.560 INFO:teuthology.orchestra.run.trial194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:15.561 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:15.561 INFO:teuthology.orchestra.run.trial194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:15.561 INFO:teuthology.lock.ops:Updating trial194.front.sepia.ceph.com on lock server 2026-02-24T18:20:15.644 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T18:20:15.657 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T18:20:15.669 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T18:20:15.669 DEBUG:teuthology.orchestra.run.trial045:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:15.671 DEBUG:teuthology.orchestra.run.trial114:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:15.672 DEBUG:teuthology.orchestra.run.trial179:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:15.674 DEBUG:teuthology.orchestra.run.trial194:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:15.689 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T18:20:15.700 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T18:20:15.701 DEBUG:teuthology.orchestra.run.trial045:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:15.728 DEBUG:teuthology.orchestra.run.trial114:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:15.730 DEBUG:teuthology.orchestra.run.trial179:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:15.732 DEBUG:teuthology.orchestra.run.trial194:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:15.749 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T18:20:16.033 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T18:20:16.053 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-24T18:20:16.053 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-24T18:20:16.053 DEBUG:teuthology.orchestra.run.trial045:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:16.054 DEBUG:teuthology.orchestra.run.trial114:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:16.054 DEBUG:teuthology.orchestra.run.trial179:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:16.054 DEBUG:teuthology.orchestra.run.trial194:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:16.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:16.069 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-24T18:20:16.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:16.069 DEBUG:teuthology.orchestra.run.trial194:> uname -r 2026-02-24T18:20:16.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:16.070 DEBUG:teuthology.orchestra.run.trial179:> uname -r 2026-02-24T18:20:16.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:16.070 DEBUG:teuthology.orchestra.run.trial045:> uname -r 2026-02-24T18:20:16.123 INFO:teuthology.orchestra.run.trial114.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:16.124 INFO:teuthology.task.kernel:Running kernel on trial114: 5.14.0-681.el9.x86_64 2026-02-24T18:20:16.124 DEBUG:teuthology.orchestra.run.trial114:> sudo yum install -y kernel 2026-02-24T18:20:16.124 INFO:teuthology.orchestra.run.trial179.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:16.124 INFO:teuthology.task.kernel:Running kernel on trial179: 5.14.0-681.el9.x86_64 2026-02-24T18:20:16.124 DEBUG:teuthology.orchestra.run.trial179:> sudo yum install -y kernel 2026-02-24T18:20:16.126 INFO:teuthology.orchestra.run.trial194.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:16.126 INFO:teuthology.task.kernel:Running kernel on trial194: 5.14.0-681.el9.x86_64 2026-02-24T18:20:16.126 DEBUG:teuthology.orchestra.run.trial194:> sudo yum install -y kernel 2026-02-24T18:20:16.127 INFO:teuthology.orchestra.run.trial045.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:16.127 INFO:teuthology.task.kernel:Running kernel on trial045: 5.14.0-681.el9.x86_64 2026-02-24T18:20:16.127 DEBUG:teuthology.orchestra.run.trial045:> sudo yum install -y kernel 2026-02-24T18:20:17.348 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-24T18:20:17.394 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-24T18:20:17.414 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.9 MB 00:00 2026-02-24T18:20:18.326 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - AppStream 71 MB/s | 27 MB 00:00 2026-02-24T18:20:19.239 INFO:teuthology.orchestra.run.trial179.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.9 MB 00:02 2026-02-24T18:20:19.906 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-24T18:20:20.081 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-24T18:20:20.986 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - CRB 28 MB/s | 8.0 MB 00:00 2026-02-24T18:20:21.815 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - Extras packages 213 kB/s | 20 kB 00:00 2026-02-24T18:20:22.314 INFO:teuthology.orchestra.run.trial179.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-24T18:20:22.316 INFO:teuthology.orchestra.run.trial194.stdout:Extra Packages for Enterprise Linux 47 MB/s | 20 MB 00:00 2026-02-24T18:20:23.969 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 8.0 MB 00:01 2026-02-24T18:20:24.124 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 8.0 MB 00:01 2026-02-24T18:20:25.525 INFO:teuthology.orchestra.run.trial194.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-24T18:20:25.681 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-24T18:20:25.743 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-24T18:20:26.536 INFO:teuthology.orchestra.run.trial194.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:26.537 INFO:teuthology.orchestra.run.trial194.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:26.553 INFO:teuthology.orchestra.run.trial045.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2026-02-24T18:20:26.557 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:20:26.558 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:20:26.558 INFO:teuthology.orchestra.run.trial194.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:26.558 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:20:26.558 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout:Install 4 Packages 2026-02-24T18:20:26.559 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:20:26.560 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 89 M 2026-02-24T18:20:26.560 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 135 M 2026-02-24T18:20:26.560 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:20:26.560 INFO:teuthology.orchestra.run.trial179.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 8.0 MB 00:01 2026-02-24T18:20:26.655 INFO:teuthology.orchestra.run.trial114.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2026-02-24T18:20:27.451 INFO:teuthology.orchestra.run.trial194.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 1.1 MB/s | 901 kB 00:00 2026-02-24T18:20:28.101 INFO:teuthology.orchestra.run.trial179.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-24T18:20:28.522 INFO:teuthology.orchestra.run.trial194.stdout:(2/4): kernel-modules-core-5.14.0-686.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-24T18:20:28.524 INFO:teuthology.orchestra.run.trial179.stdout:Extra Packages for Enterprise Linux 56 MB/s | 20 MB 00:00 2026-02-24T18:20:28.893 INFO:teuthology.orchestra.run.trial194.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 18 MB/s | 40 MB 00:02 2026-02-24T18:20:29.694 INFO:teuthology.orchestra.run.trial045.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-24T18:20:29.945 INFO:teuthology.orchestra.run.trial114.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-24T18:20:30.704 INFO:teuthology.orchestra.run.trial045.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:30.704 INFO:teuthology.orchestra.run.trial045.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:30.724 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:Install 4 Packages 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 89 M 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 135 M 2026-02-24T18:20:30.725 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:20:30.958 INFO:teuthology.orchestra.run.trial114.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:30.958 INFO:teuthology.orchestra.run.trial114.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:30.978 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:20:30.979 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:20:30.980 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:30.980 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:20:30.980 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:20:30.980 INFO:teuthology.orchestra.run.trial114.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:30.980 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:20:30.980 INFO:teuthology.orchestra.run.trial114.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:30.980 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:30.980 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:30.981 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:20:30.981 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:20:30.981 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:20:30.981 INFO:teuthology.orchestra.run.trial114.stdout:Install 4 Packages 2026-02-24T18:20:30.981 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:20:30.981 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 89 M 2026-02-24T18:20:30.981 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 135 M 2026-02-24T18:20:30.981 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:20:30.984 INFO:teuthology.orchestra.run.trial045.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 4.4 MB/s | 901 kB 00:00 2026-02-24T18:20:31.116 INFO:teuthology.orchestra.run.trial114.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 16 MB/s | 901 kB 00:00 2026-02-24T18:20:31.167 INFO:teuthology.orchestra.run.trial045.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 45 MB/s | 17 MB 00:00 2026-02-24T18:20:31.195 INFO:teuthology.orchestra.run.trial114.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 130 MB/s | 17 MB 00:00 2026-02-24T18:20:31.352 INFO:teuthology.orchestra.run.trial045.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 70 MB/s | 40 MB 00:00 2026-02-24T18:20:31.393 INFO:teuthology.orchestra.run.trial045.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 76 MB/s | 31 MB 00:00 2026-02-24T18:20:31.393 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:31.393 INFO:teuthology.orchestra.run.trial045.stdout:Total 133 MB/s | 89 MB 00:00 2026-02-24T18:20:31.582 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:20:31.598 INFO:teuthology.orchestra.run.trial194.stdout:(4/4): kernel-core-5.14.0-686.el9.x86_64.rpm 3.5 MB/s | 17 MB 00:04 2026-02-24T18:20:31.600 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:31.600 INFO:teuthology.orchestra.run.trial194.stdout:Total 18 MB/s | 89 MB 00:05 2026-02-24T18:20:31.734 INFO:teuthology.orchestra.run.trial179.stdout:lab-extras 2.9 MB/s | 50 kB 00:00 2026-02-24T18:20:31.779 INFO:teuthology.orchestra.run.trial114.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 56 MB/s | 40 MB 00:00 2026-02-24T18:20:31.785 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:20:31.785 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:20:31.792 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:20:31.990 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:20:31.991 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:20:32.112 INFO:teuthology.orchestra.run.trial114.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 31 MB/s | 31 MB 00:00 2026-02-24T18:20:32.112 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:32.112 INFO:teuthology.orchestra.run.trial114.stdout:Total 78 MB/s | 89 MB 00:01 2026-02-24T18:20:32.169 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:20:32.169 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:20:32.303 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:20:32.375 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:20:32.376 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:20:32.502 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:20:32.502 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:20:32.744 INFO:teuthology.orchestra.run.trial179.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:32.744 INFO:teuthology.orchestra.run.trial179.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:32.764 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:20:32.765 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:20:32.765 INFO:teuthology.orchestra.run.trial179.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:32.765 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:20:32.766 INFO:teuthology.orchestra.run.trial179.stdout:Install 4 Packages 2026-02-24T18:20:32.767 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:20:32.767 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 89 M 2026-02-24T18:20:32.767 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 135 M 2026-02-24T18:20:32.767 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:20:32.885 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:20:32.886 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:20:32.887 INFO:teuthology.orchestra.run.trial179.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 23 MB/s | 901 kB 00:00 2026-02-24T18:20:32.987 INFO:teuthology.orchestra.run.trial179.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 125 MB/s | 17 MB 00:00 2026-02-24T18:20:33.278 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:20:33.361 INFO:teuthology.orchestra.run.trial179.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 78 MB/s | 40 MB 00:00 2026-02-24T18:20:33.414 INFO:teuthology.orchestra.run.trial179.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 59 MB/s | 31 MB 00:00 2026-02-24T18:20:33.414 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:33.414 INFO:teuthology.orchestra.run.trial179.stdout:Total 137 MB/s | 89 MB 00:00 2026-02-24T18:20:33.478 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:20:33.566 INFO:teuthology.orchestra.run.trial045.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:33.589 INFO:teuthology.orchestra.run.trial045.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:33.603 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:20:33.766 INFO:teuthology.orchestra.run.trial194.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:33.787 INFO:teuthology.orchestra.run.trial194.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:33.806 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:20:33.807 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:20:34.027 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:20:34.189 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:20:34.189 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:20:34.337 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:34.359 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:35.300 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:20:35.590 INFO:teuthology.orchestra.run.trial179.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:35.612 INFO:teuthology.orchestra.run.trial179.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:36.154 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:36.187 INFO:teuthology.orchestra.run.trial045.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:36.344 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:36.378 INFO:teuthology.orchestra.run.trial194.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:36.916 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:36.949 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:38.165 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:38.198 INFO:teuthology.orchestra.run.trial179.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:39.287 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:39.294 INFO:teuthology.orchestra.run.trial045.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:39.419 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:39.426 INFO:teuthology.orchestra.run.trial194.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:39.984 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:39.991 INFO:teuthology.orchestra.run.trial114.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:41.460 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:41.466 INFO:teuthology.orchestra.run.trial179.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:42.405 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:42.544 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:43.036 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:44.515 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:59.995 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.016 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.078 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.100 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.203 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.204 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:21:00.204 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:21:00.204 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:21:00.262 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.262 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:21:00.262 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:21:00.263 INFO:teuthology.orchestra.run.trial045.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.263 INFO:teuthology.orchestra.run.trial045.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.263 INFO:teuthology.orchestra.run.trial045.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.263 INFO:teuthology.orchestra.run.trial045.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.263 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:21:00.263 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:21:00.287 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.287 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:21:00.288 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:21:00.288 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:21:00.326 DEBUG:teuthology.orchestra.run.trial045:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:00.344 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.344 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:21:00.345 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:21:00.345 INFO:teuthology.orchestra.run.trial194.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.345 INFO:teuthology.orchestra.run.trial194.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.345 INFO:teuthology.orchestra.run.trial194.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.345 INFO:teuthology.orchestra.run.trial194.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.345 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:21:00.345 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:21:00.356 INFO:teuthology.orchestra.run.trial045.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.357 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.357 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.357 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:21:00.357 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:21:00.357 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-24T18:21:00.358 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial045.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:21:00.358 DEBUG:teuthology.orchestra.run.trial045:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:00.374 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.396 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.404 DEBUG:teuthology.orchestra.run.trial194:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:00.422 INFO:teuthology.orchestra.run.trial045.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.423 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.423 DEBUG:teuthology.orchestra.run.trial045:> sudo rpm -qi grub2-tools 2026-02-24T18:21:00.432 INFO:teuthology.orchestra.run.trial194.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.433 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.433 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.434 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:21:00.434 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:21:00.434 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-24T18:21:00.434 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial194.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:21:00.434 DEBUG:teuthology.orchestra.run.trial194:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:00.491 INFO:teuthology.orchestra.run.trial045.stdout:Name : grub2-tools 2026-02-24T18:21:00.491 INFO:teuthology.orchestra.run.trial045.stdout:Epoch : 1 2026-02-24T18:21:00.492 INFO:teuthology.orchestra.run.trial045.stdout:Version : 2.06 2026-02-24T18:21:00.492 INFO:teuthology.orchestra.run.trial045.stdout:Release : 120.el9 2026-02-24T18:21:00.492 INFO:teuthology.orchestra.run.trial045.stdout:Architecture: x86_64 2026-02-24T18:21:00.492 INFO:teuthology.orchestra.run.trial045.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:21:00.492 INFO:teuthology.orchestra.run.trial045.stdout:Group : Unspecified 2026-02-24T18:21:00.492 INFO:teuthology.orchestra.run.trial045.stdout:Size : 9108611 2026-02-24T18:21:00.492 INFO:teuthology.orchestra.run.trial045.stdout:License : GPLv3+ 2026-02-24T18:21:00.492 INFO:teuthology.orchestra.run.trial045.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:21:00.492 INFO:teuthology.orchestra.run.trial045.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout:Packager : builder@centos.org 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout:Vendor : CentOS 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout:Summary : Support tools for GRUB. 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout:Description : 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:21:00.493 INFO:teuthology.orchestra.run.trial045.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:21:00.494 INFO:teuthology.orchestra.run.trial045.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:21:00.494 INFO:teuthology.orchestra.run.trial045.stdout:hardware devices. 2026-02-24T18:21:00.494 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:21:00.494 INFO:teuthology.orchestra.run.trial045.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:21:00.495 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:21:00.495 INFO:teuthology.task.kernel:Updating grub on trial045 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.495 DEBUG:teuthology.orchestra.run.trial045:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:21:00.501 INFO:teuthology.orchestra.run.trial194.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.502 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.502 DEBUG:teuthology.orchestra.run.trial194:> sudo rpm -qi grub2-tools 2026-02-24T18:21:00.557 INFO:teuthology.orchestra.run.trial045.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:21:00.558 DEBUG:teuthology.orchestra.run.trial045:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Name : grub2-tools 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Epoch : 1 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Version : 2.06 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Release : 120.el9 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Architecture: x86_64 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Group : Unspecified 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Size : 9108611 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:License : GPLv3+ 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:21:00.570 INFO:teuthology.orchestra.run.trial194.stdout:Packager : builder@centos.org 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout:Vendor : CentOS 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout:Summary : Support tools for GRUB. 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout:Description : 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout:hardware devices. 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:21:00.571 INFO:teuthology.orchestra.run.trial194.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:21:00.572 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:21:00.572 INFO:teuthology.task.kernel:Updating grub on trial194 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.572 DEBUG:teuthology.orchestra.run.trial194:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:21:00.581 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.581 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:21:00.581 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:21:00.581 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:21:00.624 INFO:teuthology.orchestra.run.trial045.stdout:/sbin/grubby 2026-02-24T18:21:00.626 INFO:teuthology.orchestra.run.trial045.stdout:yes 2026-02-24T18:21:00.626 DEBUG:teuthology.orchestra.run.trial045:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:21:00.636 INFO:teuthology.orchestra.run.trial194.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:21:00.637 DEBUG:teuthology.orchestra.run.trial194:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:21:00.638 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:00.638 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:21:00.638 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:21:00.638 INFO:teuthology.orchestra.run.trial114.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.638 INFO:teuthology.orchestra.run.trial114.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.638 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.638 INFO:teuthology.orchestra.run.trial114.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.638 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:21:00.638 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:21:00.690 INFO:teuthology.orchestra.run.trial045.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:21:00.690 DEBUG:teuthology.orchestra.run.trial045:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.697 DEBUG:teuthology.orchestra.run.trial114:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:00.703 INFO:teuthology.orchestra.run.trial194.stdout:/sbin/grubby 2026-02-24T18:21:00.704 INFO:teuthology.orchestra.run.trial194.stdout:yes 2026-02-24T18:21:00.704 DEBUG:teuthology.orchestra.run.trial194:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:21:00.725 INFO:teuthology.orchestra.run.trial114.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.726 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.726 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.726 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:21:00.726 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:21:00.726 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-24T18:21:00.726 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial114.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:21:00.726 DEBUG:teuthology.orchestra.run.trial114:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:00.762 DEBUG:teuthology.orchestra.run.trial045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:21:00.770 INFO:teuthology.orchestra.run.trial194.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:21:00.771 DEBUG:teuthology.orchestra.run.trial194:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.792 INFO:teuthology.orchestra.run.trial114.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:00.793 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.793 DEBUG:teuthology.orchestra.run.trial114:> sudo rpm -qi grub2-tools 2026-02-24T18:21:00.843 DEBUG:teuthology.orchestra.run.trial194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:21:00.862 INFO:teuthology.orchestra.run.trial114.stdout:Name : grub2-tools 2026-02-24T18:21:00.862 INFO:teuthology.orchestra.run.trial114.stdout:Epoch : 1 2026-02-24T18:21:00.862 INFO:teuthology.orchestra.run.trial114.stdout:Version : 2.06 2026-02-24T18:21:00.862 INFO:teuthology.orchestra.run.trial114.stdout:Release : 120.el9 2026-02-24T18:21:00.862 INFO:teuthology.orchestra.run.trial114.stdout:Architecture: x86_64 2026-02-24T18:21:00.862 INFO:teuthology.orchestra.run.trial114.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:21:00.862 INFO:teuthology.orchestra.run.trial114.stdout:Group : Unspecified 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:Size : 9108611 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:License : GPLv3+ 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:Packager : builder@centos.org 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:Vendor : CentOS 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:Summary : Support tools for GRUB. 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:Description : 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:21:00.863 INFO:teuthology.orchestra.run.trial114.stdout:hardware devices. 2026-02-24T18:21:00.864 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:21:00.864 INFO:teuthology.orchestra.run.trial114.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:21:00.864 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:21:00.865 INFO:teuthology.task.kernel:Updating grub on trial114 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:21:00.865 DEBUG:teuthology.orchestra.run.trial114:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:21:00.928 INFO:teuthology.orchestra.run.trial114.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:21:00.929 DEBUG:teuthology.orchestra.run.trial114:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:21:00.974 INFO:teuthology.orchestra.run.trial045.stderr:Generating grub configuration file ... 2026-02-24T18:21:00.991 INFO:teuthology.orchestra.run.trial114.stdout:/sbin/grubby 2026-02-24T18:21:00.993 INFO:teuthology.orchestra.run.trial114.stdout:yes 2026-02-24T18:21:00.993 DEBUG:teuthology.orchestra.run.trial114:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:21:01.041 INFO:teuthology.orchestra.run.trial045.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.048 INFO:teuthology.orchestra.run.trial045.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:21:01.053 INFO:teuthology.orchestra.run.trial194.stderr:Generating grub configuration file ... 2026-02-24T18:21:01.055 INFO:teuthology.orchestra.run.trial114.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:21:01.055 DEBUG:teuthology.orchestra.run.trial114:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.122 INFO:teuthology.orchestra.run.trial194.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.128 DEBUG:teuthology.orchestra.run.trial114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:21:01.129 INFO:teuthology.orchestra.run.trial194.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:21:01.300 INFO:teuthology.orchestra.run.trial045.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:21:01.307 INFO:teuthology.orchestra.run.trial045.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:21:01.332 INFO:teuthology.orchestra.run.trial114.stderr:Generating grub configuration file ... 2026-02-24T18:21:01.342 INFO:teuthology.orchestra.run.trial045.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:21:01.348 INFO:teuthology.orchestra.run.trial045.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:21:01.379 INFO:teuthology.orchestra.run.trial045.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:21:01.381 INFO:teuthology.orchestra.run.trial194.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:21:01.386 INFO:teuthology.orchestra.run.trial045.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:21:01.388 INFO:teuthology.orchestra.run.trial194.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:21:01.399 INFO:teuthology.orchestra.run.trial114.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:21:01.407 INFO:teuthology.orchestra.run.trial114.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:21:01.409 INFO:teuthology.orchestra.run.trial045.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:21:01.415 INFO:teuthology.orchestra.run.trial045.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:21:01.422 INFO:teuthology.orchestra.run.trial194.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:21:01.429 INFO:teuthology.orchestra.run.trial194.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:21:01.459 INFO:teuthology.orchestra.run.trial194.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:21:01.466 INFO:teuthology.orchestra.run.trial194.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:21:01.489 INFO:teuthology.orchestra.run.trial194.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:21:01.495 INFO:teuthology.orchestra.run.trial194.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:21:01.503 INFO:teuthology.orchestra.run.trial045.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:21:01.511 INFO:teuthology.orchestra.run.trial045.stderr:done 2026-02-24T18:21:01.512 DEBUG:teuthology.orchestra.run.trial045:> test -d /sys/firmware/efi 2026-02-24T18:21:01.528 DEBUG:teuthology.orchestra.run.trial045:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:21:01.582 INFO:teuthology.orchestra.run.trial194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:21:01.591 INFO:teuthology.orchestra.run.trial194.stderr:done 2026-02-24T18:21:01.592 DEBUG:teuthology.orchestra.run.trial194:> test -d /sys/firmware/efi 2026-02-24T18:21:01.594 INFO:teuthology.orchestra.run.trial045.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:21:01.594 INFO:teuthology.orchestra.run.trial045.stdout:/boot/efi/EFI/centos 2026-02-24T18:21:01.596 DEBUG:teuthology.orchestra.run.trial045:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:21:01.607 DEBUG:teuthology.orchestra.run.trial194:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:21:01.656 INFO:teuthology.orchestra.run.trial114.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:21:01.663 INFO:teuthology.orchestra.run.trial045.stdout:no 2026-02-24T18:21:01.663 DEBUG:teuthology.orchestra.run.trial045:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:21:01.664 INFO:teuthology.orchestra.run.trial114.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:21:01.673 INFO:teuthology.orchestra.run.trial194.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:21:01.673 INFO:teuthology.orchestra.run.trial194.stdout:/boot/efi/EFI/centos 2026-02-24T18:21:01.675 DEBUG:teuthology.orchestra.run.trial194:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:21:01.697 INFO:teuthology.orchestra.run.trial114.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:21:01.703 INFO:teuthology.orchestra.run.trial114.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:21:01.729 INFO:teuthology.orchestra.run.trial045.stdout:yes 2026-02-24T18:21:01.729 DEBUG:teuthology.orchestra.run.trial045:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:21:01.735 INFO:teuthology.orchestra.run.trial114.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:21:01.740 INFO:teuthology.orchestra.run.trial194.stdout:no 2026-02-24T18:21:01.741 DEBUG:teuthology.orchestra.run.trial194:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:21:01.741 INFO:teuthology.orchestra.run.trial114.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:21:01.765 INFO:teuthology.orchestra.run.trial114.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:21:01.772 INFO:teuthology.orchestra.run.trial114.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:21:01.792 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial045 2026-02-24T18:21:01.793 DEBUG:teuthology.orchestra.run.trial045:> sudo bash -c ' 2026-02-24T18:21:01.793 DEBUG:teuthology.orchestra.run.trial045:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:21:01.793 DEBUG:teuthology.orchestra.run.trial045:> ' 2026-02-24T18:21:01.804 INFO:teuthology.orchestra.run.trial194.stdout:yes 2026-02-24T18:21:01.805 DEBUG:teuthology.orchestra.run.trial194:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:21:01.856 INFO:teuthology.orchestra.run.trial114.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:21:01.865 INFO:teuthology.orchestra.run.trial114.stderr:done 2026-02-24T18:21:01.867 DEBUG:teuthology.orchestra.run.trial114:> test -d /sys/firmware/efi 2026-02-24T18:21:01.868 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial194 2026-02-24T18:21:01.868 DEBUG:teuthology.orchestra.run.trial194:> sudo bash -c ' 2026-02-24T18:21:01.868 DEBUG:teuthology.orchestra.run.trial194:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:21:01.868 DEBUG:teuthology.orchestra.run.trial194:> ' 2026-02-24T18:21:01.883 DEBUG:teuthology.orchestra.run.trial114:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:21:01.949 INFO:teuthology.orchestra.run.trial114.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:21:01.949 INFO:teuthology.orchestra.run.trial114.stdout:/boot/efi/EFI/centos 2026-02-24T18:21:01.951 DEBUG:teuthology.orchestra.run.trial114:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:21:01.965 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:01.987 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:02.017 INFO:teuthology.orchestra.run.trial114.stdout:no 2026-02-24T18:21:02.017 DEBUG:teuthology.orchestra.run.trial114:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:21:02.082 INFO:teuthology.orchestra.run.trial114.stdout:yes 2026-02-24T18:21:02.083 DEBUG:teuthology.orchestra.run.trial114:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:21:02.147 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial114 2026-02-24T18:21:02.147 DEBUG:teuthology.orchestra.run.trial114:> sudo bash -c ' 2026-02-24T18:21:02.147 DEBUG:teuthology.orchestra.run.trial114:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:21:02.147 DEBUG:teuthology.orchestra.run.trial114:> ' 2026-02-24T18:21:02.173 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:02.173 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:21:02.174 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:21:02.174 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:21:02.230 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:02.231 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:21:02.231 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:21:02.231 INFO:teuthology.orchestra.run.trial179.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:02.231 INFO:teuthology.orchestra.run.trial179.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:02.231 INFO:teuthology.orchestra.run.trial179.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:21:02.231 INFO:teuthology.orchestra.run.trial179.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:02.231 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:21:02.231 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:21:02.293 DEBUG:teuthology.orchestra.run.trial179:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:02.322 INFO:teuthology.orchestra.run.trial179.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:02.323 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:02.323 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:21:02.324 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:21:02.324 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:21:02.324 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-24T18:21:02.324 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial179.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:21:02.324 DEBUG:teuthology.orchestra.run.trial179:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:02.388 INFO:teuthology.orchestra.run.trial179.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:02.389 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:02.389 DEBUG:teuthology.orchestra.run.trial179:> sudo rpm -qi grub2-tools 2026-02-24T18:21:02.458 INFO:teuthology.orchestra.run.trial179.stdout:Name : grub2-tools 2026-02-24T18:21:02.458 INFO:teuthology.orchestra.run.trial179.stdout:Epoch : 1 2026-02-24T18:21:02.458 INFO:teuthology.orchestra.run.trial179.stdout:Version : 2.06 2026-02-24T18:21:02.458 INFO:teuthology.orchestra.run.trial179.stdout:Release : 120.el9 2026-02-24T18:21:02.458 INFO:teuthology.orchestra.run.trial179.stdout:Architecture: x86_64 2026-02-24T18:21:02.458 INFO:teuthology.orchestra.run.trial179.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:21:02.458 INFO:teuthology.orchestra.run.trial179.stdout:Group : Unspecified 2026-02-24T18:21:02.458 INFO:teuthology.orchestra.run.trial179.stdout:Size : 9108611 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:License : GPLv3+ 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:Packager : builder@centos.org 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:Vendor : CentOS 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:Summary : Support tools for GRUB. 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:Description : 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:21:02.459 INFO:teuthology.orchestra.run.trial179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:21:02.460 INFO:teuthology.orchestra.run.trial179.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:21:02.460 INFO:teuthology.orchestra.run.trial179.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:21:02.460 INFO:teuthology.orchestra.run.trial179.stdout:hardware devices. 2026-02-24T18:21:02.460 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:21:02.460 INFO:teuthology.orchestra.run.trial179.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:21:02.461 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:21:02.461 INFO:teuthology.task.kernel:Updating grub on trial179 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:21:02.461 DEBUG:teuthology.orchestra.run.trial179:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:21:02.524 INFO:teuthology.orchestra.run.trial179.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:21:02.526 DEBUG:teuthology.orchestra.run.trial179:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:21:02.589 INFO:teuthology.orchestra.run.trial179.stdout:/sbin/grubby 2026-02-24T18:21:02.590 INFO:teuthology.orchestra.run.trial179.stdout:yes 2026-02-24T18:21:02.590 DEBUG:teuthology.orchestra.run.trial179:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:21:02.654 INFO:teuthology.orchestra.run.trial179.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:21:02.654 DEBUG:teuthology.orchestra.run.trial179:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:21:02.726 DEBUG:teuthology.orchestra.run.trial179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:21:02.931 INFO:teuthology.orchestra.run.trial179.stderr:Generating grub configuration file ... 2026-02-24T18:21:03.000 INFO:teuthology.orchestra.run.trial179.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:21:03.007 INFO:teuthology.orchestra.run.trial179.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:21:03.260 INFO:teuthology.orchestra.run.trial179.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:21:03.267 INFO:teuthology.orchestra.run.trial179.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:21:03.301 INFO:teuthology.orchestra.run.trial179.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:21:03.308 INFO:teuthology.orchestra.run.trial179.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:21:03.339 INFO:teuthology.orchestra.run.trial179.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:21:03.346 INFO:teuthology.orchestra.run.trial179.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:21:03.369 INFO:teuthology.orchestra.run.trial179.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:21:03.375 INFO:teuthology.orchestra.run.trial179.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:21:03.462 INFO:teuthology.orchestra.run.trial179.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:21:03.471 INFO:teuthology.orchestra.run.trial179.stderr:done 2026-02-24T18:21:03.473 DEBUG:teuthology.orchestra.run.trial179:> test -d /sys/firmware/efi 2026-02-24T18:21:03.490 DEBUG:teuthology.orchestra.run.trial179:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:21:03.555 INFO:teuthology.orchestra.run.trial179.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:21:03.555 INFO:teuthology.orchestra.run.trial179.stdout:/boot/efi/EFI/centos 2026-02-24T18:21:03.557 DEBUG:teuthology.orchestra.run.trial179:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:21:03.623 INFO:teuthology.orchestra.run.trial179.stdout:no 2026-02-24T18:21:03.624 DEBUG:teuthology.orchestra.run.trial179:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:21:03.687 INFO:teuthology.orchestra.run.trial179.stdout:yes 2026-02-24T18:21:03.688 DEBUG:teuthology.orchestra.run.trial179:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:21:03.751 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial179 2026-02-24T18:21:03.751 DEBUG:teuthology.orchestra.run.trial179:> sudo bash -c ' 2026-02-24T18:21:03.751 DEBUG:teuthology.orchestra.run.trial179:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:21:03.751 DEBUG:teuthology.orchestra.run.trial179:> ' 2026-02-24T18:21:31.836 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-24T18:21:31.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-24T18:21:31.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:21:31.912 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-24T18:21:31.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-24T18:21:31.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:21:32.190 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-24T18:21:32.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-24T18:21:32.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:21:33.794 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-24T18:21:33.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial179.front.sepia.ceph.com' 2026-02-24T18:21:33.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:31.898 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:31.916 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:32.194 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:33.798 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:40.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-24T18:22:40.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:40.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-24T18:22:40.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:41.035 DEBUG:teuthology.orchestra.run.trial045:> true 2026-02-24T18:22:41.137 DEBUG:teuthology.orchestra.run.trial194:> true 2026-02-24T18:22:41.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-24T18:22:41.192 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:41.192 DEBUG:teuthology.orchestra.run.trial045:> uname -r 2026-02-24T18:22:41.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-24T18:22:41.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:41.321 INFO:teuthology.orchestra.run.trial045.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:41.321 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:41.321 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:41.321 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:41.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-24T18:22:41.322 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:41.322 DEBUG:teuthology.orchestra.run.trial194:> uname -r 2026-02-24T18:22:41.322 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-24T18:22:41.377 INFO:teuthology.orchestra.run.trial194.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:41.377 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:41.377 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:41.377 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:41.474 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-24T18:22:41.474 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:41.474 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-24T18:22:41.530 INFO:teuthology.orchestra.run.trial114.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:41.531 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:41.531 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:41.531 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:42.322 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-24T18:22:42.322 DEBUG:teuthology.orchestra.run.trial045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:42.352 INFO:teuthology.orchestra.run.trial045.stdout:ttyS1 2026-02-24T18:22:42.379 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-24T18:22:42.379 DEBUG:teuthology.orchestra.run.trial194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:42.382 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:42.410 INFO:teuthology.orchestra.run.trial194.stdout:ttyS1 2026-02-24T18:22:42.435 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:42.532 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-24T18:22:42.533 DEBUG:teuthology.orchestra.run.trial114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:42.561 INFO:teuthology.orchestra.run.trial114.stdout:ttyS1 2026-02-24T18:22:42.585 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:42.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial179.front.sepia.ceph.com' 2026-02-24T18:22:42.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:42.889 DEBUG:teuthology.orchestra.run.trial179:> true 2026-02-24T18:22:43.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial179.front.sepia.ceph.com' 2026-02-24T18:22:43.049 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:43.049 DEBUG:teuthology.orchestra.run.trial179:> uname -r 2026-02-24T18:22:43.105 INFO:teuthology.orchestra.run.trial179.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:43.105 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:43.106 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:43.106 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:44.106 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-24T18:22:44.107 DEBUG:teuthology.orchestra.run.trial179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:44.137 INFO:teuthology.orchestra.run.trial179.stdout:ttyS1 2026-02-24T18:22:44.156 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:44.157 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T18:22:44.168 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T18:22:44.168 DEBUG:teuthology.orchestra.run.trial045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:44.170 DEBUG:teuthology.orchestra.run.trial114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:44.171 DEBUG:teuthology.orchestra.run.trial179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:44.199 DEBUG:teuthology.orchestra.run.trial194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:44.216 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T18:22:44.227 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T18:22:44.239 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T18:22:44.239 DEBUG:teuthology.orchestra.run.trial045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:44.240 DEBUG:teuthology.orchestra.run.trial114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:44.242 DEBUG:teuthology.orchestra.run.trial179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:44.254 DEBUG:teuthology.orchestra.run.trial194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:44.277 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T18:22:44.288 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T18:22:44.288 DEBUG:teuthology.orchestra.run.trial045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:44.296 DEBUG:teuthology.orchestra.run.trial114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:44.298 DEBUG:teuthology.orchestra.run.trial179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:44.310 DEBUG:teuthology.orchestra.run.trial194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:44.318 INFO:teuthology.orchestra.run.trial045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:44.320 INFO:teuthology.orchestra.run.trial114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:44.326 INFO:teuthology.orchestra.run.trial045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:44.329 INFO:teuthology.orchestra.run.trial114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:44.331 INFO:teuthology.orchestra.run.trial179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:44.336 INFO:teuthology.orchestra.run.trial194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:44.340 INFO:teuthology.orchestra.run.trial179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:44.344 INFO:teuthology.orchestra.run.trial194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:44.346 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T18:22:44.358 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T18:22:44.359 DEBUG:teuthology.orchestra.run.trial045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:44.370 DEBUG:teuthology.orchestra.run.trial114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:44.373 DEBUG:teuthology.orchestra.run.trial179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:44.383 DEBUG:teuthology.orchestra.run.trial194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:44.409 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T18:22:44.429 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T18:22:44.430 DEBUG:teuthology.orchestra.run.trial045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:44.434 DEBUG:teuthology.orchestra.run.trial114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:44.437 DEBUG:teuthology.orchestra.run.trial179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:44.446 DEBUG:teuthology.orchestra.run.trial194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:44.465 DEBUG:teuthology.orchestra.run.trial045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:44.593 DEBUG:teuthology.orchestra.run.trial045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:44.616 DEBUG:teuthology.orchestra.run.trial045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:44.756 DEBUG:teuthology.orchestra.run.trial045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:44.781 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T18:22:44.781 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:44.844 DEBUG:teuthology.orchestra.run.trial114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:44.926 DEBUG:teuthology.orchestra.run.trial114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:44.950 DEBUG:teuthology.orchestra.run.trial114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:45.078 DEBUG:teuthology.orchestra.run.trial114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:45.103 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T18:22:45.103 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:45.167 DEBUG:teuthology.orchestra.run.trial179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:45.286 DEBUG:teuthology.orchestra.run.trial179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:45.311 DEBUG:teuthology.orchestra.run.trial179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:45.451 DEBUG:teuthology.orchestra.run.trial179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:45.475 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T18:22:45.475 DEBUG:teuthology.orchestra.run.trial179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:45.540 DEBUG:teuthology.orchestra.run.trial194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:45.642 DEBUG:teuthology.orchestra.run.trial194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:45.666 DEBUG:teuthology.orchestra.run.trial194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:45.800 DEBUG:teuthology.orchestra.run.trial194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:45.824 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T18:22:45.824 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:45.888 DEBUG:teuthology.orchestra.run.trial045:> sudo service rsyslog restart 2026-02-24T18:22:45.891 DEBUG:teuthology.orchestra.run.trial114:> sudo service rsyslog restart 2026-02-24T18:22:45.893 DEBUG:teuthology.orchestra.run.trial179:> sudo service rsyslog restart 2026-02-24T18:22:45.896 DEBUG:teuthology.orchestra.run.trial194:> sudo service rsyslog restart 2026-02-24T18:22:45.918 INFO:teuthology.orchestra.run.trial045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:22:45.920 INFO:teuthology.orchestra.run.trial114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:22:45.923 INFO:teuthology.orchestra.run.trial179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:22:45.956 INFO:teuthology.orchestra.run.trial194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:22:46.334 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T18:22:46.355 INFO:teuthology.task.internal:Starting timer... 2026-02-24T18:22:46.356 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T18:22:46.369 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T18:22:46.383 DEBUG:teuthology.orchestra.run.trial045:> sudo service auditd rotate 2026-02-24T18:22:46.412 INFO:teuthology.orchestra.run.trial045.stdout:Rotating logs: 2026-02-24T18:22:46.414 DEBUG:teuthology.orchestra.run.trial114:> sudo service auditd rotate 2026-02-24T18:22:46.445 INFO:teuthology.orchestra.run.trial114.stdout:Rotating logs: 2026-02-24T18:22:46.447 DEBUG:teuthology.orchestra.run.trial179:> sudo service auditd rotate 2026-02-24T18:22:46.477 INFO:teuthology.orchestra.run.trial179.stdout:Rotating logs: 2026-02-24T18:22:46.479 DEBUG:teuthology.orchestra.run.trial194:> sudo service auditd rotate 2026-02-24T18:22:46.508 INFO:teuthology.orchestra.run.trial194.stdout:Rotating logs: 2026-02-24T18:22:46.510 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T18:22:46.510 DEBUG:teuthology.orchestra.run.trial045:> /usr/sbin/getenforce 2026-02-24T18:22:46.527 INFO:teuthology.orchestra.run.trial045.stdout:Permissive 2026-02-24T18:22:46.527 DEBUG:teuthology.orchestra.run.trial114:> /usr/sbin/getenforce 2026-02-24T18:22:46.544 INFO:teuthology.orchestra.run.trial114.stdout:Permissive 2026-02-24T18:22:46.544 DEBUG:teuthology.orchestra.run.trial179:> /usr/sbin/getenforce 2026-02-24T18:22:46.559 INFO:teuthology.orchestra.run.trial179.stdout:Permissive 2026-02-24T18:22:46.559 DEBUG:teuthology.orchestra.run.trial194:> /usr/sbin/getenforce 2026-02-24T18:22:46.574 INFO:teuthology.orchestra.run.trial194.stdout:Permissive 2026-02-24T18:22:46.574 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial045.front.sepia.ceph.com': 'permissive', 'ubuntu@trial114.front.sepia.ceph.com': 'permissive', 'ubuntu@trial179.front.sepia.ceph.com': 'permissive', 'ubuntu@trial194.front.sepia.ceph.com': 'permissive'} 2026-02-24T18:22:46.574 DEBUG:teuthology.orchestra.run.trial045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:22:46.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:22:46.598 DEBUG:teuthology.orchestra.run.trial114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:22:46.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:22:46.622 DEBUG:teuthology.orchestra.run.trial179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:22:46.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:22:46.649 DEBUG:teuthology.orchestra.run.trial194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:22:46.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:22:46.675 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T18:22:46.676 DEBUG:teuthology.orchestra.run.trial045:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:22:46.702 DEBUG:teuthology.orchestra.run.trial114:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:22:46.726 DEBUG:teuthology.orchestra.run.trial179:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:22:46.757 DEBUG:teuthology.orchestra.run.trial194:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:22:46.791 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T18:22:46.812 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T18:22:46.824 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T18:22:46.825 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial045.front.sepia.ceph.com,trial114.front.sepia.ceph.com,trial179.front.sepia.ceph.com,trial194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T18:25:43.280 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial045.front.sepia.ceph.com'), Remote(name='ubuntu@trial114.front.sepia.ceph.com'), Remote(name='ubuntu@trial179.front.sepia.ceph.com'), Remote(name='ubuntu@trial194.front.sepia.ceph.com')] 2026-02-24T18:25:43.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-24T18:25:43.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:43.394 DEBUG:teuthology.orchestra.run.trial045:> true 2026-02-24T18:25:43.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-24T18:25:43.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-24T18:25:43.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:43.541 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-24T18:25:43.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-24T18:25:43.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial179.front.sepia.ceph.com' 2026-02-24T18:25:43.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:43.687 DEBUG:teuthology.orchestra.run.trial179:> true 2026-02-24T18:25:43.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial179.front.sepia.ceph.com' 2026-02-24T18:25:43.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-24T18:25:43.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:43.855 DEBUG:teuthology.orchestra.run.trial194:> true 2026-02-24T18:25:43.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial194.front.sepia.ceph.com' 2026-02-24T18:25:43.944 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T18:25:43.964 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T18:25:43.964 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:43.965 DEBUG:teuthology.orchestra.run.trial045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:43.967 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:43.967 DEBUG:teuthology.orchestra.run.trial114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:43.968 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:43.968 DEBUG:teuthology.orchestra.run.trial179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:43.970 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:43.970 DEBUG:teuthology.orchestra.run.trial194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:43.992 INFO:teuthology.orchestra.run.trial045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:43.994 INFO:teuthology.orchestra.run.trial114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:43.996 INFO:teuthology.orchestra.run.trial179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:44.003 INFO:teuthology.orchestra.run.trial045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:44.007 INFO:teuthology.orchestra.run.trial114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:44.008 INFO:teuthology.orchestra.run.trial179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:44.009 INFO:teuthology.orchestra.run.trial194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:44.021 INFO:teuthology.orchestra.run.trial194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:44.024 INFO:teuthology.orchestra.run.trial045.stderr:sudo: ntpd: command not found 2026-02-24T18:25:44.029 INFO:teuthology.orchestra.run.trial114.stderr:sudo: ntpd: command not found 2026-02-24T18:25:44.030 INFO:teuthology.orchestra.run.trial179.stderr:sudo: ntpd: command not found 2026-02-24T18:25:44.034 INFO:teuthology.orchestra.run.trial045.stdout:506 Cannot talk to daemon 2026-02-24T18:25:44.038 INFO:teuthology.orchestra.run.trial114.stdout:506 Cannot talk to daemon 2026-02-24T18:25:44.039 INFO:teuthology.orchestra.run.trial179.stdout:506 Cannot talk to daemon 2026-02-24T18:25:44.042 INFO:teuthology.orchestra.run.trial194.stderr:sudo: ntpd: command not found 2026-02-24T18:25:44.046 INFO:teuthology.orchestra.run.trial045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:44.049 INFO:teuthology.orchestra.run.trial114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:44.050 INFO:teuthology.orchestra.run.trial179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:44.051 INFO:teuthology.orchestra.run.trial194.stdout:506 Cannot talk to daemon 2026-02-24T18:25:44.057 INFO:teuthology.orchestra.run.trial045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:44.061 INFO:teuthology.orchestra.run.trial114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:44.062 INFO:teuthology.orchestra.run.trial179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:44.064 INFO:teuthology.orchestra.run.trial194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:44.076 INFO:teuthology.orchestra.run.trial194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:44.107 INFO:teuthology.orchestra.run.trial114.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:44.109 INFO:teuthology.orchestra.run.trial114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:44.109 INFO:teuthology.orchestra.run.trial114.stdout:=============================================================================== 2026-02-24T18:25:44.113 INFO:teuthology.orchestra.run.trial045.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:44.114 INFO:teuthology.orchestra.run.trial179.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:44.123 INFO:teuthology.orchestra.run.trial194.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:44.136 INFO:teuthology.orchestra.run.trial194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:44.136 INFO:teuthology.orchestra.run.trial194.stdout:=============================================================================== 2026-02-24T18:25:44.136 INFO:teuthology.orchestra.run.trial194.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.136 INFO:teuthology.orchestra.run.trial194.stdout:^? 50.218.103.254 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.136 INFO:teuthology.orchestra.run.trial194.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.136 INFO:teuthology.orchestra.run.trial194.stdout:^? 23.186.168.129 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.136 INFO:teuthology.orchestra.run.trial045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:44.137 INFO:teuthology.orchestra.run.trial045.stdout:=============================================================================== 2026-02-24T18:25:44.137 INFO:teuthology.orchestra.run.trial045.stdout:^? 170-187-147-56.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.137 INFO:teuthology.orchestra.run.trial045.stdout:^? 50.218.103.254 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.137 INFO:teuthology.orchestra.run.trial045.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.137 INFO:teuthology.orchestra.run.trial045.stdout:^? 23.186.168.129 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.138 INFO:teuthology.orchestra.run.trial179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:44.138 INFO:teuthology.orchestra.run.trial179.stdout:=============================================================================== 2026-02-24T18:25:44.139 INFO:teuthology.orchestra.run.trial179.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.139 INFO:teuthology.orchestra.run.trial179.stdout:^? 50.218.103.254 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.139 INFO:teuthology.orchestra.run.trial179.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.139 INFO:teuthology.orchestra.run.trial179.stdout:^? 23.186.168.129 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:44.139 INFO:teuthology.run_tasks:Running task install... 2026-02-24T18:25:44.151 DEBUG:teuthology.task.install:project ceph 2026-02-24T18:25:44.151 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}} 2026-02-24T18:25:44.151 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'} 2026-02-24T18:25:44.151 INFO:teuthology.task.install:Using flavor: default 2026-02-24T18:25:44.157 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-24T18:25:44.158 INFO:teuthology.task.install:extra packages: [] 2026-02-24T18:25:44.158 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:44.159 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:44.160 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:44.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:44.161 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:44.162 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:44.163 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:44.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:44.440 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:44.440 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:44.443 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:44.443 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:44.444 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:44.444 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:44.449 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:44.449 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:44.854 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:44.854 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T18:25:44.854 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:44.859 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:44.859 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T18:25:44.859 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:44.861 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:44.861 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T18:25:44.862 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:44.880 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:44.881 DEBUG:teuthology.orchestra.run.trial114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:44.885 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:44.886 DEBUG:teuthology.orchestra.run.trial194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:44.888 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:44.888 DEBUG:teuthology.orchestra.run.trial045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:44.912 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:44.913 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T18:25:44.913 DEBUG:teuthology.orchestra.run.trial179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:44.939 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:44.939 DEBUG:teuthology.orchestra.run.trial179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:44.945 DEBUG:teuthology.orchestra.run.trial114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:44.950 DEBUG:teuthology.orchestra.run.trial194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:44.953 DEBUG:teuthology.orchestra.run.trial045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:45.004 DEBUG:teuthology.orchestra.run.trial179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:45.017 DEBUG:teuthology.orchestra.run.trial114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:45.022 DEBUG:teuthology.orchestra.run.trial194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:45.027 DEBUG:teuthology.orchestra.run.trial045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:45.077 DEBUG:teuthology.orchestra.run.trial179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:45.081 INFO:teuthology.orchestra.run.trial114.stdout:check_obsoletes = 1 2026-02-24T18:25:45.082 DEBUG:teuthology.orchestra.run.trial114:> sudo yum clean all 2026-02-24T18:25:45.085 INFO:teuthology.orchestra.run.trial194.stdout:check_obsoletes = 1 2026-02-24T18:25:45.086 DEBUG:teuthology.orchestra.run.trial194:> sudo yum clean all 2026-02-24T18:25:45.090 INFO:teuthology.orchestra.run.trial045.stdout:check_obsoletes = 1 2026-02-24T18:25:45.092 DEBUG:teuthology.orchestra.run.trial045:> sudo yum clean all 2026-02-24T18:25:45.140 INFO:teuthology.orchestra.run.trial179.stdout:check_obsoletes = 1 2026-02-24T18:25:45.142 DEBUG:teuthology.orchestra.run.trial179:> sudo yum clean all 2026-02-24T18:25:45.231 INFO:teuthology.orchestra.run.trial114.stdout:41 files removed 2026-02-24T18:25:45.233 INFO:teuthology.orchestra.run.trial194.stdout:41 files removed 2026-02-24T18:25:45.241 INFO:teuthology.orchestra.run.trial045.stdout:41 files removed 2026-02-24T18:25:45.246 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:45.248 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:45.256 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:45.290 INFO:teuthology.orchestra.run.trial179.stdout:41 files removed 2026-02-24T18:25:45.304 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:46.042 INFO:teuthology.orchestra.run.trial114.stdout:ceph packages for x86_64 134 kB/s | 87 kB 00:00 2026-02-24T18:25:46.043 INFO:teuthology.orchestra.run.trial194.stdout:ceph packages for x86_64 134 kB/s | 87 kB 00:00 2026-02-24T18:25:46.049 INFO:teuthology.orchestra.run.trial045.stdout:ceph packages for x86_64 135 kB/s | 87 kB 00:00 2026-02-24T18:25:46.101 INFO:teuthology.orchestra.run.trial179.stdout:ceph packages for x86_64 133 kB/s | 87 kB 00:00 2026-02-24T18:25:46.659 INFO:teuthology.orchestra.run.trial194.stdout:ceph noarch packages 31 kB/s | 18 kB 00:00 2026-02-24T18:25:46.660 INFO:teuthology.orchestra.run.trial045.stdout:ceph noarch packages 31 kB/s | 18 kB 00:00 2026-02-24T18:25:46.663 INFO:teuthology.orchestra.run.trial114.stdout:ceph noarch packages 30 kB/s | 18 kB 00:00 2026-02-24T18:25:46.712 INFO:teuthology.orchestra.run.trial179.stdout:ceph noarch packages 31 kB/s | 18 kB 00:00 2026-02-24T18:25:47.173 INFO:teuthology.orchestra.run.trial194.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2026-02-24T18:25:47.175 INFO:teuthology.orchestra.run.trial045.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2026-02-24T18:25:47.176 INFO:teuthology.orchestra.run.trial114.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2026-02-24T18:25:47.224 INFO:teuthology.orchestra.run.trial179.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2026-02-24T18:25:47.473 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - BaseOS 32 MB/s | 8.9 MB 00:00 2026-02-24T18:25:48.240 INFO:teuthology.orchestra.run.trial179.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.9 MB 00:00 2026-02-24T18:25:49.568 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.9 MB 00:02 2026-02-24T18:25:51.227 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-24T18:25:52.858 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 27 MB 00:02 2026-02-24T18:25:52.950 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 8.9 MB 00:05 2026-02-24T18:25:53.561 INFO:teuthology.orchestra.run.trial179.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 27 MB 00:04 2026-02-24T18:25:54.625 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 8.0 MB 00:01 2026-02-24T18:25:55.473 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - Extras packages 194 kB/s | 20 kB 00:00 2026-02-24T18:25:56.580 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 27 MB 00:03 2026-02-24T18:25:56.747 INFO:teuthology.orchestra.run.trial114.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-24T18:25:58.022 INFO:teuthology.orchestra.run.trial179.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 8.0 MB 00:02 2026-02-24T18:25:58.841 INFO:teuthology.orchestra.run.trial179.stdout:CentOS Stream 9 - Extras packages 250 kB/s | 20 kB 00:00 2026-02-24T18:25:59.221 INFO:teuthology.orchestra.run.trial179.stdout:Extra Packages for Enterprise Linux 64 MB/s | 20 MB 00:00 2026-02-24T18:25:59.502 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 8.0 MB 00:04 2026-02-24T18:25:59.979 INFO:teuthology.orchestra.run.trial114.stdout:lab-extras 1.0 MB/s | 50 kB 00:00 2026-02-24T18:26:00.524 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 8.0 MB 00:01 2026-02-24T18:26:01.204 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:26:01.205 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:26:01.205 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-24T18:26:01.205 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout:Upgrading: 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:01.206 INFO:teuthology.orchestra.run.trial114.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:01.207 INFO:teuthology.orchestra.run.trial114.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:01.208 INFO:teuthology.orchestra.run.trial114.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout:Installing weak dependencies: 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout:Install 32 Packages 2026-02-24T18:26:01.209 INFO:teuthology.orchestra.run.trial114.stdout:Upgrade 2 Packages 2026-02-24T18:26:01.210 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:01.210 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 78 M 2026-02-24T18:26:01.210 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:26:01.244 INFO:teuthology.orchestra.run.trial194.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:00 2026-02-24T18:26:02.161 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-24T18:26:02.363 INFO:teuthology.orchestra.run.trial179.stdout:lab-extras 2.3 MB/s | 50 kB 00:00 2026-02-24T18:26:02.802 INFO:teuthology.orchestra.run.trial045.stdout:Extra Packages for Enterprise Linux 35 MB/s | 20 MB 00:00 2026-02-24T18:26:03.560 INFO:teuthology.orchestra.run.trial114.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 3.1 MB/s | 5.9 MB 00:01 2026-02-24T18:26:03.574 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repository Size 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout:Upgrading: 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:03.576 INFO:teuthology.orchestra.run.trial179.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout:Installing weak dependencies: 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout:Install 32 Packages 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout:Upgrade 2 Packages 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 78 M 2026-02-24T18:26:03.577 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:26:03.626 INFO:teuthology.orchestra.run.trial114.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 379 kB/s | 25 kB 00:00 2026-02-24T18:26:03.898 INFO:teuthology.orchestra.run.trial114.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 3.1 MB/s | 869 kB 00:00 2026-02-24T18:26:04.020 INFO:teuthology.orchestra.run.trial114.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 2.0 MB/s | 250 kB 00:00 2026-02-24T18:26:05.814 INFO:teuthology.orchestra.run.trial114.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 3.6 MB/s | 6.4 MB 00:01 2026-02-24T18:26:05.873 INFO:teuthology.orchestra.run.trial114.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 766 kB/s | 45 kB 00:00 2026-02-24T18:26:05.935 INFO:teuthology.orchestra.run.trial114.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 2.8 MB/s | 175 kB 00:00 2026-02-24T18:26:05.966 INFO:teuthology.orchestra.run.trial045.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-24T18:26:06.002 INFO:teuthology.orchestra.run.trial114.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 2.4 MB/s | 163 kB 00:00 2026-02-24T18:26:06.131 INFO:teuthology.orchestra.run.trial114.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 2.4 MB/s | 323 kB 00:00 2026-02-24T18:26:06.264 INFO:teuthology.orchestra.run.trial114.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 2.2 MB/s | 306 kB 00:00 2026-02-24T18:26:06.331 INFO:teuthology.orchestra.run.trial114.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.5 MB/s | 99 kB 00:00 2026-02-24T18:26:06.350 INFO:teuthology.orchestra.run.trial179.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 2.6 MB/s | 5.9 MB 00:02 2026-02-24T18:26:06.413 INFO:teuthology.orchestra.run.trial179.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 400 kB/s | 25 kB 00:00 2026-02-24T18:26:06.413 INFO:teuthology.orchestra.run.trial114.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 403 kB/s | 33 kB 00:00 2026-02-24T18:26:06.485 INFO:teuthology.orchestra.run.trial114.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 1.3 MB/s | 93 kB 00:00 2026-02-24T18:26:06.746 INFO:teuthology.orchestra.run.trial179.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 2.5 MB/s | 869 kB 00:00 2026-02-24T18:26:06.883 INFO:teuthology.orchestra.run.trial179.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 1.8 MB/s | 250 kB 00:00 2026-02-24T18:26:07.043 INFO:teuthology.orchestra.run.trial114.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 186 kB/s | 104 kB 00:00 2026-02-24T18:26:07.184 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout:Upgrading: 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:07.185 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout:Installing weak dependencies: 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout:Install 32 Packages 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout:Upgrade 2 Packages 2026-02-24T18:26:07.186 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:07.187 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 78 M 2026-02-24T18:26:07.187 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:26:07.281 INFO:teuthology.orchestra.run.trial114.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 689 kB/s | 164 kB 00:00 2026-02-24T18:26:07.519 INFO:teuthology.orchestra.run.trial114.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 675 kB/s | 160 kB 00:00 2026-02-24T18:26:07.601 INFO:teuthology.orchestra.run.trial114.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 550 kB/s | 45 kB 00:00 2026-02-24T18:26:08.382 INFO:teuthology.orchestra.run.trial114.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 848 kB/s | 662 kB 00:00 2026-02-24T18:26:08.677 INFO:teuthology.orchestra.run.trial114.stdout:(19/34): ceph-common-20.2.0-681.g36d388f2.el9.x 3.4 MB/s | 24 MB 00:07 2026-02-24T18:26:08.775 INFO:teuthology.orchestra.run.trial114.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 743 kB/s | 292 kB 00:00 2026-02-24T18:26:08.858 INFO:teuthology.orchestra.run.trial114.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 450 kB/s | 37 kB 00:00 2026-02-24T18:26:08.874 INFO:teuthology.orchestra.run.trial179.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 3.2 MB/s | 6.4 MB 00:01 2026-02-24T18:26:08.941 INFO:teuthology.orchestra.run.trial114.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 805 kB/s | 66 kB 00:00 2026-02-24T18:26:08.941 INFO:teuthology.orchestra.run.trial179.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 680 kB/s | 45 kB 00:00 2026-02-24T18:26:09.011 INFO:teuthology.orchestra.run.trial179.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 2.4 MB/s | 175 kB 00:00 2026-02-24T18:26:09.082 INFO:teuthology.orchestra.run.trial179.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 2.3 MB/s | 163 kB 00:00 2026-02-24T18:26:09.129 INFO:teuthology.orchestra.run.trial114.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.6 MB/s | 308 kB 00:00 2026-02-24T18:26:09.254 INFO:teuthology.orchestra.run.trial114.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2026-02-24T18:26:09.277 INFO:teuthology.orchestra.run.trial114.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.0 MB/s | 25 kB 00:00 2026-02-24T18:26:09.289 INFO:teuthology.orchestra.run.trial179.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 1.5 MB/s | 323 kB 00:00 2026-02-24T18:26:09.301 INFO:teuthology.orchestra.run.trial114.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2026-02-24T18:26:09.325 INFO:teuthology.orchestra.run.trial114.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2026-02-24T18:26:09.354 INFO:teuthology.orchestra.run.trial114.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 29 MB/s | 838 kB 00:00 2026-02-24T18:26:09.379 INFO:teuthology.orchestra.run.trial114.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 7.7 MB/s | 191 kB 00:00 2026-02-24T18:26:09.412 INFO:teuthology.orchestra.run.trial114.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 47 MB/s | 1.6 MB 00:00 2026-02-24T18:26:09.419 INFO:teuthology.orchestra.run.trial179.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 2.3 MB/s | 306 kB 00:00 2026-02-24T18:26:09.487 INFO:teuthology.orchestra.run.trial179.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 99 kB 00:00 2026-02-24T18:26:09.520 INFO:teuthology.orchestra.run.trial179.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 1.0 MB/s | 33 kB 00:00 2026-02-24T18:26:09.543 INFO:teuthology.orchestra.run.trial179.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 3.9 MB/s | 93 kB 00:00 2026-02-24T18:26:09.566 INFO:teuthology.orchestra.run.trial179.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 4.5 MB/s | 104 kB 00:00 2026-02-24T18:26:09.575 INFO:teuthology.orchestra.run.trial179.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-24T18:26:09.582 INFO:teuthology.orchestra.run.trial179.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 22 MB/s | 160 kB 00:00 2026-02-24T18:26:09.587 INFO:teuthology.orchestra.run.trial179.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 9.8 MB/s | 45 kB 00:00 2026-02-24T18:26:09.597 INFO:teuthology.orchestra.run.trial179.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 64 MB/s | 662 kB 00:00 2026-02-24T18:26:09.603 INFO:teuthology.orchestra.run.trial179.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 45 MB/s | 292 kB 00:00 2026-02-24T18:26:09.609 INFO:teuthology.orchestra.run.trial179.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 39 MB/s | 240 kB 00:00 2026-02-24T18:26:09.614 INFO:teuthology.orchestra.run.trial179.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 8.7 MB/s | 37 kB 00:00 2026-02-24T18:26:09.618 INFO:teuthology.orchestra.run.trial179.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 14 MB/s | 66 kB 00:00 2026-02-24T18:26:09.689 INFO:teuthology.orchestra.run.trial179.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.3 MB/s | 308 kB 00:00 2026-02-24T18:26:09.741 INFO:teuthology.orchestra.run.trial179.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 85 MB/s | 4.4 MB 00:00 2026-02-24T18:26:09.751 INFO:teuthology.orchestra.run.trial179.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 2.6 MB/s | 25 kB 00:00 2026-02-24T18:26:09.760 INFO:teuthology.orchestra.run.trial179.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 5.1 MB/s | 49 kB 00:00 2026-02-24T18:26:09.770 INFO:teuthology.orchestra.run.trial179.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 7.0 MB/s | 67 kB 00:00 2026-02-24T18:26:09.781 INFO:teuthology.orchestra.run.trial179.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 72 MB/s | 838 kB 00:00 2026-02-24T18:26:09.791 INFO:teuthology.orchestra.run.trial179.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 19 MB/s | 191 kB 00:00 2026-02-24T18:26:09.804 INFO:teuthology.orchestra.run.trial179.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 120 MB/s | 1.6 MB 00:00 2026-02-24T18:26:09.866 INFO:teuthology.orchestra.run.trial114.stdout:(31/34): qatlib-25.08.0-2.el9.x86_64.rpm 201 kB/s | 240 kB 00:01 2026-02-24T18:26:10.984 INFO:teuthology.orchestra.run.trial114.stdout:(32/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 2.5 MB/s | 24 MB 00:09 2026-02-24T18:26:11.434 INFO:teuthology.orchestra.run.trial179.stdout:(31/34): librados2-20.2.0-681.g36d388f2.el9.x86 2.2 MB/s | 3.5 MB 00:01 2026-02-24T18:26:11.724 INFO:teuthology.orchestra.run.trial114.stdout:(33/34): librados2-20.2.0-681.g36d388f2.el9.x86 1.5 MB/s | 3.5 MB 00:02 2026-02-24T18:26:12.122 INFO:teuthology.orchestra.run.trial114.stdout:(34/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 1.3 MB/s | 2.8 MB 00:02 2026-02-24T18:26:12.126 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:12.127 INFO:teuthology.orchestra.run.trial114.stdout:Total 7.1 MB/s | 78 MB 00:10 2026-02-24T18:26:12.218 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:26:12.234 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:26:12.235 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:26:12.525 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:26:12.526 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:26:12.750 INFO:teuthology.orchestra.run.trial179.stdout:(32/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 2.2 MB/s | 2.8 MB 00:01 2026-02-24T18:26:12.867 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:26:12.878 INFO:teuthology.orchestra.run.trial114.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:13.033 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:13.038 INFO:teuthology.orchestra.run.trial114.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:13.066 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:13.104 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:13.105 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:13.117 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:13.127 INFO:teuthology.orchestra.run.trial114.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:13.129 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:13.132 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:13.137 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:13.146 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:13.159 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:13.159 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:13.173 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:13.211 INFO:teuthology.orchestra.run.trial114.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:13.215 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:13.221 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:13.223 INFO:teuthology.orchestra.run.trial114.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:13.227 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:13.353 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:13.354 INFO:teuthology.orchestra.run.trial114.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:13.380 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:13.382 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:13.389 INFO:teuthology.orchestra.run.trial114.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:13.668 INFO:teuthology.orchestra.run.trial114.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:13.669 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:13.685 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:13.690 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:13.696 INFO:teuthology.orchestra.run.trial114.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:13.699 INFO:teuthology.orchestra.run.trial114.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:13.699 INFO:teuthology.orchestra.run.trial114.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:13.718 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:13.721 INFO:teuthology.orchestra.run.trial114.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:13.754 INFO:teuthology.orchestra.run.trial114.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:13.756 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:14.835 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:14.838 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:15.134 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:15.137 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:15.178 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:15.178 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:15.178 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:15.178 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:15.181 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:17.278 INFO:teuthology.orchestra.run.trial045.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 630 kB/s | 5.9 MB 00:09 2026-02-24T18:26:17.344 INFO:teuthology.orchestra.run.trial045.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 378 kB/s | 25 kB 00:00 2026-02-24T18:26:17.542 INFO:teuthology.orchestra.run.trial179.stdout:(33/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.8 MB/s | 24 MB 00:13 2026-02-24T18:26:18.283 INFO:teuthology.orchestra.run.trial045.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 926 kB/s | 869 kB 00:00 2026-02-24T18:26:18.536 INFO:teuthology.orchestra.run.trial045.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 991 kB/s | 250 kB 00:00 2026-02-24T18:26:19.466 INFO:teuthology.orchestra.run.trial179.stdout:(34/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 1.5 MB/s | 24 MB 00:15 2026-02-24T18:26:19.468 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:19.469 INFO:teuthology.orchestra.run.trial179.stdout:Total 4.9 MB/s | 78 MB 00:15 2026-02-24T18:26:19.554 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:26:19.572 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:26:19.572 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:26:19.717 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:19.717 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /sys 2026-02-24T18:26:19.717 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /proc 2026-02-24T18:26:19.717 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /mnt 2026-02-24T18:26:19.717 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /var/tmp 2026-02-24T18:26:19.717 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /home 2026-02-24T18:26:19.717 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /root 2026-02-24T18:26:19.717 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /tmp 2026-02-24T18:26:19.717 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:19.862 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:26:19.863 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:26:20.196 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:26:20.207 INFO:teuthology.orchestra.run.trial179.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:20.359 INFO:teuthology.orchestra.run.trial179.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:20.364 INFO:teuthology.orchestra.run.trial179.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:20.393 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:20.431 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:20.431 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:20.443 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:20.450 INFO:teuthology.orchestra.run.trial179.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:20.454 INFO:teuthology.orchestra.run.trial179.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:20.458 INFO:teuthology.orchestra.run.trial179.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:20.462 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:20.471 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:20.482 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:20.483 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:20.497 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:20.530 INFO:teuthology.orchestra.run.trial179.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:20.534 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:20.542 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:20.544 INFO:teuthology.orchestra.run.trial179.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:20.548 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:20.673 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:20.674 INFO:teuthology.orchestra.run.trial179.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:20.700 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:20.702 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:20.708 INFO:teuthology.orchestra.run.trial179.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:20.746 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:20.771 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:20.771 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:20.771 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:20.771 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:20.771 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:20.771 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:20.772 INFO:teuthology.orchestra.run.trial114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:20.785 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:20.785 INFO:teuthology.orchestra.run.trial114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:20.843 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:20.844 INFO:teuthology.orchestra.run.trial114.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:20.844 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:20.989 INFO:teuthology.orchestra.run.trial179.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:20.991 INFO:teuthology.orchestra.run.trial179.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:21.007 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:21.011 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:21.016 INFO:teuthology.orchestra.run.trial179.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:21.019 INFO:teuthology.orchestra.run.trial179.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:21.019 INFO:teuthology.orchestra.run.trial179.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:21.037 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:21.040 INFO:teuthology.orchestra.run.trial179.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:21.073 INFO:teuthology.orchestra.run.trial179.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:21.075 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:21.163 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:21.164 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:21.164 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:21.164 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:21.164 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:21.164 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:21.164 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:21.164 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:21.234 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:21.234 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:21.234 INFO:teuthology.orchestra.run.trial114.stdout:Upgraded: 2026-02-24T18:26:21.234 INFO:teuthology.orchestra.run.trial114.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.234 INFO:teuthology.orchestra.run.trial114.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.234 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.235 INFO:teuthology.orchestra.run.trial114.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.236 INFO:teuthology.orchestra.run.trial114.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:21.236 INFO:teuthology.orchestra.run.trial114.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:21.236 INFO:teuthology.orchestra.run.trial114.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:21.236 INFO:teuthology.orchestra.run.trial114.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:21.236 INFO:teuthology.orchestra.run.trial114.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:21.236 INFO:teuthology.orchestra.run.trial114.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:21.236 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:21.236 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:26:21.277 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-test 2026-02-24T18:26:21.593 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:22 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:26:21.676 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:26:21.677 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:26:21.677 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-24T18:26:21.677 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:26:21.677 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:26:21.677 INFO:teuthology.orchestra.run.trial114.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:21.677 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:26:21.677 INFO:teuthology.orchestra.run.trial114.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout:Install 5 Packages 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 85 M 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 365 M 2026-02-24T18:26:21.678 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:26:22.042 INFO:teuthology.orchestra.run.trial114.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 2.0 MB/s | 233 kB 00:00 2026-02-24T18:26:22.089 INFO:teuthology.orchestra.run.trial114.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 6.3 MB/s | 303 kB 00:00 2026-02-24T18:26:22.112 INFO:teuthology.orchestra.run.trial114.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-24T18:26:22.151 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:22.154 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:22.404 INFO:teuthology.orchestra.run.trial114.stdout:(4/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 345 kB/s | 164 kB 00:00 2026-02-24T18:26:22.456 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:22.459 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:22.498 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:22.498 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:22.498 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:22.498 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:22.502 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:24.591 INFO:teuthology.orchestra.run.trial045.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 1.1 MB/s | 6.4 MB 00:06 2026-02-24T18:26:24.660 INFO:teuthology.orchestra.run.trial045.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 658 kB/s | 45 kB 00:00 2026-02-24T18:26:24.867 INFO:teuthology.orchestra.run.trial045.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 845 kB/s | 175 kB 00:00 2026-02-24T18:26:25.000 INFO:teuthology.orchestra.run.trial045.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 1.2 MB/s | 163 kB 00:00 2026-02-24T18:26:25.257 INFO:teuthology.orchestra.run.trial045.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 1.2 MB/s | 323 kB 00:00 2026-02-24T18:26:25.517 INFO:teuthology.orchestra.run.trial045.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 1.2 MB/s | 306 kB 00:00 2026-02-24T18:26:25.651 INFO:teuthology.orchestra.run.trial045.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 738 kB/s | 99 kB 00:00 2026-02-24T18:26:25.708 INFO:teuthology.orchestra.run.trial045.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 584 kB/s | 33 kB 00:00 2026-02-24T18:26:25.727 INFO:teuthology.orchestra.run.trial045.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 4.8 MB/s | 93 kB 00:00 2026-02-24T18:26:26.127 INFO:teuthology.orchestra.run.trial045.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 260 kB/s | 104 kB 00:00 2026-02-24T18:26:26.308 INFO:teuthology.orchestra.run.trial045.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 911 kB/s | 164 kB 00:00 2026-02-24T18:26:26.422 INFO:teuthology.orchestra.run.trial045.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2026-02-24T18:26:26.511 INFO:teuthology.orchestra.run.trial045.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 512 kB/s | 45 kB 00:00 2026-02-24T18:26:26.737 INFO:teuthology.orchestra.run.trial045.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2026-02-24T18:26:26.836 INFO:teuthology.orchestra.run.trial045.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2026-02-24T18:26:26.931 INFO:teuthology.orchestra.run.trial045.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 2.5 MB/s | 240 kB 00:00 2026-02-24T18:26:27.011 INFO:teuthology.orchestra.run.trial045.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 465 kB/s | 37 kB 00:00 2026-02-24T18:26:27.081 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:27.082 INFO:teuthology.orchestra.run.trial179.stdout:skipping the directory /sys 2026-02-24T18:26:27.083 INFO:teuthology.orchestra.run.trial179.stdout:skipping the directory /proc 2026-02-24T18:26:27.083 INFO:teuthology.orchestra.run.trial179.stdout:skipping the directory /mnt 2026-02-24T18:26:27.083 INFO:teuthology.orchestra.run.trial179.stdout:skipping the directory /var/tmp 2026-02-24T18:26:27.083 INFO:teuthology.orchestra.run.trial179.stdout:skipping the directory /home 2026-02-24T18:26:27.083 INFO:teuthology.orchestra.run.trial179.stdout:skipping the directory /root 2026-02-24T18:26:27.083 INFO:teuthology.orchestra.run.trial179.stdout:skipping the directory /tmp 2026-02-24T18:26:27.083 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:27.095 INFO:teuthology.orchestra.run.trial045.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 799 kB/s | 66 kB 00:00 2026-02-24T18:26:27.302 INFO:teuthology.orchestra.run.trial045.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.4 MB/s | 308 kB 00:00 2026-02-24T18:26:27.442 INFO:teuthology.orchestra.run.trial045.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 32 MB/s | 4.4 MB 00:00 2026-02-24T18:26:27.469 INFO:teuthology.orchestra.run.trial045.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 906 kB/s | 25 kB 00:00 2026-02-24T18:26:27.497 INFO:teuthology.orchestra.run.trial045.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 1.7 MB/s | 49 kB 00:00 2026-02-24T18:26:27.526 INFO:teuthology.orchestra.run.trial045.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 2.3 MB/s | 67 kB 00:00 2026-02-24T18:26:27.557 INFO:teuthology.orchestra.run.trial045.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 26 MB/s | 838 kB 00:00 2026-02-24T18:26:27.586 INFO:teuthology.orchestra.run.trial045.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 6.6 MB/s | 191 kB 00:00 2026-02-24T18:26:27.621 INFO:teuthology.orchestra.run.trial045.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 45 MB/s | 1.6 MB 00:00 2026-02-24T18:26:28.101 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:28.124 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:28.124 INFO:teuthology.orchestra.run.trial179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:28.124 INFO:teuthology.orchestra.run.trial179.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:28.124 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:28.124 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:28.124 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:28.125 INFO:teuthology.orchestra.run.trial179.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:28.136 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:28.136 INFO:teuthology.orchestra.run.trial179.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:28.192 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:28.192 INFO:teuthology.orchestra.run.trial179.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:28.192 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:28.514 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:28.515 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:28.516 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:28.516 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:28.516 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:28.584 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout:Upgraded: 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:28.585 INFO:teuthology.orchestra.run.trial179.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:28.586 INFO:teuthology.orchestra.run.trial179.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:28.586 INFO:teuthology.orchestra.run.trial179.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:28.586 INFO:teuthology.orchestra.run.trial179.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:28.586 INFO:teuthology.orchestra.run.trial179.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:28.586 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:28.586 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:26:28.627 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-test 2026-02-24T18:26:28.943 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:00:26 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:26:29.027 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:26:29.027 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:26:29.027 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repository Size 2026-02-24T18:26:29.027 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout:Install 5 Packages 2026-02-24T18:26:29.028 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:29.029 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 85 M 2026-02-24T18:26:29.029 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 365 M 2026-02-24T18:26:29.029 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:26:29.533 INFO:teuthology.orchestra.run.trial179.stdout:(1/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 370 kB/s | 164 kB 00:00 2026-02-24T18:26:29.587 INFO:teuthology.orchestra.run.trial179.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 468 kB/s | 233 kB 00:00 2026-02-24T18:26:29.680 INFO:teuthology.orchestra.run.trial179.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 684 kB/s | 64 kB 00:00 2026-02-24T18:26:29.968 INFO:teuthology.orchestra.run.trial045.stdout:(31/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 1.1 MB/s | 24 MB 00:22 2026-02-24T18:26:29.987 INFO:teuthology.orchestra.run.trial045.stdout:(32/34): librados2-20.2.0-681.g36d388f2.el9.x86 1.5 MB/s | 3.5 MB 00:02 2026-02-24T18:26:30.051 INFO:teuthology.orchestra.run.trial179.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 585 kB/s | 303 kB 00:00 2026-02-24T18:26:31.444 INFO:teuthology.orchestra.run.trial045.stdout:(33/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 1.9 MB/s | 2.8 MB 00:01 2026-02-24T18:26:32.986 INFO:teuthology.orchestra.run.trial045.stdout:(34/34): ceph-common-20.2.0-681.g36d388f2.el9.x 964 kB/s | 24 MB 00:25 2026-02-24T18:26:32.988 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:32.988 INFO:teuthology.orchestra.run.trial045.stdout:Total 3.0 MB/s | 78 MB 00:25 2026-02-24T18:26:33.071 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:26:33.089 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:26:33.089 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:26:33.379 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:26:33.379 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:26:33.712 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:26:33.723 INFO:teuthology.orchestra.run.trial045.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:33.876 INFO:teuthology.orchestra.run.trial045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:33.880 INFO:teuthology.orchestra.run.trial045.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:33.910 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:33.947 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:33.948 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:33.960 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:33.969 INFO:teuthology.orchestra.run.trial045.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:33.971 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:33.974 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:33.978 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:33.987 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:34.000 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:34.001 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:34.013 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:34.049 INFO:teuthology.orchestra.run.trial045.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:34.052 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:34.060 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:34.062 INFO:teuthology.orchestra.run.trial045.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:34.067 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:34.189 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:34.190 INFO:teuthology.orchestra.run.trial045.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:34.215 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:34.218 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:34.224 INFO:teuthology.orchestra.run.trial045.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:34.505 INFO:teuthology.orchestra.run.trial045.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:34.506 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:34.521 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:34.525 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:34.530 INFO:teuthology.orchestra.run.trial045.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:34.532 INFO:teuthology.orchestra.run.trial045.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:34.533 INFO:teuthology.orchestra.run.trial045.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:34.550 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:34.552 INFO:teuthology.orchestra.run.trial045.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:34.585 INFO:teuthology.orchestra.run.trial045.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:34.586 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:35.664 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:35.667 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:35.966 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:35.969 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:36.007 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:36.008 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:36.008 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:36.008 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:36.011 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:40.478 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:40.478 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /sys 2026-02-24T18:26:40.478 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /proc 2026-02-24T18:26:40.478 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /mnt 2026-02-24T18:26:40.478 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /var/tmp 2026-02-24T18:26:40.478 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /home 2026-02-24T18:26:40.478 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /root 2026-02-24T18:26:40.478 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /tmp 2026-02-24T18:26:40.479 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:41.501 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:41.524 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:41.524 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:41.524 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:41.524 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:41.524 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:41.525 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:41.526 INFO:teuthology.orchestra.run.trial045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:41.538 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:41.538 INFO:teuthology.orchestra.run.trial045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:41.591 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:41.591 INFO:teuthology.orchestra.run.trial045.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:41.591 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:41.907 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:41.908 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:41.908 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:41.908 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:41.908 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:41.908 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:41.908 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:41.908 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:41.908 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:41.908 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:41.974 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:41.974 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout:Upgraded: 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:41.975 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:26:42.016 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-test 2026-02-24T18:26:42.335 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:37 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:26:42.418 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:26:42.418 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:42.419 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:42.420 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:26:42.420 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:26:42.420 INFO:teuthology.orchestra.run.trial045.stdout:Install 5 Packages 2026-02-24T18:26:42.420 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:26:42.421 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 85 M 2026-02-24T18:26:42.421 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 365 M 2026-02-24T18:26:42.421 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:26:42.996 INFO:teuthology.orchestra.run.trial045.stdout:(1/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 336 kB/s | 164 kB 00:00 2026-02-24T18:26:43.730 INFO:teuthology.orchestra.run.trial045.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 191 kB/s | 233 kB 00:01 2026-02-24T18:26:43.807 INFO:teuthology.orchestra.run.trial045.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 374 kB/s | 303 kB 00:00 2026-02-24T18:26:43.986 INFO:teuthology.orchestra.run.trial045.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 249 kB/s | 64 kB 00:00 2026-02-24T18:26:53.525 INFO:teuthology.orchestra.run.trial179.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 3.4 MB/s | 84 MB 00:24 2026-02-24T18:26:53.526 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:53.527 INFO:teuthology.orchestra.run.trial179.stdout:Total 3.5 MB/s | 85 MB 00:24 2026-02-24T18:26:53.552 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:26:53.563 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:26:53.564 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:26:53.851 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:26:53.851 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:26:54.165 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:26:54.171 INFO:teuthology.orchestra.run.trial179.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:26:54.175 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:26:54.183 INFO:teuthology.orchestra.run.trial179.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:26:54.184 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:26:55.860 INFO:teuthology.orchestra.run.trial194.stdout:Extra Packages for Enterprise Linux 381 kB/s | 20 MB 00:54 2026-02-24T18:26:58.042 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:26:58.061 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:26:58.373 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:26:58.373 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:26:58.373 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:26:58.373 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:26:58.373 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:26:58.430 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:26:58.430 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:58.430 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:26:58.430 INFO:teuthology.orchestra.run.trial179.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:58.430 INFO:teuthology.orchestra.run.trial179.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:58.430 INFO:teuthology.orchestra.run.trial179.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:26:58.430 INFO:teuthology.orchestra.run.trial179.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:26:58.430 INFO:teuthology.orchestra.run.trial179.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:26:58.430 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:58.431 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:26:58.466 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph 2026-02-24T18:26:58.772 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:00:56 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:26:58.857 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repository Size 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:26:58.858 INFO:teuthology.orchestra.run.trial179.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:26:58.859 INFO:teuthology.orchestra.run.trial179.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout:Install 40 Packages 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 30 M 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 100 M 2026-02-24T18:26:58.860 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:26:59.027 INFO:teuthology.orchestra.run.trial194.stdout:lab-extras 1.2 MB/s | 50 kB 00:00 2026-02-24T18:26:59.599 INFO:teuthology.orchestra.run.trial179.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 25 kB/s | 6.5 kB 00:00 2026-02-24T18:27:00.206 INFO:teuthology.orchestra.run.trial179.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 1.1 MB/s | 961 kB 00:00 2026-02-24T18:27:00.244 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:27:00.246 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:27:00.246 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-24T18:27:00.246 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:27:00.246 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:27:00.246 INFO:teuthology.orchestra.run.trial194.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:27:00.246 INFO:teuthology.orchestra.run.trial194.stdout:Upgrading: 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:27:00.247 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:27:00.248 INFO:teuthology.orchestra.run.trial194.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout:Installing weak dependencies: 2026-02-24T18:27:00.249 INFO:teuthology.orchestra.run.trial194.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:27:00.250 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:00.250 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:27:00.250 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:27:00.250 INFO:teuthology.orchestra.run.trial194.stdout:Install 32 Packages 2026-02-24T18:27:00.250 INFO:teuthology.orchestra.run.trial194.stdout:Upgrade 2 Packages 2026-02-24T18:27:00.250 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:00.251 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 78 M 2026-02-24T18:27:00.251 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:27:01.202 INFO:teuthology.orchestra.run.trial179.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.3 MB/s | 2.3 MB 00:01 2026-02-24T18:27:01.474 INFO:teuthology.orchestra.run.trial179.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 1.0 MB/s | 290 kB 00:00 2026-02-24T18:27:01.567 INFO:teuthology.orchestra.run.trial179.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 433 kB/s | 40 kB 00:00 2026-02-24T18:27:01.627 INFO:teuthology.orchestra.run.trial179.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 1.2 MB/s | 72 kB 00:00 2026-02-24T18:27:01.699 INFO:teuthology.orchestra.run.trial179.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.4 MB/s | 253 kB 00:00 2026-02-24T18:27:01.788 INFO:teuthology.orchestra.run.trial179.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 14 MB/s | 1.2 MB 00:00 2026-02-24T18:27:01.802 INFO:teuthology.orchestra.run.trial179.stdout:(9/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_6 2.3 MB/s | 5.1 MB 00:02 2026-02-24T18:27:01.815 INFO:teuthology.orchestra.run.trial179.stdout:(10/40): python3-ply-3.11-14.el9.noarch.rpm 3.8 MB/s | 106 kB 00:00 2026-02-24T18:27:01.843 INFO:teuthology.orchestra.run.trial179.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 5.4 MB/s | 150 kB 00:00 2026-02-24T18:27:01.871 INFO:teuthology.orchestra.run.trial179.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 4.4 MB/s | 126 kB 00:00 2026-02-24T18:27:01.899 INFO:teuthology.orchestra.run.trial179.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 7.5 MB/s | 218 kB 00:00 2026-02-24T18:27:01.928 INFO:teuthology.orchestra.run.trial179.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 6.3 MB/s | 182 kB 00:00 2026-02-24T18:27:01.936 INFO:teuthology.orchestra.run.trial179.stdout:(15/40): python3-pycparser-2.20-6.el9.noarch.rp 1.0 MB/s | 135 kB 00:00 2026-02-24T18:27:01.955 INFO:teuthology.orchestra.run.trial179.stdout:(16/40): zip-3.0-35.el9.x86_64.rpm 9.4 MB/s | 266 kB 00:00 2026-02-24T18:27:01.958 INFO:teuthology.orchestra.run.trial179.stdout:(17/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 11 MB/s | 246 kB 00:00 2026-02-24T18:27:01.965 INFO:teuthology.orchestra.run.trial179.stdout:(18/40): python3-libstoragemgmt-1.10.1-1.el9.x8 23 MB/s | 177 kB 00:00 2026-02-24T18:27:01.971 INFO:teuthology.orchestra.run.trial179.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 14 MB/s | 77 kB 00:00 2026-02-24T18:27:01.976 INFO:teuthology.orchestra.run.trial179.stdout:(20/40): python3-toml-0.10.2-6.el9.noarch.rpm 8.2 MB/s | 42 kB 00:00 2026-02-24T18:27:01.976 INFO:teuthology.orchestra.run.trial179.stdout:(21/40): lua-5.4.4-4.el9.x86_64.rpm 8.6 MB/s | 188 kB 00:00 2026-02-24T18:27:02.140 INFO:teuthology.orchestra.run.trial179.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 929 kB/s | 151 kB 00:00 2026-02-24T18:27:02.166 INFO:teuthology.orchestra.run.trial179.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 1.1 MB/s | 29 kB 00:00 2026-02-24T18:27:02.197 INFO:teuthology.orchestra.run.trial179.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 1.9 MB/s | 60 kB 00:00 2026-02-24T18:27:02.225 INFO:teuthology.orchestra.run.trial179.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.5 MB/s | 43 kB 00:00 2026-02-24T18:27:02.268 INFO:teuthology.orchestra.run.trial179.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 4.0 MB/s | 173 kB 00:00 2026-02-24T18:27:02.322 INFO:teuthology.orchestra.run.trial179.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 6.4 MB/s | 358 kB 00:00 2026-02-24T18:27:02.346 INFO:teuthology.orchestra.run.trial179.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 438 kB/s | 11 kB 00:00 2026-02-24T18:27:02.371 INFO:teuthology.orchestra.run.trial179.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 722 kB/s | 18 kB 00:00 2026-02-24T18:27:02.396 INFO:teuthology.orchestra.run.trial179.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 944 kB/s | 23 kB 00:00 2026-02-24T18:27:02.421 INFO:teuthology.orchestra.run.trial179.stdout:(31/40): python3-jaraco-context-6.0.1-3.el9.noa 799 kB/s | 20 kB 00:00 2026-02-24T18:27:02.445 INFO:teuthology.orchestra.run.trial179.stdout:(32/40): python3-jaraco-functools-3.5.0-2.el9.n 788 kB/s | 19 kB 00:00 2026-02-24T18:27:02.470 INFO:teuthology.orchestra.run.trial179.stdout:(33/40): python3-jaraco-text-4.0.0-2.el9.noarch 1.0 MB/s | 26 kB 00:00 2026-02-24T18:27:02.496 INFO:teuthology.orchestra.run.trial179.stdout:(34/40): python3-more-itertools-8.12.0-2.el9.no 3.0 MB/s | 79 kB 00:00 2026-02-24T18:27:02.520 INFO:teuthology.orchestra.run.trial179.stdout:(35/40): python3-portend-3.1.0-2.el9.noarch.rpm 673 kB/s | 16 kB 00:00 2026-02-24T18:27:02.530 INFO:teuthology.orchestra.run.trial179.stdout:(36/40): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2026-02-24T18:27:02.547 INFO:teuthology.orchestra.run.trial179.stdout:(37/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.3 MB/s | 90 kB 00:00 2026-02-24T18:27:02.554 INFO:teuthology.orchestra.run.trial179.stdout:(38/40): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2026-02-24T18:27:02.572 INFO:teuthology.orchestra.run.trial179.stdout:(39/40): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2026-02-24T18:27:03.839 INFO:teuthology.orchestra.run.trial194.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 1.9 MB/s | 5.9 MB 00:03 2026-02-24T18:27:03.904 INFO:teuthology.orchestra.run.trial194.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 388 kB/s | 25 kB 00:00 2026-02-24T18:27:04.202 INFO:teuthology.orchestra.run.trial179.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 4.2 MB/s | 17 MB 00:03 2026-02-24T18:27:04.204 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:04.204 INFO:teuthology.orchestra.run.trial179.stdout:Total 5.7 MB/s | 30 MB 00:05 2026-02-24T18:27:04.236 INFO:teuthology.orchestra.run.trial194.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 2.6 MB/s | 869 kB 00:00 2026-02-24T18:27:04.336 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:04.354 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:04.354 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:04.359 INFO:teuthology.orchestra.run.trial194.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 2.0 MB/s | 250 kB 00:00 2026-02-24T18:27:04.498 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:04.498 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:04.680 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:04.682 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:04.687 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:04.692 INFO:teuthology.orchestra.run.trial179.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:04.694 INFO:teuthology.orchestra.run.trial179.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:04.700 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:04.724 INFO:teuthology.orchestra.run.trial179.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:04.729 INFO:teuthology.orchestra.run.trial179.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:04.733 INFO:teuthology.orchestra.run.trial179.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:04.738 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:04.744 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:04.748 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:04.754 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:04.760 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:04.763 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:04.770 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:04.773 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:04.780 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:04.783 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:04.806 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:04.818 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:04.824 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:04.834 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:04.840 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:04.853 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:04.869 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:04.944 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:04.952 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:04.975 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:05.005 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:05.010 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:05.056 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:05.099 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:05.100 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:05.124 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:05.124 INFO:teuthology.orchestra.run.trial179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:05.124 INFO:teuthology.orchestra.run.trial179.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:05.124 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:05.124 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:05.124 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:05.129 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:05.145 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:05.145 INFO:teuthology.orchestra.run.trial179.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:05.146 INFO:teuthology.orchestra.run.trial179.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:05.146 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:05.153 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:05.177 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:05.177 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:05.177 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:05.859 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:05.861 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:05.886 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:05.886 INFO:teuthology.orchestra.run.trial179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:05.886 INFO:teuthology.orchestra.run.trial179.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:05.886 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:05.887 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:05.887 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:05.930 INFO:teuthology.orchestra.run.trial114.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 1.9 MB/s | 84 MB 00:44 2026-02-24T18:27:05.931 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:05.931 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.9 MB/s | 85 MB 00:44 2026-02-24T18:27:05.956 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:05.967 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:05.967 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:06.100 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:06.122 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:06.122 INFO:teuthology.orchestra.run.trial179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:06.122 INFO:teuthology.orchestra.run.trial179.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:06.122 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:06.122 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:06.122 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:06.222 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:06.243 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:06.243 INFO:teuthology.orchestra.run.trial179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:06.244 INFO:teuthology.orchestra.run.trial179.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:06.244 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:06.244 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:06.244 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:06.254 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:06.254 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:06.262 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:06.551 INFO:teuthology.orchestra.run.trial194.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 2.9 MB/s | 6.4 MB 00:02 2026-02-24T18:27:06.568 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:06.574 INFO:teuthology.orchestra.run.trial114.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:06.579 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:06.580 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:06.581 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:06.586 INFO:teuthology.orchestra.run.trial114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:06.587 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:06.613 INFO:teuthology.orchestra.run.trial194.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 718 kB/s | 45 kB 00:00 2026-02-24T18:27:06.643 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:06.644 INFO:teuthology.orchestra.run.trial179.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:06.645 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:06.646 INFO:teuthology.orchestra.run.trial179.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:06.647 INFO:teuthology.orchestra.run.trial179.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:06.647 INFO:teuthology.orchestra.run.trial179.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:06.647 INFO:teuthology.orchestra.run.trial179.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:06.647 INFO:teuthology.orchestra.run.trial179.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:06.647 INFO:teuthology.orchestra.run.trial179.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:06.647 INFO:teuthology.orchestra.run.trial179.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:06.647 INFO:teuthology.orchestra.run.trial179.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:06.647 INFO:teuthology.orchestra.run.trial179.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:06.648 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:06.648 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:06.680 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-base 2026-02-24T18:27:06.741 INFO:teuthology.orchestra.run.trial194.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 1.3 MB/s | 175 kB 00:00 2026-02-24T18:27:06.808 INFO:teuthology.orchestra.run.trial194.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 2.4 MB/s | 163 kB 00:00 2026-02-24T18:27:06.943 INFO:teuthology.orchestra.run.trial194.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 2.3 MB/s | 323 kB 00:00 2026-02-24T18:27:06.993 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:04 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:07.058 INFO:teuthology.orchestra.run.trial179.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:07.075 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:07.076 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T18:27:07.077 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:07.080 INFO:teuthology.orchestra.run.trial194.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 2.2 MB/s | 306 kB 00:00 2026-02-24T18:27:07.097 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install cephadm 2026-02-24T18:27:07.148 INFO:teuthology.orchestra.run.trial194.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 99 kB 00:00 2026-02-24T18:27:07.231 INFO:teuthology.orchestra.run.trial194.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 400 kB/s | 33 kB 00:00 2026-02-24T18:27:07.303 INFO:teuthology.orchestra.run.trial194.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 1.3 MB/s | 93 kB 00:00 2026-02-24T18:27:07.409 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:05 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:07.493 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:07.493 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repository Size 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 1.0 M 2026-02-24T18:27:07.494 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 1.0 M 2026-02-24T18:27:07.495 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:07.901 INFO:teuthology.orchestra.run.trial194.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 174 kB/s | 104 kB 00:00 2026-02-24T18:27:08.158 INFO:teuthology.orchestra.run.trial194.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 637 kB/s | 164 kB 00:00 2026-02-24T18:27:08.415 INFO:teuthology.orchestra.run.trial194.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 624 kB/s | 160 kB 00:00 2026-02-24T18:27:08.435 INFO:teuthology.orchestra.run.trial179.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 1.1 MB/s | 1.0 MB 00:00 2026-02-24T18:27:08.435 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:08.435 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.1 MB/s | 1.0 MB 00:00 2026-02-24T18:27:08.436 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:08.438 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:08.438 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:08.442 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:08.442 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:08.461 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:08.515 INFO:teuthology.orchestra.run.trial194.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2026-02-24T18:27:08.526 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:08.541 INFO:teuthology.orchestra.run.trial179.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:08.610 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:08.669 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:08.669 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:08.669 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:08.669 INFO:teuthology.orchestra.run.trial179.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:08.669 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:08.670 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:08.697 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:09.008 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:07 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:09.091 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:09.092 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:09.092 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T18:27:09.092 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:09.092 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:09.092 INFO:teuthology.orchestra.run.trial179.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:27:09.092 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:09.092 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:09.092 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:09.093 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:27:09.093 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:09.093 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 154 k 2026-02-24T18:27:09.093 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 447 k 2026-02-24T18:27:09.093 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:09.324 INFO:teuthology.orchestra.run.trial194.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 818 kB/s | 662 kB 00:00 2026-02-24T18:27:09.558 INFO:teuthology.orchestra.run.trial179.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 330 kB/s | 154 kB 00:00 2026-02-24T18:27:09.558 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:09.559 INFO:teuthology.orchestra.run.trial179.stdout:Total 330 kB/s | 154 kB 00:00 2026-02-24T18:27:09.559 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:09.563 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:09.563 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:09.590 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:09.590 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:09.640 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:09.641 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:09.664 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:09.665 INFO:teuthology.orchestra.run.trial179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:09.665 INFO:teuthology.orchestra.run.trial179.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:27:09.665 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:09.740 INFO:teuthology.orchestra.run.trial194.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 703 kB/s | 292 kB 00:00 2026-02-24T18:27:09.983 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:09.983 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:09.983 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:09.983 INFO:teuthology.orchestra.run.trial179.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:09.983 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:09.983 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:10.012 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-mgr 2026-02-24T18:27:10.076 INFO:teuthology.orchestra.run.trial194.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 713 kB/s | 240 kB 00:00 2026-02-24T18:27:10.175 INFO:teuthology.orchestra.run.trial194.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 373 kB/s | 37 kB 00:00 2026-02-24T18:27:10.275 INFO:teuthology.orchestra.run.trial194.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 667 kB/s | 66 kB 00:00 2026-02-24T18:27:10.314 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:10.324 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:08 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:10.332 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:10.389 INFO:teuthology.orchestra.run.trial179.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:10.405 INFO:teuthology.orchestra.run.trial194.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.3 MB/s | 308 kB 00:00 2026-02-24T18:27:10.406 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:10.407 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T18:27:10.407 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:10.429 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:27:10.524 INFO:teuthology.orchestra.run.trial194.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 37 MB/s | 4.4 MB 00:00 2026-02-24T18:27:10.563 INFO:teuthology.orchestra.run.trial194.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 632 kB/s | 25 kB 00:00 2026-02-24T18:27:10.587 INFO:teuthology.orchestra.run.trial194.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2026-02-24T18:27:10.607 INFO:teuthology.orchestra.run.trial194.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 3.2 MB/s | 67 kB 00:00 2026-02-24T18:27:10.660 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:10.660 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:10.660 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:10.660 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:10.660 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:10.660 INFO:teuthology.orchestra.run.trial194.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 16 MB/s | 838 kB 00:00 2026-02-24T18:27:10.687 INFO:teuthology.orchestra.run.trial194.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 6.9 MB/s | 191 kB 00:00 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:10.719 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:10.740 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:08 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:10.756 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph 2026-02-24T18:27:10.824 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:10.824 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:10.824 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repository Size 2026-02-24T18:27:10.824 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout:Install 14 Packages 2026-02-24T18:27:10.825 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:10.826 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 16 M 2026-02-24T18:27:10.826 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 158 M 2026-02-24T18:27:10.826 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:11.006 INFO:teuthology.orchestra.run.trial194.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2026-02-24T18:27:11.068 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:12 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:11.153 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:11.154 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:11.154 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-24T18:27:11.154 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:11.154 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:11.154 INFO:teuthology.orchestra.run.trial114.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:11.154 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:11.155 INFO:teuthology.orchestra.run.trial114.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:11.156 INFO:teuthology.orchestra.run.trial114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:11.157 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:11.158 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:11.158 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:11.158 INFO:teuthology.orchestra.run.trial114.stdout:Install 40 Packages 2026-02-24T18:27:11.158 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:11.158 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 30 M 2026-02-24T18:27:11.159 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 100 M 2026-02-24T18:27:11.159 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:11.333 INFO:teuthology.orchestra.run.trial179.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 57 kB/s | 17 kB 00:00 2026-02-24T18:27:11.388 INFO:teuthology.orchestra.run.trial179.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 121 kB/s | 43 kB 00:00 2026-02-24T18:27:11.400 INFO:teuthology.orchestra.run.trial179.stdout:(3/14): protobuf-3.14.0-17.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2026-02-24T18:27:11.412 INFO:teuthology.orchestra.run.trial179.stdout:(4/14): python3-protobuf-3.14.0-17.el9.noarch.r 22 MB/s | 267 kB 00:00 2026-02-24T18:27:11.422 INFO:teuthology.orchestra.run.trial179.stdout:(5/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 1.4 MB/s | 48 kB 00:00 2026-02-24T18:27:11.453 INFO:teuthology.orchestra.run.trial179.stdout:(6/14): protobuf-compiler-3.14.0-17.el9.x86_64. 21 MB/s | 862 kB 00:00 2026-02-24T18:27:11.528 INFO:teuthology.orchestra.run.trial179.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2026-02-24T18:27:11.640 INFO:teuthology.orchestra.run.trial179.stdout:(8/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.5 MB/s | 551 kB 00:00 2026-02-24T18:27:11.708 INFO:teuthology.orchestra.run.trial179.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2026-02-24T18:27:11.738 INFO:teuthology.orchestra.run.trial179.stdout:(10/14): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.7 MB/s | 2.0 MB 00:00 2026-02-24T18:27:11.744 INFO:teuthology.orchestra.run.trial179.stdout:(11/14): python3-repoze-lru-0.7-16.el9.noarch.r 861 kB/s | 31 kB 00:00 2026-02-24T18:27:11.797 INFO:teuthology.orchestra.run.trial179.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 422 kB/s | 22 kB 00:00 2026-02-24T18:27:11.813 INFO:teuthology.orchestra.run.trial179.stdout:(13/14): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2026-02-24T18:27:11.917 INFO:teuthology.orchestra.run.trial114.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 25 kB/s | 6.5 kB 00:00 2026-02-24T18:27:12.447 INFO:teuthology.orchestra.run.trial194.stdout:(31/34): librados2-20.2.0-681.g36d388f2.el9.x86 2.4 MB/s | 3.5 MB 00:01 2026-02-24T18:27:12.622 INFO:teuthology.orchestra.run.trial114.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 995 kB/s | 961 kB 00:00 2026-02-24T18:27:13.305 INFO:teuthology.orchestra.run.trial194.stdout:(32/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 1.9 MB/s | 24 MB 00:12 2026-02-24T18:27:13.506 INFO:teuthology.orchestra.run.trial114.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.3 MB/s | 2.3 MB 00:01 2026-02-24T18:27:13.651 INFO:teuthology.orchestra.run.trial194.stdout:(33/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.8 MB/s | 24 MB 00:12 2026-02-24T18:27:13.702 INFO:teuthology.orchestra.run.trial114.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 1.4 MB/s | 290 kB 00:00 2026-02-24T18:27:13.713 INFO:teuthology.orchestra.run.trial114.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 3.7 MB/s | 40 kB 00:00 2026-02-24T18:27:13.715 INFO:teuthology.orchestra.run.trial194.stdout:(34/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 2.2 MB/s | 2.8 MB 00:01 2026-02-24T18:27:13.720 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:13.720 INFO:teuthology.orchestra.run.trial194.stdout:Total 5.8 MB/s | 78 MB 00:13 2026-02-24T18:27:13.721 INFO:teuthology.orchestra.run.trial114.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 8.6 MB/s | 72 kB 00:00 2026-02-24T18:27:13.731 INFO:teuthology.orchestra.run.trial114.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 24 MB/s | 253 kB 00:00 2026-02-24T18:27:13.767 INFO:teuthology.orchestra.run.trial114.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 35 MB/s | 1.2 MB 00:00 2026-02-24T18:27:13.774 INFO:teuthology.orchestra.run.trial114.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 14 MB/s | 106 kB 00:00 2026-02-24T18:27:13.781 INFO:teuthology.orchestra.run.trial114.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 20 MB/s | 135 kB 00:00 2026-02-24T18:27:13.787 INFO:teuthology.orchestra.run.trial114.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 22 MB/s | 150 kB 00:00 2026-02-24T18:27:13.794 INFO:teuthology.orchestra.run.trial114.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 18 MB/s | 126 kB 00:00 2026-02-24T18:27:13.802 INFO:teuthology.orchestra.run.trial114.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 28 MB/s | 218 kB 00:00 2026-02-24T18:27:13.805 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:27:13.810 INFO:teuthology.orchestra.run.trial114.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 23 MB/s | 182 kB 00:00 2026-02-24T18:27:13.817 INFO:teuthology.orchestra.run.trial114.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 36 MB/s | 266 kB 00:00 2026-02-24T18:27:13.823 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:27:13.824 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:27:14.116 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:27:14.116 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:27:14.452 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:27:14.463 INFO:teuthology.orchestra.run.trial194.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:27:14.588 INFO:teuthology.orchestra.run.trial114.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 320 kB/s | 246 kB 00:00 2026-02-24T18:27:14.616 INFO:teuthology.orchestra.run.trial194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:27:14.621 INFO:teuthology.orchestra.run.trial194.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:27:14.650 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:27:14.688 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:27:14.689 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:27:14.700 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:27:14.709 INFO:teuthology.orchestra.run.trial194.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:27:14.713 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:27:14.716 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:27:14.721 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:27:14.730 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:27:14.742 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:27:14.743 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:27:14.754 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:27:14.785 INFO:teuthology.orchestra.run.trial194.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:27:14.789 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:27:14.797 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:27:14.799 INFO:teuthology.orchestra.run.trial194.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:27:14.803 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:27:14.927 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:27:14.928 INFO:teuthology.orchestra.run.trial194.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:27:14.956 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:27:14.958 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:27:14.965 INFO:teuthology.orchestra.run.trial194.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:27:15.244 INFO:teuthology.orchestra.run.trial194.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:27:15.245 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:27:15.261 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:27:15.265 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:27:15.269 INFO:teuthology.orchestra.run.trial194.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:27:15.271 INFO:teuthology.orchestra.run.trial194.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:27:15.272 INFO:teuthology.orchestra.run.trial194.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:27:15.289 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:27:15.291 INFO:teuthology.orchestra.run.trial194.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:27:15.324 INFO:teuthology.orchestra.run.trial194.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:27:15.325 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:27:15.326 INFO:teuthology.orchestra.run.trial114.stdout:(17/40): lua-5.4.4-4.el9.x86_64.rpm 255 kB/s | 188 kB 00:00 2026-02-24T18:27:15.909 INFO:teuthology.orchestra.run.trial179.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 2.2 MB/s | 11 MB 00:04 2026-02-24T18:27:15.910 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:15.910 INFO:teuthology.orchestra.run.trial179.stdout:Total 3.1 MB/s | 16 MB 00:05 2026-02-24T18:27:15.948 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:15.957 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:15.957 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:16.025 INFO:teuthology.orchestra.run.trial114.stdout:(18/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_ 1.2 MB/s | 5.1 MB 00:04 2026-02-24T18:27:16.054 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:16.054 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:16.067 INFO:teuthology.orchestra.run.trial114.stdout:(19/40): python3-libstoragemgmt-1.10.1-1.el9.x8 239 kB/s | 177 kB 00:00 2026-02-24T18:27:16.172 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:16.180 INFO:teuthology.orchestra.run.trial179.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:27:16.183 INFO:teuthology.orchestra.run.trial179.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:27:16.188 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:27:16.199 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:27:16.201 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:27:16.230 INFO:teuthology.orchestra.run.trial179.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:27:16.273 INFO:teuthology.orchestra.run.trial179.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:27:16.303 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:27:16.312 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:27:16.320 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:16.322 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:27:16.329 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:27:16.400 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:27:16.402 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:27:16.666 INFO:teuthology.orchestra.run.trial114.stdout:(20/40): python3-packaging-20.9-5.el9.noarch.rp 120 kB/s | 77 kB 00:00 2026-02-24T18:27:16.680 INFO:teuthology.orchestra.run.trial114.stdout:(21/40): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2026-02-24T18:27:16.700 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:27:16.703 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:27:16.729 INFO:teuthology.orchestra.run.trial114.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2026-02-24T18:27:16.737 INFO:teuthology.orchestra.run.trial114.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 3.5 MB/s | 29 kB 00:00 2026-02-24T18:27:16.744 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:27:16.744 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:27:16.744 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:27:16.744 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:16.746 INFO:teuthology.orchestra.run.trial114.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 7.1 MB/s | 60 kB 00:00 2026-02-24T18:27:16.748 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:27:16.754 INFO:teuthology.orchestra.run.trial114.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 5.2 MB/s | 43 kB 00:00 2026-02-24T18:27:16.770 INFO:teuthology.orchestra.run.trial114.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 11 MB/s | 173 kB 00:00 2026-02-24T18:27:16.791 INFO:teuthology.orchestra.run.trial114.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 17 MB/s | 358 kB 00:00 2026-02-24T18:27:16.798 INFO:teuthology.orchestra.run.trial114.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 1.4 MB/s | 11 kB 00:00 2026-02-24T18:27:16.806 INFO:teuthology.orchestra.run.trial114.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 2.3 MB/s | 18 kB 00:00 2026-02-24T18:27:16.814 INFO:teuthology.orchestra.run.trial114.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 2.9 MB/s | 23 kB 00:00 2026-02-24T18:27:16.822 INFO:teuthology.orchestra.run.trial114.stdout:(31/40): python3-jaraco-context-6.0.1-3.el9.noa 2.4 MB/s | 20 kB 00:00 2026-02-24T18:27:16.830 INFO:teuthology.orchestra.run.trial114.stdout:(32/40): python3-jaraco-functools-3.5.0-2.el9.n 2.5 MB/s | 19 kB 00:00 2026-02-24T18:27:16.838 INFO:teuthology.orchestra.run.trial114.stdout:(33/40): python3-jaraco-text-4.0.0-2.el9.noarch 3.2 MB/s | 26 kB 00:00 2026-02-24T18:27:16.847 INFO:teuthology.orchestra.run.trial114.stdout:(34/40): python3-more-itertools-8.12.0-2.el9.no 8.7 MB/s | 79 kB 00:00 2026-02-24T18:27:16.855 INFO:teuthology.orchestra.run.trial114.stdout:(35/40): python3-portend-3.1.0-2.el9.noarch.rpm 2.1 MB/s | 16 kB 00:00 2026-02-24T18:27:16.864 INFO:teuthology.orchestra.run.trial114.stdout:(36/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 10 MB/s | 90 kB 00:00 2026-02-24T18:27:16.871 INFO:teuthology.orchestra.run.trial114.stdout:(37/40): python3-tempora-5.0.0-2.el9.noarch.rpm 4.4 MB/s | 36 kB 00:00 2026-02-24T18:27:16.879 INFO:teuthology.orchestra.run.trial114.stdout:(38/40): python3-zc-lockfile-2.0-10.el9.noarch. 2.5 MB/s | 20 kB 00:00 2026-02-24T18:27:17.023 INFO:teuthology.orchestra.run.trial114.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:17.476 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:27:17.480 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:17.518 INFO:teuthology.orchestra.run.trial114.stdout:(39/40): lua-devel-5.4.4-4.el9.x86_64.rpm 26 kB/s | 22 kB 00:00 2026-02-24T18:27:17.683 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:27:17.684 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:17.685 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:27:17.685 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:27:17.685 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:27:17.742 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:27:17.743 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:17.743 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:17.743 INFO:teuthology.orchestra.run.trial179.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:27:17.743 INFO:teuthology.orchestra.run.trial179.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:17.743 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:17.743 INFO:teuthology.orchestra.run.trial179.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:17.743 INFO:teuthology.orchestra.run.trial179.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:27:17.743 INFO:teuthology.orchestra.run.trial179.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:27:17.743 INFO:teuthology.orchestra.run.trial179.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial179.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial179.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial179.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial179.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial179.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial179.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial179.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:17.744 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:17.775 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:27:18.084 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:16 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout:====================================================================================== 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repository Size 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout:====================================================================================== 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:27:18.167 INFO:teuthology.orchestra.run.trial179.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout:====================================================================================== 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout:Install 12 Packages 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 43 M 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 234 M 2026-02-24T18:27:18.168 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:18.316 INFO:teuthology.orchestra.run.trial045.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 2.3 MB/s | 84 MB 00:35 2026-02-24T18:27:18.318 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:18.318 INFO:teuthology.orchestra.run.trial045.stdout:Total 2.4 MB/s | 85 MB 00:35 2026-02-24T18:27:18.342 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:27:18.353 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:27:18.353 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:27:18.641 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:27:18.642 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:27:18.825 INFO:teuthology.orchestra.run.trial179.stdout:[MIRROR] libgfortran-11.5.0-14.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-14.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:18.830 INFO:teuthology.orchestra.run.trial179.stdout:[MIRROR] libquadmath-11.5.0-14.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-14.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:18.955 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:27:18.961 INFO:teuthology.orchestra.run.trial045.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:18.965 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:18.973 INFO:teuthology.orchestra.run.trial045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:18.974 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:19.463 INFO:teuthology.orchestra.run.trial179.stdout:[MIRROR] libgfortran-11.5.0-14.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-14.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:19.469 INFO:teuthology.orchestra.run.trial179.stdout:[MIRROR] libquadmath-11.5.0-14.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-14.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T18:27:19.488 INFO:teuthology.orchestra.run.trial179.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 162 kB/s | 184 kB 00:01 2026-02-24T18:27:19.490 INFO:teuthology.orchestra.run.trial179.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 695 kB/s | 794 kB 00:01 2026-02-24T18:27:19.543 INFO:teuthology.orchestra.run.trial179.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 544 kB/s | 30 kB 00:00 2026-02-24T18:27:19.583 INFO:teuthology.orchestra.run.trial179.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 367 kB/s | 15 kB 00:00 2026-02-24T18:27:19.593 INFO:teuthology.orchestra.run.trial179.stdout:(5/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 29 MB/s | 3.0 MB 00:00 2026-02-24T18:27:19.620 INFO:teuthology.orchestra.run.trial179.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 1.1 MB/s | 42 kB 00:00 2026-02-24T18:27:19.664 INFO:teuthology.orchestra.run.trial179.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 5.4 MB/s | 244 kB 00:00 2026-02-24T18:27:19.677 INFO:teuthology.orchestra.run.trial179.stdout:(8/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 63 MB/s | 5.3 MB 00:00 2026-02-24T18:27:19.726 INFO:teuthology.orchestra.run.trial179.stdout:(9/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 99 MB/s | 6.1 MB 00:00 2026-02-24T18:27:19.727 INFO:teuthology.orchestra.run.trial179.stdout:(10/12): python3-numpy-f2py-1.23.5-2.el9.x86_64 8.6 MB/s | 442 kB 00:00 2026-02-24T18:27:19.903 INFO:teuthology.orchestra.run.trial179.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 109 MB/s | 19 MB 00:00 2026-02-24T18:27:21.036 INFO:teuthology.orchestra.run.trial114.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 2.0 MB/s | 17 MB 00:08 2026-02-24T18:27:21.038 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:21.038 INFO:teuthology.orchestra.run.trial114.stdout:Total 3.1 MB/s | 30 MB 00:09 2026-02-24T18:27:21.182 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:21.200 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:21.200 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:21.303 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:27:21.304 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /sys 2026-02-24T18:27:21.304 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /proc 2026-02-24T18:27:21.304 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /mnt 2026-02-24T18:27:21.304 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /var/tmp 2026-02-24T18:27:21.304 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /home 2026-02-24T18:27:21.304 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /root 2026-02-24T18:27:21.304 INFO:teuthology.orchestra.run.trial194.stdout:skipping the directory /tmp 2026-02-24T18:27:21.304 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:21.345 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:21.345 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:21.526 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:21.528 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:21.532 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:21.537 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:21.541 INFO:teuthology.orchestra.run.trial114.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:21.547 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:21.571 INFO:teuthology.orchestra.run.trial114.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:21.575 INFO:teuthology.orchestra.run.trial114.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:21.580 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:21.585 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:21.591 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:21.595 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:21.601 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:21.606 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:21.609 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:21.615 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:21.618 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:21.625 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:21.628 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:21.651 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:21.663 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:21.668 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:21.678 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:21.685 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:21.698 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:21.713 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:21.787 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:21.796 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:21.819 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:21.847 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:21.853 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:21.899 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:21.944 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:21.945 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:21.968 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:21.968 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:21.968 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:21.969 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:21.969 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:21.969 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:21.972 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:21.988 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:21.988 INFO:teuthology.orchestra.run.trial114.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:21.988 INFO:teuthology.orchestra.run.trial114.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:21.989 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:21.995 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:22.018 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:22.019 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:22.019 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:22.329 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:27:22.353 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:27:22.353 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:22.353 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:27:22.353 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:27:22.353 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:27:22.353 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:22.355 INFO:teuthology.orchestra.run.trial194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:27:22.367 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:27:22.367 INFO:teuthology.orchestra.run.trial194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:27:22.424 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:27:22.425 INFO:teuthology.orchestra.run.trial194.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:27:22.425 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:22.746 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:27:22.746 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:27:22.747 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:27:22.749 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:22.751 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:22.778 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:22.778 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:22.778 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:22.778 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:22.778 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:22.778 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:22.810 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:22.814 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:27:22.814 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:22.814 INFO:teuthology.orchestra.run.trial194.stdout:Upgraded: 2026-02-24T18:27:22.814 INFO:teuthology.orchestra.run.trial194.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.814 INFO:teuthology.orchestra.run.trial194.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.814 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:27:22.814 INFO:teuthology.orchestra.run.trial194.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:27:22.814 INFO:teuthology.orchestra.run.trial194.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.814 INFO:teuthology.orchestra.run.trial194.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:27:22.815 INFO:teuthology.orchestra.run.trial194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:27:22.816 INFO:teuthology.orchestra.run.trial194.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.816 INFO:teuthology.orchestra.run.trial194.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:27:22.816 INFO:teuthology.orchestra.run.trial194.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.816 INFO:teuthology.orchestra.run.trial194.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:27:22.816 INFO:teuthology.orchestra.run.trial194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:27:22.816 INFO:teuthology.orchestra.run.trial194.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:27:22.816 INFO:teuthology.orchestra.run.trial194.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:27:22.816 INFO:teuthology.orchestra.run.trial194.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:27:22.816 INFO:teuthology.orchestra.run.trial194.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:22.817 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:27:22.828 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:22.859 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-test 2026-02-24T18:27:23.010 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:23.032 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:23.032 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:23.032 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:23.032 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:23.032 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:23.032 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:23.136 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:23.157 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:23.157 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:23.157 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:23.157 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:23.157 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:23.158 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:23.162 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:23.162 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:23.162 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:23.162 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:23.162 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:23.175 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:00:24 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:27:23.175 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:23.220 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:23.220 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:23.221 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:27:23.221 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:23.221 INFO:teuthology.orchestra.run.trial045.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:23.221 INFO:teuthology.orchestra.run.trial045.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:23.221 INFO:teuthology.orchestra.run.trial045.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:23.221 INFO:teuthology.orchestra.run.trial045.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:23.221 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:23.221 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:23.257 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph 2026-02-24T18:27:23.259 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:27:23.259 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:27:23.260 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:23.261 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:27:23.261 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:27:23.261 INFO:teuthology.orchestra.run.trial194.stdout:Install 5 Packages 2026-02-24T18:27:23.261 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:27:23.261 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 85 M 2026-02-24T18:27:23.261 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 365 M 2026-02-24T18:27:23.261 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:27:23.423 INFO:teuthology.orchestra.run.trial179.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.5 MB/s | 7.4 MB 00:05 2026-02-24T18:27:23.425 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:23.425 INFO:teuthology.orchestra.run.trial179.stdout:Total 8.1 MB/s | 43 MB 00:05 2026-02-24T18:27:23.511 INFO:teuthology.orchestra.run.trial194.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.5 MB/s | 233 kB 00:00 2026-02-24T18:27:23.515 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:23.515 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:23.515 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:23.515 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:23.515 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:23.515 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:23.516 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:23.517 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:23.518 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:23.518 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:23.518 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:23.518 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:23.518 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:23.518 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:23.518 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:23.518 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:23.518 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:23.563 INFO:teuthology.orchestra.run.trial194.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 5.6 MB/s | 303 kB 00:00 2026-02-24T18:27:23.575 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:18 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:23.577 INFO:teuthology.orchestra.run.trial114.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:23.578 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:23.580 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:23.589 INFO:teuthology.orchestra.run.trial194.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-24T18:27:23.593 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:23.593 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:23.614 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-base 2026-02-24T18:27:23.660 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:23.661 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:23.661 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-24T18:27:23.661 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:23.661 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:27:23.661 INFO:teuthology.orchestra.run.trial045.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:23.661 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:23.662 INFO:teuthology.orchestra.run.trial045.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:23.663 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:23.664 INFO:teuthology.orchestra.run.trial045.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:23.665 INFO:teuthology.orchestra.run.trial045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:23.665 INFO:teuthology.orchestra.run.trial045.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:23.665 INFO:teuthology.orchestra.run.trial045.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:23.665 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:23.665 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:27:23.665 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:23.665 INFO:teuthology.orchestra.run.trial045.stdout:Install 40 Packages 2026-02-24T18:27:23.665 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:23.666 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 30 M 2026-02-24T18:27:23.666 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 100 M 2026-02-24T18:27:23.666 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:27:23.795 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:23.795 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:23.815 INFO:teuthology.orchestra.run.trial194.stdout:(4/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 358 kB/s | 164 kB 00:00 2026-02-24T18:27:23.933 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:24 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:23.998 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:24.011 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:24.014 INFO:teuthology.orchestra.run.trial179.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:27:24.016 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:24.016 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T18:27:24.017 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:24.019 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:24.039 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install cephadm 2026-02-24T18:27:24.053 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:24.058 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:27:24.115 INFO:teuthology.orchestra.run.trial179.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:27:24.118 INFO:teuthology.orchestra.run.trial179.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:27:24.139 INFO:teuthology.orchestra.run.trial179.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:27:24.361 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:25 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:24.444 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:27:24.445 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:24.446 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 1.0 M 2026-02-24T18:27:24.446 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 1.0 M 2026-02-24T18:27:24.446 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:24.458 INFO:teuthology.orchestra.run.trial179.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:27:24.465 INFO:teuthology.orchestra.run.trial045.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 24 kB/s | 6.5 kB 00:00 2026-02-24T18:27:24.530 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:27:25.199 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:25.585 INFO:teuthology.orchestra.run.trial114.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 896 kB/s | 1.0 MB 00:01 2026-02-24T18:27:25.586 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:25.586 INFO:teuthology.orchestra.run.trial114.stdout:Total 895 kB/s | 1.0 MB 00:01 2026-02-24T18:27:25.586 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:25.588 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:25.588 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:25.592 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:25.592 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:25.610 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:25.657 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:27:25.657 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:25.677 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:25.691 INFO:teuthology.orchestra.run.trial114.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:25.759 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:25.820 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:25.820 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:25.820 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:25.820 INFO:teuthology.orchestra.run.trial114.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:25.820 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:25.820 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:25.847 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:25.880 INFO:teuthology.orchestra.run.trial045.stdout:(2/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.4 MB/s | 2.3 MB 00:01 2026-02-24T18:27:25.911 INFO:teuthology.orchestra.run.trial045.stdout:(3/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 558 kB/s | 961 kB 00:01 2026-02-24T18:27:25.981 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:25.981 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:27:25.981 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:25.981 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:25.981 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:27:25.981 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:27:25.981 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:27:25.981 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:27:25.982 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:27:25.982 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:27:25.982 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:25.982 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:27:26.043 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:27:26.043 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:26.043 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:26.043 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:26.043 INFO:teuthology.orchestra.run.trial179.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:27:26.043 INFO:teuthology.orchestra.run.trial179.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:26.044 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:26.081 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:27:26.165 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:27 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 154 k 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 447 k 2026-02-24T18:27:26.248 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:26.307 INFO:teuthology.orchestra.run.trial045.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 730 kB/s | 290 kB 00:00 2026-02-24T18:27:26.398 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:24 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:26.483 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:26.483 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:26.483 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repository Size 2026-02-24T18:27:26.483 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:26.483 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:26.483 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:27:26.483 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:27:26.483 INFO:teuthology.orchestra.run.trial179.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout:Install 10 Packages 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 2.0 M 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 25 M 2026-02-24T18:27:26.484 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:26.734 INFO:teuthology.orchestra.run.trial114.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 317 kB/s | 154 kB 00:00 2026-02-24T18:27:26.734 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:26.734 INFO:teuthology.orchestra.run.trial114.stdout:Total 317 kB/s | 154 kB 00:00 2026-02-24T18:27:26.735 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:26.740 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:26.740 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:26.753 INFO:teuthology.orchestra.run.trial045.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 91 kB/s | 40 kB 00:00 2026-02-24T18:27:26.767 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:26.767 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:26.816 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:26.818 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:26.841 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:26.841 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:26.841 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:27:26.841 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:26.931 INFO:teuthology.orchestra.run.trial045.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 404 kB/s | 72 kB 00:00 2026-02-24T18:27:27.010 INFO:teuthology.orchestra.run.trial179.stdout:(1/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.1 MB/s | 157 kB 00:00 2026-02-24T18:27:27.030 INFO:teuthology.orchestra.run.trial179.stdout:(2/10): python3-pyasn1-modules-0.4.8-7.el9.noar 1.7 MB/s | 277 kB 00:00 2026-02-24T18:27:27.040 INFO:teuthology.orchestra.run.trial179.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 1.7 MB/s | 54 kB 00:00 2026-02-24T18:27:27.080 INFO:teuthology.orchestra.run.trial179.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 363 kB/s | 14 kB 00:00 2026-02-24T18:27:27.089 INFO:teuthology.orchestra.run.trial179.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 547 kB/s | 32 kB 00:00 2026-02-24T18:27:27.115 INFO:teuthology.orchestra.run.trial179.stdout:(6/10): python3-google-auth-2.45.0-1.el9.noarch 7.1 MB/s | 254 kB 00:00 2026-02-24T18:27:27.133 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:27.133 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:27.133 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:27.133 INFO:teuthology.orchestra.run.trial114.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:27.133 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:27.134 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:27.137 INFO:teuthology.orchestra.run.trial179.stdout:(7/10): python3-kubernetes-26.1.0-3.el9.noarch. 21 MB/s | 1.0 MB 00:00 2026-02-24T18:27:27.138 INFO:teuthology.orchestra.run.trial179.stdout:(8/10): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2026-02-24T18:27:27.147 INFO:teuthology.orchestra.run.trial179.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 9.1 MB/s | 90 kB 00:00 2026-02-24T18:27:27.162 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr 2026-02-24T18:27:27.267 INFO:teuthology.orchestra.run.trial179.stdout:(10/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9 126 kB/s | 50 kB 00:00 2026-02-24T18:27:27.267 INFO:teuthology.orchestra.run.trial045.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 754 kB/s | 253 kB 00:00 2026-02-24T18:27:27.270 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:27.271 INFO:teuthology.orchestra.run.trial179.stdout:Total 2.5 MB/s | 2.0 MB 00:00 2026-02-24T18:27:27.296 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:27.304 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:27.304 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:27.344 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:27.344 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:27.420 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:27.473 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:27:27.485 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:27.486 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:27.501 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:27:27.505 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:27:27.513 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:27:27.550 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:27.554 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:27:27.566 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:27.567 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:27.568 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T18:27:27.568 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:27.589 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:27:27.891 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:27:27.906 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:27:27.906 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:27.907 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:27.989 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:27.990 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:27.991 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-24T18:27:27.991 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:27.991 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:27.991 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:27:27.991 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:27:27.991 INFO:teuthology.orchestra.run.trial114.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:27:27.991 INFO:teuthology.orchestra.run.trial114.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:27:27.991 INFO:teuthology.orchestra.run.trial114.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:27:27.992 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:27.993 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:27.993 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:27.993 INFO:teuthology.orchestra.run.trial114.stdout:Install 14 Packages 2026-02-24T18:27:27.993 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:27.993 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 16 M 2026-02-24T18:27:27.993 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 158 M 2026-02-24T18:27:27.993 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:28.019 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:28.019 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:27:28.019 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:28.020 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:27:28.020 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:27:28.020 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:27:28.020 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:27:28.020 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:28.020 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:27:28.020 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:27:28.081 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:27:28.082 INFO:teuthology.orchestra.run.trial179.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:27:28.083 INFO:teuthology.orchestra.run.trial179.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:27:28.083 INFO:teuthology.orchestra.run.trial179.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:27:28.083 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:28.083 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:28.112 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:27:28.423 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:26 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:28.507 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:28.508 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:28.508 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repository Size 2026-02-24T18:27:28.508 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:28.509 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:28.510 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:28.510 INFO:teuthology.orchestra.run.trial179.stdout:Install 7 Packages 2026-02-24T18:27:28.510 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:28.510 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 7.1 M 2026-02-24T18:27:28.510 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 33 M 2026-02-24T18:27:28.510 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:28.662 INFO:teuthology.orchestra.run.trial179.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 11 MB/s | 249 kB 00:00 2026-02-24T18:27:28.667 INFO:teuthology.orchestra.run.trial179.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 7.0 MB/s | 35 kB 00:00 2026-02-24T18:27:28.686 INFO:teuthology.orchestra.run.trial179.stdout:(3/7): python3-babel-2.9.1-2.el9.noarch.rpm 131 MB/s | 6.0 MB 00:00 2026-02-24T18:27:28.785 INFO:teuthology.orchestra.run.trial045.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 840 kB/s | 1.2 MB 00:01 2026-02-24T18:27:28.808 INFO:teuthology.orchestra.run.trial114.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 51 kB/s | 17 kB 00:00 2026-02-24T18:27:28.838 INFO:teuthology.orchestra.run.trial179.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 379 kB/s | 58 kB 00:00 2026-02-24T18:27:28.859 INFO:teuthology.orchestra.run.trial114.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 111 kB/s | 43 kB 00:00 2026-02-24T18:27:28.937 INFO:teuthology.orchestra.run.trial179.stdout:(5/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.0 MB/s | 548 kB 00:00 2026-02-24T18:27:28.958 INFO:teuthology.orchestra.run.trial114.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 485 kB/s | 48 kB 00:00 2026-02-24T18:27:28.964 INFO:teuthology.orchestra.run.trial045.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 594 kB/s | 106 kB 00:00 2026-02-24T18:27:28.965 INFO:teuthology.orchestra.run.trial179.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 680 kB/s | 86 kB 00:00 2026-02-24T18:27:29.018 INFO:teuthology.orchestra.run.trial114.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2026-02-24T18:27:29.046 INFO:teuthology.orchestra.run.trial114.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 3.0 MB/s | 267 kB 00:00 2026-02-24T18:27:29.134 INFO:teuthology.orchestra.run.trial179.stdout:(7/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 350 kB/s | 173 kB 00:00 2026-02-24T18:27:29.135 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:29.135 INFO:teuthology.orchestra.run.trial179.stdout:Total 11 MB/s | 7.1 MB 00:00 2026-02-24T18:27:29.147 INFO:teuthology.orchestra.run.trial045.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 738 kB/s | 135 kB 00:00 2026-02-24T18:27:29.175 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:29.181 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:29.181 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:29.253 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:29.253 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:29.346 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:29.369 INFO:teuthology.orchestra.run.trial114.stdout:(6/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.7 MB/s | 551 kB 00:00 2026-02-24T18:27:29.395 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:27:29.405 INFO:teuthology.orchestra.run.trial045.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 585 kB/s | 150 kB 00:00 2026-02-24T18:27:29.405 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:27:29.407 INFO:teuthology.orchestra.run.trial114.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 511 kB/s | 19 kB 00:00 2026-02-24T18:27:29.411 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:27:29.534 INFO:teuthology.orchestra.run.trial114.stdout:(8/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 16 MB/s | 2.0 MB 00:00 2026-02-24T18:27:29.573 INFO:teuthology.orchestra.run.trial114.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.6 MB/s | 144 kB 00:00 2026-02-24T18:27:29.584 INFO:teuthology.orchestra.run.trial045.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 706 kB/s | 126 kB 00:00 2026-02-24T18:27:29.611 INFO:teuthology.orchestra.run.trial114.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 813 kB/s | 31 kB 00:00 2026-02-24T18:27:29.631 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:29.651 INFO:teuthology.orchestra.run.trial114.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 4.7 MB/s | 188 kB 00:00 2026-02-24T18:27:29.654 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:27:29.677 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:27:29.678 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:29.688 INFO:teuthology.orchestra.run.trial114.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 587 kB/s | 22 kB 00:00 2026-02-24T18:27:29.795 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:29.796 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:27:29.796 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:27:29.796 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:27:29.796 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:29.796 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:27:29.796 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:27:29.856 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:27:29.856 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:29.856 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial179.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial179.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial179.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial179.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial179.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial179.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:29.857 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:29.887 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-fuse 2026-02-24T18:27:29.920 INFO:teuthology.orchestra.run.trial045.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 648 kB/s | 218 kB 00:00 2026-02-24T18:27:30.177 INFO:teuthology.orchestra.run.trial045.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 708 kB/s | 182 kB 00:00 2026-02-24T18:27:30.203 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:30.286 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 942 k 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 2.7 M 2026-02-24T18:27:30.287 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:30.478 INFO:teuthology.orchestra.run.trial114.stdout:(13/14): protobuf-compiler-3.14.0-17.el9.x86_64 591 kB/s | 862 kB 00:01 2026-02-24T18:27:30.513 INFO:teuthology.orchestra.run.trial045.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 792 kB/s | 266 kB 00:00 2026-02-24T18:27:30.598 INFO:teuthology.orchestra.run.trial045.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.8 MB/s | 246 kB 00:00 2026-02-24T18:27:30.622 INFO:teuthology.orchestra.run.trial045.stdout:(17/40): lua-5.4.4-4.el9.x86_64.rpm 7.5 MB/s | 188 kB 00:00 2026-02-24T18:27:30.646 INFO:teuthology.orchestra.run.trial045.stdout:(18/40): python3-libstoragemgmt-1.10.1-1.el9.x8 7.2 MB/s | 177 kB 00:00 2026-02-24T18:27:30.669 INFO:teuthology.orchestra.run.trial045.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-24T18:27:30.692 INFO:teuthology.orchestra.run.trial045.stdout:(20/40): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-24T18:27:30.767 INFO:teuthology.orchestra.run.trial045.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2026-02-24T18:27:30.903 INFO:teuthology.orchestra.run.trial045.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2026-02-24T18:27:30.929 INFO:teuthology.orchestra.run.trial045.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 1.1 MB/s | 29 kB 00:00 2026-02-24T18:27:30.958 INFO:teuthology.orchestra.run.trial045.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 2.0 MB/s | 60 kB 00:00 2026-02-24T18:27:30.985 INFO:teuthology.orchestra.run.trial045.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.6 MB/s | 43 kB 00:00 2026-02-24T18:27:31.026 INFO:teuthology.orchestra.run.trial045.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 4.1 MB/s | 173 kB 00:00 2026-02-24T18:27:31.077 INFO:teuthology.orchestra.run.trial045.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 6.8 MB/s | 358 kB 00:00 2026-02-24T18:27:31.101 INFO:teuthology.orchestra.run.trial045.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 454 kB/s | 11 kB 00:00 2026-02-24T18:27:31.125 INFO:teuthology.orchestra.run.trial045.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 748 kB/s | 18 kB 00:00 2026-02-24T18:27:31.149 INFO:teuthology.orchestra.run.trial045.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 976 kB/s | 23 kB 00:00 2026-02-24T18:27:31.173 INFO:teuthology.orchestra.run.trial045.stdout:(31/40): python3-jaraco-context-6.0.1-3.el9.noa 829 kB/s | 20 kB 00:00 2026-02-24T18:27:31.196 INFO:teuthology.orchestra.run.trial045.stdout:(32/40): python3-jaraco-functools-3.5.0-2.el9.n 825 kB/s | 19 kB 00:00 2026-02-24T18:27:31.221 INFO:teuthology.orchestra.run.trial045.stdout:(33/40): python3-jaraco-text-4.0.0-2.el9.noarch 1.1 MB/s | 26 kB 00:00 2026-02-24T18:27:31.245 INFO:teuthology.orchestra.run.trial045.stdout:(34/40): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2026-02-24T18:27:31.269 INFO:teuthology.orchestra.run.trial045.stdout:(35/40): python3-portend-3.1.0-2.el9.noarch.rpm 692 kB/s | 16 kB 00:00 2026-02-24T18:27:31.294 INFO:teuthology.orchestra.run.trial045.stdout:(36/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2026-02-24T18:27:31.318 INFO:teuthology.orchestra.run.trial045.stdout:(37/40): python3-tempora-5.0.0-2.el9.noarch.rpm 1.5 MB/s | 36 kB 00:00 2026-02-24T18:27:31.326 INFO:teuthology.orchestra.run.trial179.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 907 kB/s | 942 kB 00:01 2026-02-24T18:27:31.328 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:31.328 INFO:teuthology.orchestra.run.trial179.stdout:Total 905 kB/s | 942 kB 00:01 2026-02-24T18:27:31.329 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:31.334 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:31.334 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:31.343 INFO:teuthology.orchestra.run.trial045.stdout:(38/40): python3-zc-lockfile-2.0-10.el9.noarch. 822 kB/s | 20 kB 00:00 2026-02-24T18:27:31.366 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:31.366 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:31.455 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:31.473 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:31.532 INFO:teuthology.orchestra.run.trial045.stdout:(39/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_ 736 kB/s | 5.1 MB 00:07 2026-02-24T18:27:31.723 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:31.785 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:31.785 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:31.786 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:31.786 INFO:teuthology.orchestra.run.trial179.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:31.786 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:31.786 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:31.811 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-volume 2026-02-24T18:27:32.121 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:30 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:32.205 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:32.206 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:32.206 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repository Size 2026-02-24T18:27:32.206 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:32.206 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:32.206 INFO:teuthology.orchestra.run.trial179.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:27:32.206 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:27:32.206 INFO:teuthology.orchestra.run.trial179.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:27:32.207 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:32.207 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:32.207 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:32.207 INFO:teuthology.orchestra.run.trial179.stdout:Install 2 Packages 2026-02-24T18:27:32.207 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:32.207 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 648 k 2026-02-24T18:27:32.207 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 2.2 M 2026-02-24T18:27:32.207 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:32.328 INFO:teuthology.orchestra.run.trial179.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 5.3 MB/s | 351 kB 00:00 2026-02-24T18:27:32.446 INFO:teuthology.orchestra.run.trial114.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 2.7 MB/s | 11 MB 00:03 2026-02-24T18:27:32.448 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:32.449 INFO:teuthology.orchestra.run.trial114.stdout:Total 3.5 MB/s | 16 MB 00:04 2026-02-24T18:27:32.453 INFO:teuthology.orchestra.run.trial045.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 2.6 MB/s | 17 MB 00:06 2026-02-24T18:27:32.455 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:32.455 INFO:teuthology.orchestra.run.trial045.stdout:Total 3.4 MB/s | 30 MB 00:08 2026-02-24T18:27:32.485 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:32.495 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:32.495 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:32.594 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:32.594 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:32.594 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:27:32.612 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:27:32.612 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:27:32.712 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:32.720 INFO:teuthology.orchestra.run.trial114.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:27:32.723 INFO:teuthology.orchestra.run.trial114.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:27:32.728 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:27:32.740 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:27:32.742 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:27:32.757 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:27:32.758 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:27:32.769 INFO:teuthology.orchestra.run.trial114.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:27:32.814 INFO:teuthology.orchestra.run.trial114.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:27:32.843 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:27:32.853 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:27:32.860 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:32.862 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:27:32.869 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:27:32.928 INFO:teuthology.orchestra.run.trial179.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 447 kB/s | 297 kB 00:00 2026-02-24T18:27:32.930 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:32.930 INFO:teuthology.orchestra.run.trial179.stdout:Total 895 kB/s | 648 kB 00:00 2026-02-24T18:27:32.938 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:27:32.940 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:32.940 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:32.945 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:32.946 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:32.946 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:32.950 INFO:teuthology.orchestra.run.trial045.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:32.952 INFO:teuthology.orchestra.run.trial045.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:32.958 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:32.982 INFO:teuthology.orchestra.run.trial045.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:32.987 INFO:teuthology.orchestra.run.trial045.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:32.988 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:32.989 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:32.992 INFO:teuthology.orchestra.run.trial045.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:32.996 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:33.003 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:33.007 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:33.012 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:33.017 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:33.021 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:33.027 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:33.030 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:33.037 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:33.040 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:33.063 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:33.069 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:33.075 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:33.080 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:33.090 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:33.097 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:33.110 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:33.125 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:33.130 INFO:teuthology.orchestra.run.trial179.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:27:33.132 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:27:33.148 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:27:33.148 INFO:teuthology.orchestra.run.trial179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:33.149 INFO:teuthology.orchestra.run.trial179.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:27:33.149 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:33.200 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:33.209 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:33.231 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:33.260 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:33.266 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:33.314 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:33.358 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:33.359 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:33.367 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:27:33.383 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:33.383 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:33.383 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:33.383 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:33.383 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:33.383 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:33.388 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:33.405 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:33.405 INFO:teuthology.orchestra.run.trial045.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:33.405 INFO:teuthology.orchestra.run.trial045.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:33.405 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:33.413 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:33.429 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:27:33.429 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:33.429 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:33.429 INFO:teuthology.orchestra.run.trial179.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:27:33.430 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:33.430 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:33.437 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:33.437 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:33.437 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:33.457 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install librados-devel 2026-02-24T18:27:33.771 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:31 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:33.856 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:33.857 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:33.857 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T18:27:33.857 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:33.857 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:33.857 INFO:teuthology.orchestra.run.trial179.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:27:33.857 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:33.857 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:33.857 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:33.858 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:27:33.858 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:33.858 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 126 k 2026-02-24T18:27:33.858 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 449 k 2026-02-24T18:27:33.858 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:34.000 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:27:34.005 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:34.135 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:34.136 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:34.162 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:34.162 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:34.162 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:34.162 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:34.162 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:34.162 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:34.221 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:34.221 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:27:34.221 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:27:34.222 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:27:34.223 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:27:34.283 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:27:34.283 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:34.283 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:34.283 INFO:teuthology.orchestra.run.trial114.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:27:34.283 INFO:teuthology.orchestra.run.trial114.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:34.283 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:34.283 INFO:teuthology.orchestra.run.trial114.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:34.283 INFO:teuthology.orchestra.run.trial114.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:34.284 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:34.314 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:27:34.325 INFO:teuthology.orchestra.run.trial179.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 268 kB/s | 126 kB 00:00 2026-02-24T18:27:34.326 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:34.326 INFO:teuthology.orchestra.run.trial179.stdout:Total 268 kB/s | 126 kB 00:00 2026-02-24T18:27:34.326 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:34.329 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:34.329 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:34.360 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:34.360 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:34.378 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:34.401 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:34.402 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:34.402 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:34.402 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:34.402 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:34.402 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:34.416 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:34.433 INFO:teuthology.orchestra.run.trial179.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:34.501 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:34.520 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:34.523 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:34.523 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:34.523 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:34.523 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:34.523 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:34.523 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:34.541 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:34.582 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:34.582 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:34.583 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:34.583 INFO:teuthology.orchestra.run.trial179.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.583 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:34.583 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:34.609 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install libcephfs2 2026-02-24T18:27:34.633 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:34.717 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:34.718 INFO:teuthology.orchestra.run.trial114.stdout:====================================================================================== 2026-02-24T18:27:34.718 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-24T18:27:34.718 INFO:teuthology.orchestra.run.trial114.stdout:====================================================================================== 2026-02-24T18:27:34.718 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:34.718 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:27:34.718 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:27:34.718 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:34.719 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:34.720 INFO:teuthology.orchestra.run.trial114.stdout:====================================================================================== 2026-02-24T18:27:34.720 INFO:teuthology.orchestra.run.trial114.stdout:Install 12 Packages 2026-02-24T18:27:34.720 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:34.720 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 43 M 2026-02-24T18:27:34.720 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 234 M 2026-02-24T18:27:34.720 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:34.881 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:34.882 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:34.920 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:32 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:34.944 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:34.944 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:34.944 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial045.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:34.946 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:34.947 INFO:teuthology.orchestra.run.trial045.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:34.948 INFO:teuthology.orchestra.run.trial045.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:34.948 INFO:teuthology.orchestra.run.trial045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:34.948 INFO:teuthology.orchestra.run.trial045.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:34.948 INFO:teuthology.orchestra.run.trial045.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:34.948 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:34.948 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:34.981 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-base 2026-02-24T18:27:34.986 INFO:teuthology.orchestra.run.trial179.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:35.004 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:35.005 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T18:27:35.005 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:35.026 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install libcephfs-devel 2026-02-24T18:27:35.090 INFO:teuthology.orchestra.run.trial114.stdout:(1/12): libgfortran-11.5.0-14.el9.x86_64.rpm 13 MB/s | 794 kB 00:00 2026-02-24T18:27:35.101 INFO:teuthology.orchestra.run.trial114.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 2.7 MB/s | 30 kB 00:00 2026-02-24T18:27:35.105 INFO:teuthology.orchestra.run.trial114.stdout:(3/12): libquadmath-11.5.0-14.el9.x86_64.rpm 2.3 MB/s | 184 kB 00:00 2026-02-24T18:27:35.116 INFO:teuthology.orchestra.run.trial114.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 1.4 MB/s | 15 kB 00:00 2026-02-24T18:27:35.128 INFO:teuthology.orchestra.run.trial114.stdout:(5/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 108 MB/s | 3.0 MB 00:00 2026-02-24T18:27:35.129 INFO:teuthology.orchestra.run.trial114.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 3.3 MB/s | 42 kB 00:00 2026-02-24T18:27:35.150 INFO:teuthology.orchestra.run.trial114.stdout:(7/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 245 MB/s | 5.3 MB 00:00 2026-02-24T18:27:35.150 INFO:teuthology.orchestra.run.trial114.stdout:(8/12): python3-devel-3.9.25-3.el9.x86_64.rpm 11 MB/s | 244 kB 00:00 2026-02-24T18:27:35.171 INFO:teuthology.orchestra.run.trial114.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 22 MB/s | 442 kB 00:00 2026-02-24T18:27:35.178 INFO:teuthology.orchestra.run.trial114.stdout:(10/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 223 MB/s | 6.1 MB 00:00 2026-02-24T18:27:35.297 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:30 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:35.338 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:33 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:35.345 INFO:teuthology.orchestra.run.trial114.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 111 MB/s | 19 MB 00:00 2026-02-24T18:27:35.364 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:35.381 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:35.382 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T18:27:35.382 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:35.403 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install cephadm 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout:Installing dependencies: 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout:Install 2 Packages 2026-02-24T18:27:35.422 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:35.423 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 58 k 2026-02-24T18:27:35.423 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 207 k 2026-02-24T18:27:35.423 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:35.719 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:30 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:35.774 INFO:teuthology.orchestra.run.trial179.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 98 kB/s | 34 kB 00:00 2026-02-24T18:27:35.774 INFO:teuthology.orchestra.run.trial179.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 69 kB/s | 24 kB 00:00 2026-02-24T18:27:35.775 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:35.775 INFO:teuthology.orchestra.run.trial179.stdout:Total 166 kB/s | 58 kB 00:00 2026-02-24T18:27:35.775 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:35.778 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:35.779 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:35.802 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:35.802 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:35.802 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-24T18:27:35.802 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:35.802 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:27:35.802 INFO:teuthology.orchestra.run.trial045.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:35.802 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:35.802 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:27:35.802 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:35.803 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:27:35.803 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:35.803 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 1.0 M 2026-02-24T18:27:35.803 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 1.0 M 2026-02-24T18:27:35.803 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:27:35.809 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:35.809 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:35.858 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:35.859 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:27:35.873 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:27:35.890 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:27:35.954 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:27:35.954 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:27:36.017 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:27:36.017 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:36.018 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:36.018 INFO:teuthology.orchestra.run.trial179.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:36.018 INFO:teuthology.orchestra.run.trial179.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:36.018 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:36.018 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:36.044 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install librados2 2026-02-24T18:27:36.357 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:36.423 INFO:teuthology.orchestra.run.trial179.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:36.442 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:36.442 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T18:27:36.442 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:36.463 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install librbd1 2026-02-24T18:27:36.779 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:36.845 INFO:teuthology.orchestra.run.trial179.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:36.864 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:36.864 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T18:27:36.864 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:36.886 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install python3-rados 2026-02-24T18:27:37.105 INFO:teuthology.orchestra.run.trial045.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 784 kB/s | 1.0 MB 00:01 2026-02-24T18:27:37.106 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:37.106 INFO:teuthology.orchestra.run.trial045.stdout:Total 783 kB/s | 1.0 MB 00:01 2026-02-24T18:27:37.106 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:27:37.108 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:27:37.109 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:27:37.113 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:27:37.113 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:27:37.131 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:27:37.197 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:37.198 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:37.211 INFO:teuthology.orchestra.run.trial045.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:37.263 INFO:teuthology.orchestra.run.trial179.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:37.282 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:37.282 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T18:27:37.282 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:37.286 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:37.304 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install python3-rgw 2026-02-24T18:27:37.347 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:37.347 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:37.347 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:27:37.347 INFO:teuthology.orchestra.run.trial045.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:37.348 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:37.348 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:37.374 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:37.617 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:37.684 INFO:teuthology.orchestra.run.trial179.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:37.687 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:32 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:37.703 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:37.704 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T18:27:37.704 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:37.725 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install python3-cephfs 2026-02-24T18:27:37.771 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:37.773 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:37.773 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T18:27:37.773 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:37.773 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:27:37.773 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:27:37.773 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:37.773 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:27:37.773 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:37.774 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:27:37.774 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:37.774 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 154 k 2026-02-24T18:27:37.774 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 447 k 2026-02-24T18:27:37.774 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:27:38.045 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:36 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:38.114 INFO:teuthology.orchestra.run.trial179.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:38.134 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:38.134 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T18:27:38.135 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:38.156 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install python3-rbd 2026-02-24T18:27:38.308 INFO:teuthology.orchestra.run.trial045.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 288 kB/s | 154 kB 00:00 2026-02-24T18:27:38.308 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:38.308 INFO:teuthology.orchestra.run.trial045.stdout:Total 287 kB/s | 154 kB 00:00 2026-02-24T18:27:38.309 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:27:38.314 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:27:38.314 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:27:38.341 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:27:38.341 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:27:38.391 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:27:38.393 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:38.416 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:38.416 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:38.416 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:27:38.416 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:38.470 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:36 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:38.535 INFO:teuthology.orchestra.run.trial179.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:38.554 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:38.555 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T18:27:38.555 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:38.576 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install rbd-fuse 2026-02-24T18:27:38.711 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:38.711 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:38.711 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:27:38.711 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:38.711 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:38.711 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:38.738 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr 2026-02-24T18:27:38.893 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:36 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:38.978 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 91 k 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 238 k 2026-02-24T18:27:38.979 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:39.055 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:39.121 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:39.139 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:39.139 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T18:27:39.140 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:39.160 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:27:39.468 INFO:teuthology.orchestra.run.trial179.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 187 kB/s | 91 kB 00:00 2026-02-24T18:27:39.468 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:39.469 INFO:teuthology.orchestra.run.trial179.stdout:Total 186 kB/s | 91 kB 00:00 2026-02-24T18:27:39.469 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:39.473 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:39.473 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:39.474 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:39.504 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:39.504 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:39.554 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:27:39.558 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout:Install 14 Packages 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 16 M 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 158 M 2026-02-24T18:27:39.559 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:27:39.572 INFO:teuthology.orchestra.run.trial179.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:39.655 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:39.717 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:39.718 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:39.718 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:39.718 INFO:teuthology.orchestra.run.trial179.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:39.718 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:39.718 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:39.745 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install rbd-mirror 2026-02-24T18:27:40.061 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:38 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:40.145 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:27:40.146 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:40.147 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 2.9 M 2026-02-24T18:27:40.147 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 11 M 2026-02-24T18:27:40.147 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:40.253 INFO:teuthology.orchestra.run.trial045.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 65 kB/s | 17 kB 00:00 2026-02-24T18:27:40.311 INFO:teuthology.orchestra.run.trial045.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 133 kB/s | 43 kB 00:00 2026-02-24T18:27:40.382 INFO:teuthology.orchestra.run.trial114.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.4 MB/s | 7.4 MB 00:05 2026-02-24T18:27:40.384 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:40.384 INFO:teuthology.orchestra.run.trial114.stdout:Total 7.5 MB/s | 43 MB 00:05 2026-02-24T18:27:40.543 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:40.557 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:40.557 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:40.629 INFO:teuthology.orchestra.run.trial045.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 149 kB/s | 48 kB 00:00 2026-02-24T18:27:40.760 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:40.761 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:40.909 INFO:teuthology.orchestra.run.trial045.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2026-02-24T18:27:40.914 INFO:teuthology.orchestra.run.trial045.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 939 kB/s | 267 kB 00:00 2026-02-24T18:27:40.946 INFO:teuthology.orchestra.run.trial045.stdout:(6/14): protobuf-compiler-3.14.0-17.el9.x86_64. 23 MB/s | 862 kB 00:00 2026-02-24T18:27:40.979 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:40.982 INFO:teuthology.orchestra.run.trial114.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:27:40.988 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:41.022 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:41.026 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:27:41.087 INFO:teuthology.orchestra.run.trial114.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:27:41.089 INFO:teuthology.orchestra.run.trial114.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:27:41.111 INFO:teuthology.orchestra.run.trial114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:27:41.195 INFO:teuthology.orchestra.run.trial045.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2026-02-24T18:27:41.429 INFO:teuthology.orchestra.run.trial114.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:27:41.462 INFO:teuthology.orchestra.run.trial045.stdout:(8/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-24T18:27:41.501 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:27:41.540 INFO:teuthology.orchestra.run.trial045.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.8 MB/s | 144 kB 00:00 2026-02-24T18:27:41.607 INFO:teuthology.orchestra.run.trial045.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 457 kB/s | 31 kB 00:00 2026-02-24T18:27:41.630 INFO:teuthology.orchestra.run.trial045.stdout:(11/14): python3-grpcio-1.46.7-10.el9.x86_64.rp 4.7 MB/s | 2.0 MB 00:00 2026-02-24T18:27:41.686 INFO:teuthology.orchestra.run.trial045.stdout:(12/14): python3-routes-2.5.1-5.el9.noarch.rpm 2.3 MB/s | 188 kB 00:00 2026-02-24T18:27:41.691 INFO:teuthology.orchestra.run.trial045.stdout:(13/14): python3-xmltodict-0.12.0-15.el9.noarch 363 kB/s | 22 kB 00:00 2026-02-24T18:27:42.160 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:42.612 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:27:42.613 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:42.834 INFO:teuthology.orchestra.run.trial179.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.1 MB/s | 2.9 MB 00:02 2026-02-24T18:27:42.835 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:42.835 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.1 MB/s | 2.9 MB 00:02 2026-02-24T18:27:42.836 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:42.841 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:42.841 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:42.879 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:42.879 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:42.912 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:42.912 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:42.913 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:27:42.976 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:27:42.976 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:42.976 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:42.976 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:42.976 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:27:42.976 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:27:42.976 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:27:42.977 INFO:teuthology.orchestra.run.trial114.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:27:42.977 INFO:teuthology.orchestra.run.trial114.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:27:42.977 INFO:teuthology.orchestra.run.trial114.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:27:42.977 INFO:teuthology.orchestra.run.trial114.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:27:42.977 INFO:teuthology.orchestra.run.trial114.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:27:42.977 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:42.978 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:42.978 INFO:teuthology.orchestra.run.trial114.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:27:42.978 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:42.978 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:43.015 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:27:43.049 INFO:teuthology.orchestra.run.trial045.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 3.5 MB/s | 11 MB 00:03 2026-02-24T18:27:43.051 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:43.051 INFO:teuthology.orchestra.run.trial045.stdout:Total 4.5 MB/s | 16 MB 00:03 2026-02-24T18:27:43.059 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:43.061 INFO:teuthology.orchestra.run.trial179.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:43.083 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:43.083 INFO:teuthology.orchestra.run.trial179.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:43.083 INFO:teuthology.orchestra.run.trial179.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:27:43.083 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:27:43.083 INFO:teuthology.orchestra.run.trial179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:27:43.083 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:43.087 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:27:43.097 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:27:43.097 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:27:43.194 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:27:43.194 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:27:43.312 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:27:43.319 INFO:teuthology.orchestra.run.trial045.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:27:43.323 INFO:teuthology.orchestra.run.trial045.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:27:43.327 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:27:43.336 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:44 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:43.339 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:27:43.341 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:27:43.368 INFO:teuthology.orchestra.run.trial045.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:27:43.377 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:43.377 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:43.377 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:43.377 INFO:teuthology.orchestra.run.trial179.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:43.378 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:43.378 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:43.404 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install rbd-nbd 2026-02-24T18:27:43.410 INFO:teuthology.orchestra.run.trial045.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:27:43.420 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:43.421 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:43.421 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-24T18:27:43.421 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:27:43.422 INFO:teuthology.orchestra.run.trial114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial114.stdout:Install 10 Packages 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 2.0 M 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 25 M 2026-02-24T18:27:43.423 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:43.439 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:27:43.449 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:27:43.455 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:43.458 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:27:43.465 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:27:43.701 INFO:teuthology.orchestra.run.trial114.stdout:(1/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.1 MB/s | 157 kB 00:00 2026-02-24T18:27:43.719 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:41 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:43.721 INFO:teuthology.orchestra.run.trial114.stdout:(2/10): python3-pyasn1-modules-0.4.8-7.el9.noar 1.7 MB/s | 277 kB 00:00 2026-02-24T18:27:43.731 INFO:teuthology.orchestra.run.trial114.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 1.7 MB/s | 54 kB 00:00 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 180 k 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 498 k 2026-02-24T18:27:43.803 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:43.832 INFO:teuthology.orchestra.run.trial114.stdout:(4/10): python3-cachetools-4.2.4-1.el9.noarch.r 293 kB/s | 32 kB 00:00 2026-02-24T18:27:43.832 INFO:teuthology.orchestra.run.trial114.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2026-02-24T18:27:43.927 INFO:teuthology.orchestra.run.trial114.stdout:(6/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 137 kB/s | 50 kB 00:00 2026-02-24T18:27:43.930 INFO:teuthology.orchestra.run.trial114.stdout:(7/10): python3-google-auth-2.45.0-1.el9.noarch 2.5 MB/s | 254 kB 00:00 2026-02-24T18:27:43.986 INFO:teuthology.orchestra.run.trial114.stdout:(8/10): python3-kubernetes-26.1.0-3.el9.noarch. 6.7 MB/s | 1.0 MB 00:00 2026-02-24T18:27:43.986 INFO:teuthology.orchestra.run.trial114.stdout:(9/10): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2026-02-24T18:27:43.987 INFO:teuthology.orchestra.run.trial114.stdout:(10/10): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2026-02-24T18:27:43.989 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:43.989 INFO:teuthology.orchestra.run.trial114.stdout:Total 3.5 MB/s | 2.0 MB 00:00 2026-02-24T18:27:44.016 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:44.023 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:44.023 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:44.064 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:44.064 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:44.139 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:44.189 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:27:44.202 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:44.216 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:27:44.221 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:27:44.229 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:27:44.255 INFO:teuthology.orchestra.run.trial179.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 398 kB/s | 180 kB 00:00 2026-02-24T18:27:44.256 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:44.256 INFO:teuthology.orchestra.run.trial179.stdout:Total 397 kB/s | 180 kB 00:00 2026-02-24T18:27:44.256 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:27:44.261 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:27:44.261 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:27:44.268 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:27:44.280 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:44.291 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:27:44.291 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:27:44.347 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:27:44.364 INFO:teuthology.orchestra.run.trial179.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:44.449 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:44.516 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:44.517 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:44.517 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:27:44.517 INFO:teuthology.orchestra.run.trial179.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:44.517 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:44.517 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:27:44.545 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:27:44.587 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:27:44.591 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:44.595 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:27:44.609 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:27:44.610 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:44.725 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:44.725 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:27:44.725 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:44.726 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:27:44.726 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:27:44.726 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:27:44.726 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:27:44.726 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:44.726 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:27:44.726 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:27:44.787 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:27:44.787 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:44.787 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:44.787 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:44.787 INFO:teuthology.orchestra.run.trial114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:27:44.787 INFO:teuthology.orchestra.run.trial114.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:27:44.788 INFO:teuthology.orchestra.run.trial114.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:27:44.788 INFO:teuthology.orchestra.run.trial114.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:27:44.788 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:27:44.788 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:27:44.788 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:27:44.788 INFO:teuthology.orchestra.run.trial114.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:27:44.788 INFO:teuthology.orchestra.run.trial114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:27:44.788 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:44.788 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:44.799 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:27:44.800 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:27:44.819 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:44.860 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:44.861 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:01:42 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:27:44.891 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:27:44.944 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:27:44.945 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:44.945 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T18:27:44.945 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 107 M 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 664 M 2026-02-24T18:27:44.946 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:27:45.134 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:46 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:45.208 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:40 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:45.217 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:45.219 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:45.219 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-24T18:27:45.219 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:45.219 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:45.219 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:27:45.219 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:27:45.219 INFO:teuthology.orchestra.run.trial114.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:27:45.219 INFO:teuthology.orchestra.run.trial114.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:27:45.219 INFO:teuthology.orchestra.run.trial114.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout:Install 7 Packages 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 7.1 M 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 33 M 2026-02-24T18:27:45.220 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:45.292 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:45.294 INFO:teuthology.orchestra.run.trial045.stdout:====================================================================================== 2026-02-24T18:27:45.294 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-24T18:27:45.294 INFO:teuthology.orchestra.run.trial045.stdout:====================================================================================== 2026-02-24T18:27:45.294 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:27:45.294 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:27:45.295 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:27:45.295 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:27:45.295 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:27:45.295 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:27:45.295 INFO:teuthology.orchestra.run.trial045.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:27:45.295 INFO:teuthology.orchestra.run.trial045.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:27:45.296 INFO:teuthology.orchestra.run.trial045.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:27:45.296 INFO:teuthology.orchestra.run.trial045.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:27:45.296 INFO:teuthology.orchestra.run.trial045.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:27:45.296 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:27:45.296 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:27:45.296 INFO:teuthology.orchestra.run.trial045.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:27:45.297 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:45.297 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:27:45.297 INFO:teuthology.orchestra.run.trial045.stdout:====================================================================================== 2026-02-24T18:27:45.297 INFO:teuthology.orchestra.run.trial045.stdout:Install 12 Packages 2026-02-24T18:27:45.297 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:45.297 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 43 M 2026-02-24T18:27:45.298 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 234 M 2026-02-24T18:27:45.298 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:27:45.931 INFO:teuthology.orchestra.run.trial114.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 3.8 MB/s | 249 kB 00:00 2026-02-24T18:27:45.947 INFO:teuthology.orchestra.run.trial114.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 2.2 MB/s | 35 kB 00:00 2026-02-24T18:27:45.962 INFO:teuthology.orchestra.run.trial114.stdout:(3/7): python3-babel-2.9.1-2.el9.noarch.rpm 64 MB/s | 6.0 MB 00:00 2026-02-24T18:27:46.288 INFO:teuthology.orchestra.run.trial114.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 177 kB/s | 58 kB 00:00 2026-02-24T18:27:46.327 INFO:teuthology.orchestra.run.trial114.stdout:(5/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 377 kB/s | 173 kB 00:00 2026-02-24T18:27:46.412 INFO:teuthology.orchestra.run.trial114.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 698 kB/s | 86 kB 00:00 2026-02-24T18:27:46.466 INFO:teuthology.orchestra.run.trial114.stdout:(7/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2026-02-24T18:27:46.467 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:46.467 INFO:teuthology.orchestra.run.trial114.stdout:Total 5.7 MB/s | 7.1 MB 00:01 2026-02-24T18:27:46.506 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:46.514 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:46.514 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:46.588 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:46.588 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:46.622 INFO:teuthology.orchestra.run.trial045.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 161 kB/s | 184 kB 00:01 2026-02-24T18:27:46.679 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:46.703 INFO:teuthology.orchestra.run.trial045.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 367 kB/s | 30 kB 00:00 2026-02-24T18:27:46.727 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:27:46.737 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:27:46.743 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:27:46.863 INFO:teuthology.orchestra.run.trial045.stdout:(3/12): libgfortran-11.5.0-14.el9.x86_64.rpm 572 kB/s | 794 kB 00:01 2026-02-24T18:27:46.892 INFO:teuthology.orchestra.run.trial045.stdout:(4/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2026-02-24T18:27:46.917 INFO:teuthology.orchestra.run.trial045.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-24T18:27:46.936 INFO:teuthology.orchestra.run.trial045.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 203 kB/s | 15 kB 00:00 2026-02-24T18:27:46.962 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:46.985 INFO:teuthology.orchestra.run.trial045.stdout:(7/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 79 MB/s | 5.3 MB 00:00 2026-02-24T18:27:46.985 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:27:47.009 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:27:47.010 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:47.051 INFO:teuthology.orchestra.run.trial045.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 92 MB/s | 6.1 MB 00:00 2026-02-24T18:27:47.052 INFO:teuthology.orchestra.run.trial045.stdout:(9/12): python3-devel-3.9.25-3.el9.x86_64.rpm 2.1 MB/s | 244 kB 00:00 2026-02-24T18:27:47.081 INFO:teuthology.orchestra.run.trial045.stdout:(10/12): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-24T18:27:47.129 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:47.130 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:27:47.130 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:27:47.130 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:27:47.130 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:47.130 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:27:47.130 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:27:47.192 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:47.193 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:47.222 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-fuse 2026-02-24T18:27:47.525 INFO:teuthology.orchestra.run.trial045.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 41 MB/s | 19 MB 00:00 2026-02-24T18:27:47.542 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:48 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:47.627 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:27:47.628 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:47.629 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 942 k 2026-02-24T18:27:47.629 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 2.7 M 2026-02-24T18:27:47.629 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:49.146 INFO:teuthology.orchestra.run.trial114.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 621 kB/s | 942 kB 00:01 2026-02-24T18:27:49.147 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:49.147 INFO:teuthology.orchestra.run.trial114.stdout:Total 620 kB/s | 942 kB 00:01 2026-02-24T18:27:49.147 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:49.152 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:49.152 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:49.185 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:49.185 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:49.274 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:49.292 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:49.539 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:49.602 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:49.602 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:49.602 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:49.602 INFO:teuthology.orchestra.run.trial114.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:49.602 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:49.602 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:49.629 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-volume 2026-02-24T18:27:49.947 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:50 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:50.032 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:50.033 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:50.033 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-24T18:27:50.033 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:50.033 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:50.033 INFO:teuthology.orchestra.run.trial114.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:27:50.033 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:27:50.033 INFO:teuthology.orchestra.run.trial114.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:27:50.033 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:50.033 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:50.034 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:50.034 INFO:teuthology.orchestra.run.trial114.stdout:Install 2 Packages 2026-02-24T18:27:50.034 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:50.034 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 648 k 2026-02-24T18:27:50.034 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 2.2 M 2026-02-24T18:27:50.034 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:50.274 INFO:teuthology.orchestra.run.trial114.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 1.9 MB/s | 351 kB 00:00 2026-02-24T18:27:50.781 INFO:teuthology.orchestra.run.trial114.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 433 kB/s | 297 kB 00:00 2026-02-24T18:27:50.781 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:50.781 INFO:teuthology.orchestra.run.trial114.stdout:Total 867 kB/s | 648 kB 00:00 2026-02-24T18:27:50.791 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:50.798 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:50.798 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:50.844 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:50.844 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:50.925 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:50.987 INFO:teuthology.orchestra.run.trial114.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:27:50.990 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:27:51.004 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:27:51.005 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:51.005 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:27:51.005 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:51.246 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:27:51.309 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:27:51.310 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:51.310 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:51.310 INFO:teuthology.orchestra.run.trial114.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:27:51.310 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:51.310 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:51.339 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados-devel 2026-02-24T18:27:51.657 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:52 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:51.742 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:51.742 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:51.742 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T18:27:51.742 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 126 k 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 449 k 2026-02-24T18:27:51.743 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:52.095 INFO:teuthology.orchestra.run.trial045.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.1 MB/s | 7.4 MB 00:06 2026-02-24T18:27:52.097 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:52.097 INFO:teuthology.orchestra.run.trial045.stdout:Total 6.3 MB/s | 43 MB 00:06 2026-02-24T18:27:52.205 INFO:teuthology.orchestra.run.trial114.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 272 kB/s | 126 kB 00:00 2026-02-24T18:27:52.205 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:52.206 INFO:teuthology.orchestra.run.trial114.stdout:Total 271 kB/s | 126 kB 00:00 2026-02-24T18:27:52.206 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:52.208 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:52.208 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:52.240 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:52.240 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:52.258 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:27:52.272 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:27:52.272 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:27:52.296 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:52.314 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:52.401 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:52.464 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:52.464 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:52.465 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:52.465 INFO:teuthology.orchestra.run.trial114.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:52.465 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:52.465 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:52.474 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:27:52.475 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:27:52.494 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install libcephfs2 2026-02-24T18:27:52.693 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:27:52.696 INFO:teuthology.orchestra.run.trial045.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:27:52.704 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:52.737 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:52.742 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:27:52.800 INFO:teuthology.orchestra.run.trial045.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:27:52.803 INFO:teuthology.orchestra.run.trial045.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:27:52.816 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:53 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:52.825 INFO:teuthology.orchestra.run.trial045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:27:52.881 INFO:teuthology.orchestra.run.trial114.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:52.900 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:52.901 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T18:27:52.901 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:52.922 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install libcephfs-devel 2026-02-24T18:27:53.144 INFO:teuthology.orchestra.run.trial045.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:27:53.216 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:27:53.240 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:54 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:53.323 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:53.324 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:53.325 INFO:teuthology.orchestra.run.trial114.stdout:Install 2 Packages 2026-02-24T18:27:53.326 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:53.326 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 58 k 2026-02-24T18:27:53.326 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 207 k 2026-02-24T18:27:53.326 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:53.671 INFO:teuthology.orchestra.run.trial114.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 99 kB/s | 34 kB 00:00 2026-02-24T18:27:53.678 INFO:teuthology.orchestra.run.trial114.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 68 kB/s | 24 kB 00:00 2026-02-24T18:27:53.679 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:53.679 INFO:teuthology.orchestra.run.trial114.stdout:Total 165 kB/s | 58 kB 00:00 2026-02-24T18:27:53.679 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:53.683 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:53.683 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:53.715 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:53.715 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:53.764 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:53.765 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:27:53.779 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:27:53.796 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:27:53.860 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:27:53.860 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:27:53.877 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:53.923 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:27:53.923 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:53.923 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:53.923 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:53.923 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:53.923 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:53.923 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:53.950 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados2 2026-02-24T18:27:54.266 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:55 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:54.332 INFO:teuthology.orchestra.run.trial114.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:54.332 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:27:54.333 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:54.350 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:54.351 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T18:27:54.351 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:54.371 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librbd1 2026-02-24T18:27:54.645 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:54.645 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:27:54.645 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:54.646 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:54.646 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:27:54.646 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:27:54.646 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:27:54.646 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:27:54.646 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:27:54.646 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:27:54.646 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:54.646 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:27:54.688 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:55 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:54.710 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:27:54.710 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:54.710 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:27:54.710 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:54.710 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:54.711 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:54.749 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:27:54.754 INFO:teuthology.orchestra.run.trial114.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:54.772 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:54.773 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T18:27:54.773 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:54.795 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rados 2026-02-24T18:27:55.068 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:50 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:55.115 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:55.151 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:55.151 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout:Install 10 Packages 2026-02-24T18:27:55.152 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:55.153 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 2.0 M 2026-02-24T18:27:55.153 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 25 M 2026-02-24T18:27:55.153 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:27:55.180 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:55.198 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:55.199 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T18:27:55.199 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:55.221 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rgw 2026-02-24T18:27:55.531 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:55.598 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:55.616 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:55.617 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T18:27:55.617 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:55.626 INFO:teuthology.orchestra.run.trial045.stdout:(1/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.1 MB/s | 157 kB 00:00 2026-02-24T18:27:55.638 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-cephfs 2026-02-24T18:27:55.645 INFO:teuthology.orchestra.run.trial045.stdout:(2/10): python3-pyasn1-modules-0.4.8-7.el9.noar 1.7 MB/s | 277 kB 00:00 2026-02-24T18:27:55.657 INFO:teuthology.orchestra.run.trial045.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 1.7 MB/s | 54 kB 00:00 2026-02-24T18:27:55.706 INFO:teuthology.orchestra.run.trial045.stdout:(4/10): python3-cachetools-4.2.4-1.el9.noarch.r 527 kB/s | 32 kB 00:00 2026-02-24T18:27:55.715 INFO:teuthology.orchestra.run.trial045.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 244 kB/s | 14 kB 00:00 2026-02-24T18:27:55.774 INFO:teuthology.orchestra.run.trial045.stdout:(6/10): python3-google-auth-2.45.0-1.el9.noarch 3.7 MB/s | 254 kB 00:00 2026-02-24T18:27:55.802 INFO:teuthology.orchestra.run.trial045.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 2.1 MB/s | 59 kB 00:00 2026-02-24T18:27:55.824 INFO:teuthology.orchestra.run.trial045.stdout:(8/10): python3-kubernetes-26.1.0-3.el9.noarch. 9.4 MB/s | 1.0 MB 00:00 2026-02-24T18:27:55.831 INFO:teuthology.orchestra.run.trial045.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 3.0 MB/s | 90 kB 00:00 2026-02-24T18:27:55.851 INFO:teuthology.orchestra.run.trial045.stdout:(10/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9 137 kB/s | 50 kB 00:00 2026-02-24T18:27:55.852 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:55.852 INFO:teuthology.orchestra.run.trial045.stdout:Total 2.8 MB/s | 2.0 MB 00:00 2026-02-24T18:27:55.878 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:27:55.886 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:27:55.886 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:27:55.926 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:27:55.927 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:27:55.955 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:56.002 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:27:56.020 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:56.041 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:56.041 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T18:27:56.041 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:56.053 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:27:56.062 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rbd 2026-02-24T18:27:56.065 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:56.081 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:27:56.085 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:27:56.093 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:27:56.133 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:27:56.145 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:56.378 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:57 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:56.443 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:56.462 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:56.463 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T18:27:56.463 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:56.467 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:27:56.482 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:27:56.483 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:56.484 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-fuse 2026-02-24T18:27:56.596 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:27:56.596 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:27:56.596 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:27:56.596 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:27:56.596 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:27:56.596 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:27:56.597 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:27:56.597 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:27:56.597 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:27:56.597 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:27:56.657 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:27:56.657 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:56.657 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:27:56.657 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:56.657 INFO:teuthology.orchestra.run.trial045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:27:56.657 INFO:teuthology.orchestra.run.trial045.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:27:56.657 INFO:teuthology.orchestra.run.trial045.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:27:56.658 INFO:teuthology.orchestra.run.trial045.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:27:56.658 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:27:56.658 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:27:56.658 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:27:56.658 INFO:teuthology.orchestra.run.trial045.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:27:56.658 INFO:teuthology.orchestra.run.trial045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:27:56.658 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:56.658 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:56.688 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:27:56.799 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:57 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:56.883 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:56.884 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:56.884 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:56.884 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 91 k 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 238 k 2026-02-24T18:27:56.885 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:57.007 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:52 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:57.092 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:Install 7 Packages 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 7.1 M 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 33 M 2026-02-24T18:27:57.093 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:27:57.275 INFO:teuthology.orchestra.run.trial114.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 234 kB/s | 91 kB 00:00 2026-02-24T18:27:57.275 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:57.275 INFO:teuthology.orchestra.run.trial114.stdout:Total 233 kB/s | 91 kB 00:00 2026-02-24T18:27:57.275 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:57.280 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:57.280 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:57.310 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:57.310 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:57.361 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:57.379 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:57.461 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:57.525 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:57.526 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:57.526 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:57.526 INFO:teuthology.orchestra.run.trial114.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:57.526 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:57.526 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:57.553 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-mirror 2026-02-24T18:27:57.680 INFO:teuthology.orchestra.run.trial045.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-24T18:27:57.706 INFO:teuthology.orchestra.run.trial045.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 1.3 MB/s | 35 kB 00:00 2026-02-24T18:27:57.827 INFO:teuthology.orchestra.run.trial045.stdout:(3/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.5 MB/s | 548 kB 00:00 2026-02-24T18:27:57.843 INFO:teuthology.orchestra.run.trial045.stdout:(4/7): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2026-02-24T18:27:57.867 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:27:57.870 INFO:teuthology.orchestra.run.trial045.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2026-02-24T18:27:57.926 INFO:teuthology.orchestra.run.trial045.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 1.0 MB/s | 86 kB 00:00 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:27:57.951 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:57.952 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 2.9 M 2026-02-24T18:27:57.952 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 11 M 2026-02-24T18:27:57.952 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:27:57.998 INFO:teuthology.orchestra.run.trial045.stdout:(7/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 364 kB/s | 173 kB 00:00 2026-02-24T18:27:57.998 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:57.999 INFO:teuthology.orchestra.run.trial045.stdout:Total 7.8 MB/s | 7.1 MB 00:00 2026-02-24T18:27:58.038 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:27:58.115 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:27:58.115 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:27:58.206 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:27:58.256 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:27:58.266 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:27:58.272 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:27:58.495 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:58.519 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:27:58.543 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:27:58.544 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:58.659 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:27:58.660 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:27:58.660 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:27:58.660 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:27:58.660 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:27:58.660 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:27:58.660 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:27:58.721 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:27:58.721 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:58.722 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:27:58.754 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-fuse 2026-02-24T18:27:59.079 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:54 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 942 k 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 2.7 M 2026-02-24T18:27:59.163 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:27:59.248 INFO:teuthology.orchestra.run.trial114.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 2.2 MB/s | 2.9 MB 00:01 2026-02-24T18:27:59.248 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:59.248 INFO:teuthology.orchestra.run.trial114.stdout:Total 2.2 MB/s | 2.9 MB 00:01 2026-02-24T18:27:59.248 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:27:59.254 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:27:59.254 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:27:59.292 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:27:59.292 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:27:59.472 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:27:59.473 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:59.497 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:59.497 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:59.497 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:27:59.497 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:27:59.497 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:27:59.497 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:59.823 INFO:teuthology.orchestra.run.trial045.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.4 MB/s | 942 kB 00:00 2026-02-24T18:27:59.824 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:59.824 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.4 MB/s | 942 kB 00:00 2026-02-24T18:27:59.825 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:27:59.829 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:27:59.829 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:27:59.844 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:27:59.844 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:59.844 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:27:59.844 INFO:teuthology.orchestra.run.trial114.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:59.844 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:27:59.844 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:27:59.862 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:27:59.862 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:27:59.871 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-nbd 2026-02-24T18:27:59.953 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:27:59.972 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:00.197 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:02:01 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:28:00.222 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:00.283 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:28:00.284 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:00.285 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 180 k 2026-02-24T18:28:00.285 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 498 k 2026-02-24T18:28:00.285 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:28:00.285 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:00.285 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:00.286 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:28:00.286 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:00.286 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:00.286 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:00.313 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-volume 2026-02-24T18:28:00.629 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:55 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:00.713 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:Install 2 Packages 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 648 k 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 2.2 M 2026-02-24T18:28:00.714 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:28:00.740 INFO:teuthology.orchestra.run.trial114.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 393 kB/s | 180 kB 00:00 2026-02-24T18:28:00.740 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:00.740 INFO:teuthology.orchestra.run.trial114.stdout:Total 393 kB/s | 180 kB 00:00 2026-02-24T18:28:00.740 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:28:00.745 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:28:00.745 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:28:00.776 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:28:00.777 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:28:00.832 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:28:00.849 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:00.937 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:01.003 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:01.004 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:01.004 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:28:01.004 INFO:teuthology.orchestra.run.trial114.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:01.004 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:01.004 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:28:01.033 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:28:01.355 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:02:02 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:28:01.440 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:28:01.440 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:28:01.440 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T18:28:01.440 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:28:01.440 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:28:01.440 INFO:teuthology.orchestra.run.trial114.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:28:01.440 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:01.441 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:28:01.441 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:28:01.441 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:28:01.441 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:01.441 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 107 M 2026-02-24T18:28:01.441 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 664 M 2026-02-24T18:28:01.441 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:28:01.483 INFO:teuthology.orchestra.run.trial045.stdout:(1/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 587 kB/s | 297 kB 00:00 2026-02-24T18:28:01.773 INFO:teuthology.orchestra.run.trial045.stdout:(2/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 440 kB/s | 351 kB 00:00 2026-02-24T18:28:01.775 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:01.775 INFO:teuthology.orchestra.run.trial045.stdout:Total 611 kB/s | 648 kB 00:01 2026-02-24T18:28:01.786 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:28:01.793 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:28:01.794 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:28:01.838 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:28:01.838 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:28:01.919 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:28:01.981 INFO:teuthology.orchestra.run.trial045.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:28:01.983 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:01.999 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:01.999 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:01.999 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:28:01.999 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:02.226 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:28:02.290 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:28:02.290 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:02.290 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:28:02.290 INFO:teuthology.orchestra.run.trial045.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:28:02.290 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:02.290 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:02.318 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados-devel 2026-02-24T18:28:02.643 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:57 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:02.728 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:02.729 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:02.730 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 126 k 2026-02-24T18:28:02.731 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 449 k 2026-02-24T18:28:02.731 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:28:03.269 INFO:teuthology.orchestra.run.trial045.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 233 kB/s | 126 kB 00:00 2026-02-24T18:28:03.270 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:03.270 INFO:teuthology.orchestra.run.trial045.stdout:Total 233 kB/s | 126 kB 00:00 2026-02-24T18:28:03.270 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:28:03.273 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:28:03.273 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:28:03.303 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:28:03.304 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:28:03.359 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:28:03.377 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:03.463 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:03.526 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:03.526 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:03.526 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:28:03.526 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:03.526 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:03.526 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:03.554 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install libcephfs2 2026-02-24T18:28:03.871 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:03.936 INFO:teuthology.orchestra.run.trial045.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:03.954 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:03.955 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T18:28:03.955 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:03.976 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install libcephfs-devel 2026-02-24T18:28:04.215 INFO:teuthology.orchestra.run.trial194.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 2.1 MB/s | 84 MB 00:40 2026-02-24T18:28:04.216 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:04.216 INFO:teuthology.orchestra.run.trial194.stdout:Total 2.1 MB/s | 85 MB 00:40 2026-02-24T18:28:04.240 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:28:04.250 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:28:04.250 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:28:04.298 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:59 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:04.383 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:04.384 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:04.384 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout:Install 2 Packages 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:04.385 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 58 k 2026-02-24T18:28:04.386 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 207 k 2026-02-24T18:28:04.386 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:28:04.539 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:28:04.539 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:28:04.730 INFO:teuthology.orchestra.run.trial045.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 99 kB/s | 34 kB 00:00 2026-02-24T18:28:04.734 INFO:teuthology.orchestra.run.trial045.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 69 kB/s | 24 kB 00:00 2026-02-24T18:28:04.735 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:04.735 INFO:teuthology.orchestra.run.trial045.stdout:Total 167 kB/s | 58 kB 00:00 2026-02-24T18:28:04.735 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:28:04.738 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:28:04.738 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:28:04.770 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:28:04.770 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:28:04.821 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:28:04.822 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:04.837 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:04.855 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:04.855 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:28:04.861 INFO:teuthology.orchestra.run.trial194.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:28:04.865 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:28:04.872 INFO:teuthology.orchestra.run.trial194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:28:04.873 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:28:04.913 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:04.913 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:04.975 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:04.975 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:04.975 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:28:04.975 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:04.975 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:04.975 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:04.975 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:05.001 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados2 2026-02-24T18:28:05.315 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:00 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:05.379 INFO:teuthology.orchestra.run.trial045.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:05.398 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:05.399 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T18:28:05.399 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:05.419 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librbd1 2026-02-24T18:28:05.739 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:00 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:05.805 INFO:teuthology.orchestra.run.trial045.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:05.824 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:05.825 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T18:28:05.825 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:05.846 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rados 2026-02-24T18:28:06.158 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:01 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:06.222 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:06.241 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:06.242 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T18:28:06.242 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:06.262 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rgw 2026-02-24T18:28:06.584 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:01 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:06.650 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:06.668 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:06.669 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T18:28:06.669 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:06.690 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-cephfs 2026-02-24T18:28:07.008 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:02 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:07.076 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:07.095 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:07.095 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T18:28:07.095 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:07.117 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rbd 2026-02-24T18:28:07.436 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:02 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:07.501 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:07.520 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:07.521 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T18:28:07.521 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:07.542 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-fuse 2026-02-24T18:28:07.854 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:02 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:07.940 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:07.940 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:07.940 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:07.940 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:07.940 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:28:07.941 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:28:07.941 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:07.941 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:28:07.941 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:07.941 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:28:07.941 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:07.941 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 91 k 2026-02-24T18:28:07.941 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 238 k 2026-02-24T18:28:07.941 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:28:08.367 INFO:teuthology.orchestra.run.trial045.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 214 kB/s | 91 kB 00:00 2026-02-24T18:28:08.368 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:08.368 INFO:teuthology.orchestra.run.trial045.stdout:Total 214 kB/s | 91 kB 00:00 2026-02-24T18:28:08.368 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:28:08.373 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:28:08.373 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:28:08.403 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:28:08.404 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:28:08.456 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:28:08.473 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:08.561 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:08.623 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:08.623 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:08.623 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:28:08.623 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:08.624 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:08.624 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:08.649 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-mirror 2026-02-24T18:28:08.709 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:28:08.728 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:28:08.967 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:09.048 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:28:09.049 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:28:09.049 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:28:09.049 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:28:09.049 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:28:09.051 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:09.052 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:09.052 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T18:28:09.052 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:09.052 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:28:09.052 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:28:09.052 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:09.052 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:28:09.053 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:09.053 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:28:09.053 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:09.053 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 2.9 M 2026-02-24T18:28:09.053 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 11 M 2026-02-24T18:28:09.053 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:28:09.108 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:28:09.108 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:09.108 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:28:09.108 INFO:teuthology.orchestra.run.trial194.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:09.108 INFO:teuthology.orchestra.run.trial194.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:09.108 INFO:teuthology.orchestra.run.trial194.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:28:09.108 INFO:teuthology.orchestra.run.trial194.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:28:09.109 INFO:teuthology.orchestra.run.trial194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:28:09.109 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:09.109 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:28:09.143 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph 2026-02-24T18:28:09.453 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:01:10 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:28:09.537 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:28:09.538 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:09.538 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-24T18:28:09.538 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:09.538 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:28:09.538 INFO:teuthology.orchestra.run.trial194.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:28:09.538 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:28:09.538 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:28:09.538 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:28:09.539 INFO:teuthology.orchestra.run.trial194.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:28:09.540 INFO:teuthology.orchestra.run.trial194.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:28:09.540 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:09.540 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:28:09.540 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:09.540 INFO:teuthology.orchestra.run.trial194.stdout:Install 40 Packages 2026-02-24T18:28:09.540 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:09.540 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 30 M 2026-02-24T18:28:09.540 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 100 M 2026-02-24T18:28:09.540 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:28:10.391 INFO:teuthology.orchestra.run.trial194.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 23 kB/s | 6.5 kB 00:00 2026-02-24T18:28:11.756 INFO:teuthology.orchestra.run.trial194.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 586 kB/s | 961 kB 00:01 2026-02-24T18:28:12.503 INFO:teuthology.orchestra.run.trial194.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.0 MB/s | 2.3 MB 00:02 2026-02-24T18:28:12.713 INFO:teuthology.orchestra.run.trial194.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 1.3 MB/s | 290 kB 00:00 2026-02-24T18:28:12.725 INFO:teuthology.orchestra.run.trial045.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 812 kB/s | 2.9 MB 00:03 2026-02-24T18:28:12.726 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:12.726 INFO:teuthology.orchestra.run.trial045.stdout:Total 812 kB/s | 2.9 MB 00:03 2026-02-24T18:28:12.726 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:28:12.731 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:28:12.731 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:28:12.770 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:28:12.771 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:28:12.956 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:28:12.958 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:12.979 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:12.980 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:12.980 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:28:12.980 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:12.980 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:12.980 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:13.139 INFO:teuthology.orchestra.run.trial194.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 95 kB/s | 40 kB 00:00 2026-02-24T18:28:13.283 INFO:teuthology.orchestra.run.trial194.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 499 kB/s | 72 kB 00:00 2026-02-24T18:28:13.304 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:13.304 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:13.304 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:28:13.304 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:13.304 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:13.304 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:13.331 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-nbd 2026-02-24T18:28:13.656 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:08 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:13.740 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:13.740 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:13.740 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:13.740 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:13.740 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:28:13.740 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:28:13.741 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:13.741 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:28:13.741 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:13.741 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:28:13.741 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:13.741 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 180 k 2026-02-24T18:28:13.741 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 498 k 2026-02-24T18:28:13.741 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:28:14.333 INFO:teuthology.orchestra.run.trial045.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 303 kB/s | 180 kB 00:00 2026-02-24T18:28:14.333 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:14.333 INFO:teuthology.orchestra.run.trial045.stdout:Total 303 kB/s | 180 kB 00:00 2026-02-24T18:28:14.333 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:28:14.338 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:28:14.338 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:28:14.369 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:28:14.369 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:28:14.425 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:28:14.442 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:14.447 INFO:teuthology.orchestra.run.trial194.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 218 kB/s | 253 kB 00:01 2026-02-24T18:28:14.532 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:14.594 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:14.594 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:14.594 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:28:14.595 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:14.595 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:14.595 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:28:14.622 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:28:14.941 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:09 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:15.027 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 107 M 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 664 M 2026-02-24T18:28:15.028 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:28:16.540 INFO:teuthology.orchestra.run.trial114.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 7.1 MB/s | 107 MB 00:15 2026-02-24T18:28:16.540 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:16.541 INFO:teuthology.orchestra.run.trial114.stdout:Total 7.1 MB/s | 107 MB 00:15 2026-02-24T18:28:16.541 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:28:16.543 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:28:16.543 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:28:16.563 INFO:teuthology.orchestra.run.trial194.stdout:(8/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_6 843 kB/s | 5.1 MB 00:06 2026-02-24T18:28:16.881 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:28:16.881 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:28:17.191 INFO:teuthology.orchestra.run.trial194.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 170 kB/s | 106 kB 00:00 2026-02-24T18:28:17.432 INFO:teuthology.orchestra.run.trial194.stdout:(10/40): python3-cryptography-36.0.1-5.el9.x86_ 427 kB/s | 1.2 MB 00:02 2026-02-24T18:28:17.528 INFO:teuthology.orchestra.run.trial194.stdout:(11/40): python3-pycparser-2.20-6.el9.noarch.rp 401 kB/s | 135 kB 00:00 2026-02-24T18:28:18.151 INFO:teuthology.orchestra.run.trial194.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 203 kB/s | 126 kB 00:00 2026-02-24T18:28:18.302 INFO:teuthology.orchestra.run.trial194.stdout:(13/40): python3-pyparsing-2.4.7-9.el9.noarch.r 173 kB/s | 150 kB 00:00 2026-02-24T18:28:18.859 INFO:teuthology.orchestra.run.trial194.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 326 kB/s | 182 kB 00:00 2026-02-24T18:28:18.977 INFO:teuthology.orchestra.run.trial194.stdout:(15/40): python3-urllib3-1.26.5-7.el9.noarch.rp 264 kB/s | 218 kB 00:00 2026-02-24T18:28:19.067 INFO:teuthology.orchestra.run.trial194.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.7 MB/s | 246 kB 00:00 2026-02-24T18:28:19.092 INFO:teuthology.orchestra.run.trial194.stdout:(17/40): lua-5.4.4-4.el9.x86_64.rpm 7.4 MB/s | 188 kB 00:00 2026-02-24T18:28:19.116 INFO:teuthology.orchestra.run.trial194.stdout:(18/40): python3-libstoragemgmt-1.10.1-1.el9.x8 7.2 MB/s | 177 kB 00:00 2026-02-24T18:28:19.140 INFO:teuthology.orchestra.run.trial194.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-24T18:28:19.162 INFO:teuthology.orchestra.run.trial194.stdout:(20/40): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-24T18:28:19.188 INFO:teuthology.orchestra.run.trial194.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 861 kB/s | 22 kB 00:00 2026-02-24T18:28:19.465 INFO:teuthology.orchestra.run.trial194.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 546 kB/s | 151 kB 00:00 2026-02-24T18:28:19.511 INFO:teuthology.orchestra.run.trial194.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 637 kB/s | 29 kB 00:00 2026-02-24T18:28:19.563 INFO:teuthology.orchestra.run.trial194.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 1.1 MB/s | 60 kB 00:00 2026-02-24T18:28:19.612 INFO:teuthology.orchestra.run.trial194.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 887 kB/s | 43 kB 00:00 2026-02-24T18:28:19.685 INFO:teuthology.orchestra.run.trial194.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 2.3 MB/s | 173 kB 00:00 2026-02-24T18:28:19.740 INFO:teuthology.orchestra.run.trial194.stdout:(27/40): zip-3.0-35.el9.x86_64.rpm 302 kB/s | 266 kB 00:00 2026-02-24T18:28:19.778 INFO:teuthology.orchestra.run.trial194.stdout:(28/40): python3-cherrypy-18.6.1-2.el9.noarch.r 3.8 MB/s | 358 kB 00:00 2026-02-24T18:28:19.820 INFO:teuthology.orchestra.run.trial194.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 425 kB/s | 18 kB 00:00 2026-02-24T18:28:19.861 INFO:teuthology.orchestra.run.trial194.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 557 kB/s | 23 kB 00:00 2026-02-24T18:28:19.870 INFO:teuthology.orchestra.run.trial194.stdout:(31/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 82 kB/s | 11 kB 00:00 2026-02-24T18:28:19.903 INFO:teuthology.orchestra.run.trial194.stdout:(32/40): python3-jaraco-context-6.0.1-3.el9.noa 472 kB/s | 20 kB 00:00 2026-02-24T18:28:19.928 INFO:teuthology.orchestra.run.trial194.stdout:(33/40): python3-jaraco-functools-3.5.0-2.el9.n 342 kB/s | 19 kB 00:00 2026-02-24T18:28:19.944 INFO:teuthology.orchestra.run.trial194.stdout:(34/40): python3-jaraco-text-4.0.0-2.el9.noarch 635 kB/s | 26 kB 00:00 2026-02-24T18:28:19.986 INFO:teuthology.orchestra.run.trial194.stdout:(35/40): python3-portend-3.1.0-2.el9.noarch.rpm 395 kB/s | 16 kB 00:00 2026-02-24T18:28:20.031 INFO:teuthology.orchestra.run.trial194.stdout:(36/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.0 MB/s | 90 kB 00:00 2026-02-24T18:28:20.042 INFO:teuthology.orchestra.run.trial194.stdout:(37/40): python3-more-itertools-8.12.0-2.el9.no 690 kB/s | 79 kB 00:00 2026-02-24T18:28:20.074 INFO:teuthology.orchestra.run.trial194.stdout:(38/40): python3-tempora-5.0.0-2.el9.noarch.rpm 838 kB/s | 36 kB 00:00 2026-02-24T18:28:20.090 INFO:teuthology.orchestra.run.trial194.stdout:(39/40): python3-zc-lockfile-2.0-10.el9.noarch. 420 kB/s | 20 kB 00:00 2026-02-24T18:28:22.869 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:28:22.888 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:28:23.401 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:28:23.464 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:28:23.464 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:23.464 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:28:23.465 INFO:teuthology.orchestra.run.trial114.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:23.465 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:23.465 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:28:23.502 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:28:23.829 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:02:24 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:28:23.915 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 586 M 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 3.4 G 2026-02-24T18:28:23.916 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:28:29.984 INFO:teuthology.orchestra.run.trial194.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 954 kB/s | 17 MB 00:18 2026-02-24T18:28:29.986 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:29.986 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.5 MB/s | 30 MB 00:20 2026-02-24T18:28:30.123 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:28:30.141 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:28:30.141 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:28:30.287 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:28:30.287 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:28:30.468 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:28:30.470 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:28:30.475 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:28:30.479 INFO:teuthology.orchestra.run.trial194.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:28:30.481 INFO:teuthology.orchestra.run.trial194.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:28:30.487 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:28:30.511 INFO:teuthology.orchestra.run.trial194.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:28:30.515 INFO:teuthology.orchestra.run.trial194.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:28:30.519 INFO:teuthology.orchestra.run.trial194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:28:30.524 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:28:30.530 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:28:30.534 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:28:30.540 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:28:30.545 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:28:30.548 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:28:30.554 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:28:30.558 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:28:30.565 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:28:30.568 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:28:30.590 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:28:30.603 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:28:30.608 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:28:30.618 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:28:30.624 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:28:30.637 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:28:30.653 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:28:30.727 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:28:30.735 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:28:30.758 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:28:30.787 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:28:30.793 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:28:30.839 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:28:30.882 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:28:30.883 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:28:30.907 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:28:30.907 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:30.907 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:28:30.907 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:28:30.907 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:28:30.908 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:30.912 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:28:30.929 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:28:30.929 INFO:teuthology.orchestra.run.trial194.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:28:30.930 INFO:teuthology.orchestra.run.trial194.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:28:30.930 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:30.938 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:28:30.961 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:28:30.962 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:28:30.962 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:31.646 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:28:31.647 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:28:31.673 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:28:31.674 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:31.674 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:28:31.674 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:28:31.674 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:28:31.674 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:31.889 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:28:31.911 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:28:31.911 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:31.911 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:28:31.911 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:28:31.911 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:28:31.911 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:32.008 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:28:32.029 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:28:32.030 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:32.030 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:28:32.030 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:28:32.030 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:28:32.030 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:32.047 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:28:32.374 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:28:32.375 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:28:32.375 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:28:32.375 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:28:32.375 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:28:32.375 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:28:32.375 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:28:32.375 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:28:32.375 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:28:32.376 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:28:32.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:28:32.378 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:28:32.378 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:28:32.378 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:28:32.378 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:28:32.378 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:28:32.378 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:28:32.378 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:28:32.378 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:28:32.378 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:28:32.436 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:28:32.436 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:32.436 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:28:32.436 INFO:teuthology.orchestra.run.trial194.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:32.436 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:32.436 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:28:32.437 INFO:teuthology.orchestra.run.trial194.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:28:32.438 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:28:32.439 INFO:teuthology.orchestra.run.trial194.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:28:32.440 INFO:teuthology.orchestra.run.trial194.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:28:32.440 INFO:teuthology.orchestra.run.trial194.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:28:32.440 INFO:teuthology.orchestra.run.trial194.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:28:32.440 INFO:teuthology.orchestra.run.trial194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:28:32.440 INFO:teuthology.orchestra.run.trial194.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:28:32.440 INFO:teuthology.orchestra.run.trial194.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:28:32.440 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:32.440 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:28:32.472 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-base 2026-02-24T18:28:32.786 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:01:33 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:28:32.851 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:32.869 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:28:32.869 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T18:28:32.869 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:28:32.891 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install cephadm 2026-02-24T18:28:33.203 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:28:33.285 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:28:33.286 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:33.286 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-24T18:28:33.286 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:33.286 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:28:33.286 INFO:teuthology.orchestra.run.trial194.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:28:33.286 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:33.287 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:28:33.287 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:33.287 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:28:33.287 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:33.287 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 1.0 M 2026-02-24T18:28:33.287 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 1.0 M 2026-02-24T18:28:33.287 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:28:34.746 INFO:teuthology.orchestra.run.trial194.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 700 kB/s | 1.0 MB 00:01 2026-02-24T18:28:34.747 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:34.747 INFO:teuthology.orchestra.run.trial194.stdout:Total 699 kB/s | 1.0 MB 00:01 2026-02-24T18:28:34.747 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:28:34.750 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:28:34.750 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:28:34.754 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:28:34.754 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:28:34.774 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:28:34.840 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:28:34.856 INFO:teuthology.orchestra.run.trial194.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:28:34.930 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:28:34.989 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:28:34.989 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:34.990 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:28:34.990 INFO:teuthology.orchestra.run.trial194.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:34.990 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:34.990 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:28:35.017 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:28:35.335 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:01:36 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:28:35.421 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:28:35.422 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:35.423 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 154 k 2026-02-24T18:28:35.423 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 447 k 2026-02-24T18:28:35.423 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:28:35.976 INFO:teuthology.orchestra.run.trial194.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 278 kB/s | 154 kB 00:00 2026-02-24T18:28:35.976 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:35.976 INFO:teuthology.orchestra.run.trial194.stdout:Total 277 kB/s | 154 kB 00:00 2026-02-24T18:28:35.977 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:28:35.981 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:28:35.981 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:28:36.008 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:28:36.008 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:28:36.059 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:28:36.060 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:28:36.084 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:28:36.084 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:36.084 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:28:36.084 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:36.404 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:28:36.404 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:36.404 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:28:36.404 INFO:teuthology.orchestra.run.trial194.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:36.404 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:36.405 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:28:36.432 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr 2026-02-24T18:28:36.747 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:01:37 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:28:36.813 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:36.831 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:28:36.831 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T18:28:36.831 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:28:36.852 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:28:37.165 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:01:38 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:28:37.249 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:28:37.250 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:37.250 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-24T18:28:37.250 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:37.250 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:28:37.250 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:28:37.250 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:28:37.250 INFO:teuthology.orchestra.run.trial194.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:28:37.250 INFO:teuthology.orchestra.run.trial194.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:28:37.250 INFO:teuthology.orchestra.run.trial194.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:28:37.251 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:37.252 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:28:37.252 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:37.252 INFO:teuthology.orchestra.run.trial194.stdout:Install 14 Packages 2026-02-24T18:28:37.252 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:37.252 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 16 M 2026-02-24T18:28:37.252 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 158 M 2026-02-24T18:28:37.252 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:28:37.808 INFO:teuthology.orchestra.run.trial194.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 48 kB/s | 17 kB 00:00 2026-02-24T18:28:37.866 INFO:teuthology.orchestra.run.trial194.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 102 kB/s | 43 kB 00:00 2026-02-24T18:28:37.966 INFO:teuthology.orchestra.run.trial194.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 478 kB/s | 48 kB 00:00 2026-02-24T18:28:38.014 INFO:teuthology.orchestra.run.trial194.stdout:(4/14): protobuf-3.14.0-17.el9.x86_64.rpm 4.9 MB/s | 1.0 MB 00:00 2026-02-24T18:28:38.054 INFO:teuthology.orchestra.run.trial194.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 3.0 MB/s | 267 kB 00:00 2026-02-24T18:28:38.120 INFO:teuthology.orchestra.run.trial194.stdout:(6/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 8.2 MB/s | 551 kB 00:00 2026-02-24T18:28:38.129 INFO:teuthology.orchestra.run.trial194.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 2.1 MB/s | 19 kB 00:00 2026-02-24T18:28:38.145 INFO:teuthology.orchestra.run.trial194.stdout:(8/14): protobuf-compiler-3.14.0-17.el9.x86_64. 6.4 MB/s | 862 kB 00:00 2026-02-24T18:28:38.158 INFO:teuthology.orchestra.run.trial194.stdout:(9/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 70 MB/s | 2.0 MB 00:00 2026-02-24T18:28:38.169 INFO:teuthology.orchestra.run.trial194.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 2.7 MB/s | 31 kB 00:00 2026-02-24T18:28:38.182 INFO:teuthology.orchestra.run.trial194.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 15 MB/s | 188 kB 00:00 2026-02-24T18:28:38.185 INFO:teuthology.orchestra.run.trial194.stdout:(12/14): python3-grpcio-tools-1.46.7-10.el9.x86 3.5 MB/s | 144 kB 00:00 2026-02-24T18:28:38.190 INFO:teuthology.orchestra.run.trial194.stdout:(13/14): python3-xmltodict-0.12.0-15.el9.noarch 2.6 MB/s | 22 kB 00:00 2026-02-24T18:28:47.909 INFO:teuthology.orchestra.run.trial194.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 1.0 MB/s | 11 MB 00:10 2026-02-24T18:28:47.911 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:47.911 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.5 MB/s | 16 MB 00:10 2026-02-24T18:28:47.947 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:28:47.957 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:28:47.957 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:28:48.052 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:28:48.052 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:28:48.170 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:28:48.177 INFO:teuthology.orchestra.run.trial194.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:28:48.181 INFO:teuthology.orchestra.run.trial194.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:28:48.186 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:28:48.197 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:28:48.199 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:28:48.227 INFO:teuthology.orchestra.run.trial194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:28:48.270 INFO:teuthology.orchestra.run.trial194.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:28:48.299 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:28:48.309 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:28:48.315 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:28:48.319 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:28:48.325 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:28:49.487 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:28:49.492 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:28:49.689 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:28:49.751 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:28:49.751 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:49.751 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:28:49.751 INFO:teuthology.orchestra.run.trial194.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:28:49.751 INFO:teuthology.orchestra.run.trial194.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:28:49.752 INFO:teuthology.orchestra.run.trial194.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:28:49.753 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:49.753 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:28:49.785 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:28:50.106 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:01:51 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:28:50.191 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:28:50.192 INFO:teuthology.orchestra.run.trial194.stdout:====================================================================================== 2026-02-24T18:28:50.192 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-24T18:28:50.192 INFO:teuthology.orchestra.run.trial194.stdout:====================================================================================== 2026-02-24T18:28:50.192 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:28:50.192 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:28:50.193 INFO:teuthology.orchestra.run.trial194.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:28:50.194 INFO:teuthology.orchestra.run.trial194.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:28:50.194 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:50.194 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:28:50.194 INFO:teuthology.orchestra.run.trial194.stdout:====================================================================================== 2026-02-24T18:28:50.194 INFO:teuthology.orchestra.run.trial194.stdout:Install 12 Packages 2026-02-24T18:28:50.194 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:50.194 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 43 M 2026-02-24T18:28:50.194 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 234 M 2026-02-24T18:28:50.194 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:28:51.443 INFO:teuthology.orchestra.run.trial194.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 167 kB/s | 184 kB 00:01 2026-02-24T18:28:51.526 INFO:teuthology.orchestra.run.trial194.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 668 kB/s | 794 kB 00:01 2026-02-24T18:28:51.702 INFO:teuthology.orchestra.run.trial194.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 115 kB/s | 30 kB 00:00 2026-02-24T18:28:51.802 INFO:teuthology.orchestra.run.trial194.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 147 kB/s | 15 kB 00:00 2026-02-24T18:28:51.950 INFO:teuthology.orchestra.run.trial194.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 286 kB/s | 42 kB 00:00 2026-02-24T18:28:52.303 INFO:teuthology.orchestra.run.trial194.stdout:(6/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 3.8 MB/s | 3.0 MB 00:00 2026-02-24T18:28:52.385 INFO:teuthology.orchestra.run.trial194.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2026-02-24T18:28:52.575 INFO:teuthology.orchestra.run.trial194.stdout:(8/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 8.5 MB/s | 5.3 MB 00:00 2026-02-24T18:28:52.608 INFO:teuthology.orchestra.run.trial194.stdout:(9/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 28 MB/s | 6.1 MB 00:00 2026-02-24T18:28:52.658 INFO:teuthology.orchestra.run.trial194.stdout:(10/12): python3-numpy-f2py-1.23.5-2.el9.x86_64 5.2 MB/s | 442 kB 00:00 2026-02-24T18:28:53.197 INFO:teuthology.orchestra.run.trial194.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 33 MB/s | 19 MB 00:00 2026-02-24T18:28:56.607 INFO:teuthology.orchestra.run.trial194.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.2 MB/s | 7.4 MB 00:06 2026-02-24T18:28:56.609 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:56.609 INFO:teuthology.orchestra.run.trial194.stdout:Total 6.7 MB/s | 43 MB 00:06 2026-02-24T18:28:56.773 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:28:56.786 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:28:56.786 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:28:56.988 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:28:56.989 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:28:57.204 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:28:57.207 INFO:teuthology.orchestra.run.trial194.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:28:57.213 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:28:57.247 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:28:57.252 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:28:57.311 INFO:teuthology.orchestra.run.trial194.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:28:57.313 INFO:teuthology.orchestra.run.trial194.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:28:57.334 INFO:teuthology.orchestra.run.trial194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:28:57.658 INFO:teuthology.orchestra.run.trial194.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:28:57.730 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:28:58.400 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:28:58.856 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:28:58.857 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:28:59.168 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:28:59.168 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:28:59.168 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:28:59.169 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:28:59.169 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:28:59.169 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:28:59.169 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:28:59.169 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:28:59.169 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:28:59.169 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:28:59.169 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:28:59.169 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:28:59.231 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:28:59.232 INFO:teuthology.orchestra.run.trial194.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:28:59.233 INFO:teuthology.orchestra.run.trial194.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:28:59.233 INFO:teuthology.orchestra.run.trial194.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:28:59.233 INFO:teuthology.orchestra.run.trial194.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:28:59.233 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:59.233 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:28:59.270 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:28:59.593 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:00 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:28:59.676 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:28:59.677 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:59.677 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-24T18:28:59.677 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:59.677 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:28:59.678 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:59.679 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:28:59.679 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:28:59.679 INFO:teuthology.orchestra.run.trial194.stdout:Install 10 Packages 2026-02-24T18:28:59.679 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:28:59.679 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 2.0 M 2026-02-24T18:28:59.679 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 25 M 2026-02-24T18:28:59.679 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:00.272 INFO:teuthology.orchestra.run.trial194.stdout:(1/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 121 kB/s | 50 kB 00:00 2026-02-24T18:29:00.500 INFO:teuthology.orchestra.run.trial194.stdout:(2/10): python3-pyasn1-modules-0.4.8-7.el9.noar 431 kB/s | 277 kB 00:00 2026-02-24T18:29:00.720 INFO:teuthology.orchestra.run.trial194.stdout:(3/10): python3-cachetools-4.2.4-1.el9.noarch.r 147 kB/s | 32 kB 00:00 2026-02-24T18:29:00.739 INFO:teuthology.orchestra.run.trial194.stdout:(4/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 178 kB/s | 157 kB 00:00 2026-02-24T18:29:00.749 INFO:teuthology.orchestra.run.trial194.stdout:(5/10): python3-requests-oauthlib-1.3.0-12.el9. 112 kB/s | 54 kB 00:00 2026-02-24T18:29:00.799 INFO:teuthology.orchestra.run.trial194.stdout:(6/10): python3-certifi-2023.05.07-4.el9.noarch 179 kB/s | 14 kB 00:00 2026-02-24T18:29:00.938 INFO:teuthology.orchestra.run.trial194.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 425 kB/s | 59 kB 00:00 2026-02-24T18:29:01.040 INFO:teuthology.orchestra.run.trial194.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 877 kB/s | 90 kB 00:00 2026-02-24T18:29:01.255 INFO:teuthology.orchestra.run.trial194.stdout:(9/10): python3-google-auth-2.45.0-1.el9.noarch 493 kB/s | 254 kB 00:00 2026-02-24T18:29:01.269 INFO:teuthology.orchestra.run.trial194.stdout:(10/10): python3-kubernetes-26.1.0-3.el9.noarch 2.0 MB/s | 1.0 MB 00:00 2026-02-24T18:29:01.270 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:01.270 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.2 MB/s | 2.0 MB 00:01 2026-02-24T18:29:01.294 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:29:01.301 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:29:01.301 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:29:01.341 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:29:01.342 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:29:01.417 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:29:01.468 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:29:01.480 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:29:01.495 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:29:01.500 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:29:01.507 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:29:01.547 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:29:01.559 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:29:01.878 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:29:01.893 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:29:01.894 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:29:02.012 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:29:02.012 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:29:02.012 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:29:02.012 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:29:02.012 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:29:02.012 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:29:02.013 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:29:02.013 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:29:02.013 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:29:02.013 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:29:02.074 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:29:02.074 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:02.074 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:29:02.074 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:29:02.074 INFO:teuthology.orchestra.run.trial194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:29:02.074 INFO:teuthology.orchestra.run.trial194.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:29:02.074 INFO:teuthology.orchestra.run.trial194.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:29:02.074 INFO:teuthology.orchestra.run.trial194.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:29:02.075 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:29:02.075 INFO:teuthology.orchestra.run.trial194.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:29:02.075 INFO:teuthology.orchestra.run.trial194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:29:02.075 INFO:teuthology.orchestra.run.trial194.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:29:02.075 INFO:teuthology.orchestra.run.trial194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:29:02.075 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:02.075 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:02.106 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:29:02.427 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:02.512 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:02.513 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:29:02.514 INFO:teuthology.orchestra.run.trial194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:29:02.515 INFO:teuthology.orchestra.run.trial194.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:29:02.515 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:02.515 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:29:02.515 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:02.515 INFO:teuthology.orchestra.run.trial194.stdout:Install 7 Packages 2026-02-24T18:29:02.515 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:02.515 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 7.1 M 2026-02-24T18:29:02.515 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 33 M 2026-02-24T18:29:02.515 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:03.224 INFO:teuthology.orchestra.run.trial194.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 491 kB/s | 249 kB 00:00 2026-02-24T18:29:03.287 INFO:teuthology.orchestra.run.trial194.stdout:(2/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 304 kB/s | 173 kB 00:00 2026-02-24T18:29:03.309 INFO:teuthology.orchestra.run.trial194.stdout:(3/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 404 kB/s | 35 kB 00:00 2026-02-24T18:29:03.570 INFO:teuthology.orchestra.run.trial194.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 222 kB/s | 58 kB 00:00 2026-02-24T18:29:03.579 INFO:teuthology.orchestra.run.trial194.stdout:(5/7): python3-babel-2.9.1-2.el9.noarch.rpm 6.9 MB/s | 6.0 MB 00:00 2026-02-24T18:29:03.704 INFO:teuthology.orchestra.run.trial194.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 647 kB/s | 86 kB 00:00 2026-02-24T18:29:03.748 INFO:teuthology.orchestra.run.trial194.stdout:(7/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.2 MB/s | 548 kB 00:00 2026-02-24T18:29:03.748 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:03.748 INFO:teuthology.orchestra.run.trial194.stdout:Total 5.7 MB/s | 7.1 MB 00:01 2026-02-24T18:29:03.788 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:29:03.795 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:29:03.796 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:29:03.868 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:29:03.869 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:29:03.959 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:29:04.008 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:29:04.017 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:29:04.023 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:29:04.244 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:29:04.268 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:29:04.291 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:29:04.293 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:29:04.408 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:29:04.408 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:29:04.408 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:29:04.409 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:29:04.409 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:29:04.409 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:29:04.409 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:29:04.470 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:29:04.470 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:04.470 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:29:04.470 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:29:04.470 INFO:teuthology.orchestra.run.trial194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:29:04.470 INFO:teuthology.orchestra.run.trial194.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:29:04.471 INFO:teuthology.orchestra.run.trial194.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:29:04.471 INFO:teuthology.orchestra.run.trial194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:29:04.471 INFO:teuthology.orchestra.run.trial194.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:29:04.471 INFO:teuthology.orchestra.run.trial194.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:29:04.471 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:04.471 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:04.501 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-fuse 2026-02-24T18:29:04.819 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:05 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout: Package Architecture Version Repository Size 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 942 k 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 2.7 M 2026-02-24T18:29:04.904 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:05.860 INFO:teuthology.orchestra.run.trial194.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 986 kB/s | 942 kB 00:00 2026-02-24T18:29:05.861 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:05.861 INFO:teuthology.orchestra.run.trial194.stdout:Total 985 kB/s | 942 kB 00:00 2026-02-24T18:29:05.861 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:29:05.866 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:29:05.866 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:29:05.899 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:29:05.899 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:29:05.987 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:29:06.005 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:06.207 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:06.269 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:06.269 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:06.269 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:29:06.269 INFO:teuthology.orchestra.run.trial194.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:06.269 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:06.269 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:06.296 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-volume 2026-02-24T18:29:06.613 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:07 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:06.699 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:06.699 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:06.699 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repository Size 2026-02-24T18:29:06.699 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout:Install 2 Packages 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 648 k 2026-02-24T18:29:06.700 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 2.2 M 2026-02-24T18:29:06.701 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:07.007 INFO:teuthology.orchestra.run.trial194.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 6.1 MB/s | 351 kB 00:00 2026-02-24T18:29:07.599 INFO:teuthology.orchestra.run.trial194.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 458 kB/s | 297 kB 00:00 2026-02-24T18:29:07.599 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:07.600 INFO:teuthology.orchestra.run.trial194.stdout:Total 720 kB/s | 648 kB 00:00 2026-02-24T18:29:07.611 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:29:07.618 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:29:07.618 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:29:07.662 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:29:07.662 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:29:07.743 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:29:07.806 INFO:teuthology.orchestra.run.trial194.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:29:07.808 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:29:07.823 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:29:07.823 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:29:07.823 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:29:07.823 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:08.053 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:29:08.116 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:29:08.116 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:08.116 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:29:08.116 INFO:teuthology.orchestra.run.trial194.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:29:08.116 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:08.116 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:08.145 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install librados-devel 2026-02-24T18:29:08.464 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:09 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:08.549 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:08.549 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:08.549 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T18:29:08.549 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:08.549 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:29:08.549 INFO:teuthology.orchestra.run.trial194.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:29:08.549 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:08.549 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:29:08.550 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:08.550 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:29:08.550 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:08.550 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 126 k 2026-02-24T18:29:08.550 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 449 k 2026-02-24T18:29:08.550 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:09.044 INFO:teuthology.orchestra.run.trial194.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 255 kB/s | 126 kB 00:00 2026-02-24T18:29:09.044 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:09.044 INFO:teuthology.orchestra.run.trial194.stdout:Total 255 kB/s | 126 kB 00:00 2026-02-24T18:29:09.044 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:29:09.047 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:29:09.047 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:29:09.077 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:29:09.078 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:29:09.133 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:29:09.150 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:09.236 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:09.298 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:09.298 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:09.298 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:29:09.298 INFO:teuthology.orchestra.run.trial194.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:09.299 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:09.299 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:09.326 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install libcephfs2 2026-02-24T18:29:09.648 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:10 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:09.715 INFO:teuthology.orchestra.run.trial194.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:29:09.734 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:09.734 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T18:29:09.734 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:09.755 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install libcephfs-devel 2026-02-24T18:29:10.070 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:11 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:10.155 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout:Installing dependencies: 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:29:10.156 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:10.157 INFO:teuthology.orchestra.run.trial194.stdout:Install 2 Packages 2026-02-24T18:29:10.157 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:10.157 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 58 k 2026-02-24T18:29:10.157 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 207 k 2026-02-24T18:29:10.157 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:10.495 INFO:teuthology.orchestra.run.trial194.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 101 kB/s | 34 kB 00:00 2026-02-24T18:29:10.505 INFO:teuthology.orchestra.run.trial194.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 69 kB/s | 24 kB 00:00 2026-02-24T18:29:10.506 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:10.506 INFO:teuthology.orchestra.run.trial194.stdout:Total 167 kB/s | 58 kB 00:00 2026-02-24T18:29:10.506 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:29:10.509 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:29:10.509 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:29:10.541 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:29:10.541 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:29:10.589 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:29:10.590 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:29:10.603 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:29:10.620 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:29:10.678 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:29:10.678 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:29:10.739 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:29:10.739 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:10.739 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:29:10.740 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:10.740 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:10.740 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:10.740 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:10.766 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install librados2 2026-02-24T18:29:11.083 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:12 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:11.149 INFO:teuthology.orchestra.run.trial194.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:29:11.167 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:11.168 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T18:29:11.168 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:11.189 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install librbd1 2026-02-24T18:29:11.509 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:12 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:11.575 INFO:teuthology.orchestra.run.trial194.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:29:11.594 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:11.594 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T18:29:11.594 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:11.615 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-rados 2026-02-24T18:29:11.931 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:12 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:11.997 INFO:teuthology.orchestra.run.trial194.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:29:12.016 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:12.017 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T18:29:12.017 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:12.038 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-rgw 2026-02-24T18:29:12.351 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:13 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:12.418 INFO:teuthology.orchestra.run.trial194.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:29:12.437 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:12.437 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T18:29:12.437 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:12.458 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-cephfs 2026-02-24T18:29:12.774 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:13 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:12.841 INFO:teuthology.orchestra.run.trial194.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:29:12.859 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:12.860 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T18:29:12.860 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:12.881 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-rbd 2026-02-24T18:29:13.197 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:14 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:13.262 INFO:teuthology.orchestra.run.trial194.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:29:13.281 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:13.281 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T18:29:13.281 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:13.303 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install rbd-fuse 2026-02-24T18:29:13.619 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:14 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:13.704 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:13.704 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout: Package Architecture Version Repository Size 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 91 k 2026-02-24T18:29:13.705 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 238 k 2026-02-24T18:29:13.706 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:14.126 INFO:teuthology.orchestra.run.trial194.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 216 kB/s | 91 kB 00:00 2026-02-24T18:29:14.127 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:14.127 INFO:teuthology.orchestra.run.trial194.stdout:Total 216 kB/s | 91 kB 00:00 2026-02-24T18:29:14.127 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:29:14.131 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:29:14.131 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:29:14.162 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:29:14.162 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:29:14.213 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:29:14.230 INFO:teuthology.orchestra.run.trial194.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:14.316 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:14.379 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:14.380 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:14.380 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:29:14.380 INFO:teuthology.orchestra.run.trial194.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:14.380 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:14.380 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:14.408 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install rbd-mirror 2026-02-24T18:29:14.723 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:15 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:14.807 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:14.808 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:14.808 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 2.9 M 2026-02-24T18:29:14.809 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 11 M 2026-02-24T18:29:14.810 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:16.630 INFO:teuthology.orchestra.run.trial194.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.6 MB/s | 2.9 MB 00:01 2026-02-24T18:29:16.630 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:16.630 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.6 MB/s | 2.9 MB 00:01 2026-02-24T18:29:16.630 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:29:16.635 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:29:16.635 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:29:16.673 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:29:16.674 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:29:16.853 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:29:16.854 INFO:teuthology.orchestra.run.trial194.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:16.877 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:16.877 INFO:teuthology.orchestra.run.trial194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:29:16.877 INFO:teuthology.orchestra.run.trial194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:29:16.877 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:29:16.877 INFO:teuthology.orchestra.run.trial194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:29:16.877 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:17.209 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:17.209 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:17.209 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:29:17.209 INFO:teuthology.orchestra.run.trial194.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:17.209 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:17.209 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:17.237 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install rbd-nbd 2026-02-24T18:29:17.557 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:18 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout: Package Architecture Version Repository Size 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 180 k 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 498 k 2026-02-24T18:29:17.642 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:18.105 INFO:teuthology.orchestra.run.trial194.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 388 kB/s | 180 kB 00:00 2026-02-24T18:29:18.106 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:18.106 INFO:teuthology.orchestra.run.trial194.stdout:Total 388 kB/s | 180 kB 00:00 2026-02-24T18:29:18.106 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:29:18.111 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:29:18.111 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:29:18.141 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:29:18.142 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:29:18.198 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:29:18.215 INFO:teuthology.orchestra.run.trial194.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:18.298 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:18.360 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:29:18.361 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:18.361 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:29:18.361 INFO:teuthology.orchestra.run.trial194.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:18.361 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:18.361 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:29:18.390 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:29:18.712 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:02:19 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:29:18.797 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:29:18.798 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:18.798 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T18:29:18.798 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:18.798 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:29:18.799 INFO:teuthology.orchestra.run.trial194.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:29:18.799 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:18.799 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:29:18.799 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:29:18.799 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:29:18.799 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:29:18.799 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 107 M 2026-02-24T18:29:18.799 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 664 M 2026-02-24T18:29:18.799 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:29:24.139 INFO:teuthology.orchestra.run.trial179.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.1 MB/s | 107 MB 01:39 2026-02-24T18:29:24.140 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:24.140 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.1 MB/s | 107 MB 01:39 2026-02-24T18:29:24.140 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:29:24.142 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:29:24.142 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:29:24.478 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:29:24.478 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:29:30.369 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:29:30.388 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:30.928 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:30.989 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:30.989 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:29:30.989 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:29:30.989 INFO:teuthology.orchestra.run.trial179.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:30.989 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:29:30.989 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:29:31.026 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:29:31.342 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:03:29 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:29:31.427 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:29:31.428 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:29:31.428 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T18:29:31.428 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:29:31.429 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:29:31.429 INFO:teuthology.orchestra.run.trial179.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:29:31.429 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:29:31.429 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:29:31.429 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:29:31.429 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:29:31.429 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:29:31.429 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 586 M 2026-02-24T18:29:31.429 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 3.4 G 2026-02-24T18:29:31.430 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:29:35.937 INFO:teuthology.orchestra.run.trial045.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.3 MB/s | 107 MB 01:20 2026-02-24T18:29:35.938 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:35.938 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.3 MB/s | 107 MB 01:20 2026-02-24T18:29:35.938 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:29:35.940 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:29:35.940 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:29:36.277 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:29:36.277 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:29:42.164 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:29:42.183 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:42.690 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:42.752 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:42.752 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:29:42.752 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:29:42.752 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:42.752 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:29:42.752 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:29:42.788 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:29:43.105 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:03:38 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:29:43.190 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:29:43.190 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:29:43.190 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T18:29:43.190 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:29:43.190 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:29:43.191 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:29:43.191 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:29:43.191 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:29:43.191 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:29:43.191 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:29:43.191 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:29:43.191 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 586 M 2026-02-24T18:29:43.191 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 3.4 G 2026-02-24T18:29:43.191 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:30:24.475 INFO:teuthology.orchestra.run.trial194.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.6 MB/s | 107 MB 01:05 2026-02-24T18:30:24.476 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:30:24.476 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.6 MB/s | 107 MB 01:05 2026-02-24T18:30:24.476 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:30:24.478 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:30:24.478 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:30:24.816 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:30:24.817 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:30:30.694 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:30:30.714 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:30:31.256 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:30:31.318 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:30:31.319 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:30:31.319 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:30:31.319 INFO:teuthology.orchestra.run.trial194.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:30:31.319 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:30:31.319 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:30:31.356 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:30:31.672 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:03:32 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:30:31.765 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:30:31.765 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:30:31.765 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 586 M 2026-02-24T18:30:31.766 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 3.4 G 2026-02-24T18:30:31.767 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:32:31.682 INFO:teuthology.orchestra.run.trial114.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 2.4 MB/s | 586 MB 04:07 2026-02-24T18:32:31.683 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:32:31.683 INFO:teuthology.orchestra.run.trial114.stdout:Total 2.4 MB/s | 586 MB 04:07 2026-02-24T18:32:31.683 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:32:31.686 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:32:31.686 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:32:33.429 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:32:33.429 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:33:05.239 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:33:05.256 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:33:06.237 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:33:06.300 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:33:06.300 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:33:06.300 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:33:06.300 INFO:teuthology.orchestra.run.trial114.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:33:06.300 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:33:06.300 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:33:06.386 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:33:06.708 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:07:07 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:33:06.792 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:33:06.793 INFO:teuthology.orchestra.run.trial114.stdout:======================================================================================= 2026-02-24T18:33:06.793 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T18:33:06.793 INFO:teuthology.orchestra.run.trial114.stdout:======================================================================================= 2026-02-24T18:33:06.793 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:33:06.793 INFO:teuthology.orchestra.run.trial114.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:33:06.793 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:33:06.793 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:33:06.794 INFO:teuthology.orchestra.run.trial114.stdout:======================================================================================= 2026-02-24T18:33:06.794 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:33:06.794 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:33:06.794 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 3.0 M 2026-02-24T18:33:06.794 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 15 M 2026-02-24T18:33:06.794 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:33:08.557 INFO:teuthology.orchestra.run.trial114.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.7 MB/s | 3.0 MB 00:01 2026-02-24T18:33:08.557 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:33:08.557 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.7 MB/s | 3.0 MB 00:01 2026-02-24T18:33:08.557 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:33:08.559 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:33:08.559 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:33:08.585 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:33:08.585 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:33:08.772 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:33:08.789 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:33:08.858 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:33:08.921 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:33:08.922 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:33:08.922 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:33:08.922 INFO:teuthology.orchestra.run.trial114.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:33:08.922 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:33:08.922 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:33:08.950 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:33:09.267 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:07:10 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:33:09.351 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:33:09.351 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:33:09.351 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T18:33:09.351 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:33:09.351 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:33:09.351 INFO:teuthology.orchestra.run.trial114.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:33:09.351 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:33:09.351 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:33:09.351 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:33:09.352 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:33:09.352 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:33:09.352 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 543 M 2026-02-24T18:33:09.352 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 0 2026-02-24T18:33:09.352 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:36:54.809 INFO:teuthology.orchestra.run.trial045.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 1.4 MB/s | 586 MB 07:11 2026-02-24T18:36:54.810 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:36:54.810 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.4 MB/s | 586 MB 07:11 2026-02-24T18:36:54.810 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:36:54.813 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:36:54.813 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:36:56.558 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:36:56.558 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:37:28.561 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:37:28.578 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:37:29.550 INFO:teuthology.orchestra.run.trial179.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 1.2 MB/s | 586 MB 07:58 2026-02-24T18:37:29.550 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:37:29.551 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.2 MB/s | 586 MB 07:58 2026-02-24T18:37:29.551 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:37:29.553 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:37:29.553 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:37:29.839 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:37:29.901 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:37:29.902 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:37:29.902 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:37:29.902 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:37:29.902 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:37:29.902 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:37:29.986 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:37:30.311 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:11:25 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:37:30.395 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:37:30.395 INFO:teuthology.orchestra.run.trial045.stdout:======================================================================================= 2026-02-24T18:37:30.395 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T18:37:30.395 INFO:teuthology.orchestra.run.trial045.stdout:======================================================================================= 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout:======================================================================================= 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 3.0 M 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 15 M 2026-02-24T18:37:30.396 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:37:31.286 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:37:31.286 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:37:33.923 INFO:teuthology.orchestra.run.trial045.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 880 kB/s | 3.0 MB 00:03 2026-02-24T18:37:33.923 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:37:33.924 INFO:teuthology.orchestra.run.trial045.stdout:Total 880 kB/s | 3.0 MB 00:03 2026-02-24T18:37:33.924 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:37:33.926 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:37:33.926 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:37:33.951 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:37:33.952 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:37:34.142 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:37:34.159 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:37:34.233 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:37:34.295 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:37:34.295 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:37:34.296 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:37:34.296 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:37:34.296 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:37:34.296 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:37:34.322 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:37:34.643 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:11:29 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:37:34.731 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:37:34.731 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:37:34.731 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T18:37:34.731 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:37:34.731 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:37:34.731 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:37:34.731 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:37:34.732 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:37:34.732 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:37:34.732 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:37:34.732 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:37:34.732 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 543 M 2026-02-24T18:37:34.732 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 0 2026-02-24T18:37:34.732 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:38:03.110 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:38:03.127 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:38:04.402 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:38:04.463 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:38:04.463 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:38:04.463 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:38:04.463 INFO:teuthology.orchestra.run.trial179.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:38:04.463 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:38:04.464 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:38:04.543 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:38:04.868 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:12:02 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:38:04.952 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:38:04.953 INFO:teuthology.orchestra.run.trial179.stdout:======================================================================================= 2026-02-24T18:38:04.953 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout:======================================================================================= 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout:======================================================================================= 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 3.0 M 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 15 M 2026-02-24T18:38:04.954 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:38:07.784 INFO:teuthology.orchestra.run.trial179.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.1 MB/s | 3.0 MB 00:02 2026-02-24T18:38:07.784 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:38:07.784 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.1 MB/s | 3.0 MB 00:02 2026-02-24T18:38:07.785 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:38:07.787 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:38:07.787 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:38:07.813 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:38:07.813 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:38:08.000 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:38:08.018 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:38:08.089 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:38:08.151 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:38:08.151 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:38:08.151 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:38:08.151 INFO:teuthology.orchestra.run.trial179.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:38:08.152 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:38:08.152 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:38:08.178 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:38:08.491 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:12:06 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:38:08.576 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:38:08.576 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:38:08.576 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T18:38:08.576 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:38:08.576 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:38:08.576 INFO:teuthology.orchestra.run.trial179.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:38:08.576 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:38:08.577 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:38:08.577 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:38:08.577 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:38:08.577 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:38:08.577 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 543 M 2026-02-24T18:38:08.577 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 0 2026-02-24T18:38:08.577 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:38:58.072 INFO:teuthology.orchestra.run.trial194.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 1.2 MB/s | 586 MB 08:26 2026-02-24T18:38:58.072 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:38:58.073 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.2 MB/s | 586 MB 08:26 2026-02-24T18:38:58.073 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:38:58.075 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:38:58.075 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:38:59.822 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:38:59.823 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:39:31.720 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:39:31.736 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:39:33.041 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:39:33.103 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:39:33.103 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:39:33.103 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:39:33.103 INFO:teuthology.orchestra.run.trial194.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:39:33.103 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:39:33.103 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:39:33.185 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:39:33.505 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:12:34 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:39:33.592 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout:======================================================================================= 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout:======================================================================================= 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout:======================================================================================= 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:39:33.593 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:39:33.594 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 3.0 M 2026-02-24T18:39:33.594 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 15 M 2026-02-24T18:39:33.594 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:39:38.293 INFO:teuthology.orchestra.run.trial194.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 661 kB/s | 3.0 MB 00:04 2026-02-24T18:39:38.294 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:39:38.294 INFO:teuthology.orchestra.run.trial194.stdout:Total 660 kB/s | 3.0 MB 00:04 2026-02-24T18:39:38.294 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:39:38.296 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:39:38.296 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:39:38.321 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:39:38.322 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:39:38.510 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:39:38.526 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:39:38.601 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:39:38.664 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:39:38.664 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:39:38.664 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:39:38.664 INFO:teuthology.orchestra.run.trial194.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:39:38.664 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:39:38.664 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:39:38.693 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:39:39.015 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:12:40 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:39:39.099 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:39:39.099 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 543 M 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 0 2026-02-24T18:39:39.100 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T18:42:21.097 INFO:teuthology.orchestra.run.trial114.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 1.0 MB/s | 543 MB 09:11 2026-02-24T18:42:21.098 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:42:21.098 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.0 MB/s | 543 MB 09:11 2026-02-24T18:42:21.098 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T18:42:21.101 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T18:42:21.101 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T18:42:22.713 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T18:42:22.713 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T18:42:55.434 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T18:42:55.451 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:42:56.926 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:42:56.989 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:42:56.989 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:42:56.989 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T18:42:56.989 INFO:teuthology.orchestra.run.trial114.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:42:56.990 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:42:56.990 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T18:42:57.073 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:42:57.397 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:16:58 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T18:42:57.480 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T18:42:57.481 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:42:57.481 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 1.7 G 2026-02-24T18:42:57.482 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 0 2026-02-24T18:42:57.483 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T18:44:28.310 INFO:teuthology.orchestra.run.trial045.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 1.3 MB/s | 543 MB 06:53 2026-02-24T18:44:28.311 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:44:28.311 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.3 MB/s | 543 MB 06:53 2026-02-24T18:44:28.311 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T18:44:28.313 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T18:44:28.313 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T18:44:29.923 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T18:44:29.923 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T18:45:02.150 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T18:45:02.168 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:45:04.437 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:45:04.499 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:45:04.500 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:45:04.500 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T18:45:04.500 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:45:04.500 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:45:04.500 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T18:45:04.575 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:45:04.888 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:18:59 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:45:04.972 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T18:45:04.973 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:45:04.973 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T18:45:04.973 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:45:04.973 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T18:45:04.973 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:45:04.973 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:45:04.973 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T18:45:04.974 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T18:45:04.974 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T18:45:04.974 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T18:45:04.974 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 1.7 G 2026-02-24T18:45:04.974 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 0 2026-02-24T18:45:04.974 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T18:50:10.698 INFO:teuthology.orchestra.run.trial179.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 770 kB/s | 543 MB 12:02 2026-02-24T18:50:10.699 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:50:10.699 INFO:teuthology.orchestra.run.trial179.stdout:Total 770 kB/s | 543 MB 12:02 2026-02-24T18:50:10.699 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T18:50:10.701 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T18:50:10.701 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T18:50:12.311 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T18:50:12.311 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T18:50:45.641 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T18:50:45.658 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:46.402 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:46.463 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:50:46.464 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:50:46.464 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T18:50:46.464 INFO:teuthology.orchestra.run.trial179.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:50:46.464 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:50:46.464 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T18:50:46.542 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:50:46.861 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:24:44 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T18:50:46.946 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T18:50:46.947 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:50:46.947 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T18:50:46.947 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:50:46.947 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T18:50:46.947 INFO:teuthology.orchestra.run.trial179.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:50:46.947 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:50:46.947 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T18:50:46.948 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T18:50:46.948 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T18:50:46.948 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T18:50:46.948 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 1.7 G 2026-02-24T18:50:46.948 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 0 2026-02-24T18:50:46.948 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T18:51:14.909 INFO:teuthology.orchestra.run.trial194.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 799 kB/s | 543 MB 11:35 2026-02-24T18:51:14.910 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:51:14.910 INFO:teuthology.orchestra.run.trial194.stdout:Total 799 kB/s | 543 MB 11:35 2026-02-24T18:51:14.910 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T18:51:14.912 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T18:51:14.912 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T18:51:16.526 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T18:51:16.527 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T18:51:48.798 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T18:51:48.816 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:51:50.316 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:51:50.379 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:51:50.379 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:51:50.379 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T18:51:50.379 INFO:teuthology.orchestra.run.trial194.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:51:50.379 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:51:50.379 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T18:51:50.458 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:51:50.775 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:24:51 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T18:51:50.860 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T18:51:50.861 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:51:50.861 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T18:51:50.861 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:51:50.861 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T18:51:50.861 INFO:teuthology.orchestra.run.trial194.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:51:50.862 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:51:50.862 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T18:51:50.862 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T18:51:50.862 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T18:51:50.862 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T18:51:50.862 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 1.7 G 2026-02-24T18:51:50.862 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 0 2026-02-24T18:51:50.862 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:09:08.709 INFO:teuthology.orchestra.run.trial114.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.1 MB/s | 1.7 GB 26:11 2026-02-24T19:09:08.710 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:09:08.710 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.1 MB/s | 1.7 GB 26:11 2026-02-24T19:09:08.710 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:09:08.714 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:09:08.714 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:09:13.915 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:09:13.915 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:10:55.822 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:10:55.842 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:10:58.946 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:10:59.008 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:10:59.008 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:10:59.008 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:10:59.008 INFO:teuthology.orchestra.run.trial114.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:10:59.008 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:10:59.008 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:10:59.210 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:10:59.529 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:45:00 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:10:59.594 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:10:59.612 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:10:59.613 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-24T19:10:59.613 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:10:59.634 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:10:59.947 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:45:00 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 22 M 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 146 M 2026-02-24T19:11:00.031 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:11:04.758 INFO:teuthology.orchestra.run.trial194.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.5 MB/s | 1.7 GB 19:13 2026-02-24T19:11:04.758 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:04.759 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.5 MB/s | 1.7 GB 19:13 2026-02-24T19:11:04.759 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:11:04.762 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:11:04.762 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:11:07.344 INFO:teuthology.orchestra.run.trial114.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 3.0 MB/s | 22 MB 00:07 2026-02-24T19:11:07.344 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:07.344 INFO:teuthology.orchestra.run.trial114.stdout:Total 3.0 MB/s | 22 MB 00:07 2026-02-24T19:11:07.344 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:11:07.346 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:11:07.346 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:11:07.430 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:11:07.430 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:11:08.689 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:11:08.706 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:11:08.871 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:11:08.935 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:11:08.935 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:08.935 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:11:08.935 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:11:08.935 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:08.935 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:11:08.965 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:11:09.284 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:45:10 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:11:09.368 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:11:09.369 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:11:09.369 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:11:09.369 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:11:09.369 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:11:09.369 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:11:09.369 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:09.369 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:11:09.369 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:11:09.370 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:11:09.370 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:09.370 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 54 M 2026-02-24T19:11:09.370 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 221 M 2026-02-24T19:11:09.370 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:11:09.958 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:11:09.958 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:11:30.568 INFO:teuthology.orchestra.run.trial114.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.5 MB/s | 54 MB 00:21 2026-02-24T19:11:30.569 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:30.569 INFO:teuthology.orchestra.run.trial114.stdout:Total 2.5 MB/s | 54 MB 00:21 2026-02-24T19:11:30.570 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:11:30.571 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:11:30.571 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:11:30.749 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:11:30.749 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:11:33.451 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:11:33.468 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:11:33.688 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:11:33.751 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:11:33.751 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:33.751 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:11:33.751 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:11:33.751 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:33.751 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:11:33.781 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:11:34.099 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:45:35 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:11:34.183 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:11:34.184 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:11:34.184 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:11:34.184 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:11:34.184 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:11:34.184 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:11:34.184 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:34.185 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:11:34.185 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:11:34.185 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:11:34.185 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:11:34.185 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 130 M 2026-02-24T19:11:34.185 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 643 M 2026-02-24T19:11:34.185 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:11:52.654 INFO:teuthology.orchestra.run.trial045.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.1 MB/s | 1.7 GB 26:47 2026-02-24T19:11:52.655 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:52.656 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.1 MB/s | 1.7 GB 26:47 2026-02-24T19:11:52.656 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:11:52.659 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:11:52.659 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:11:57.850 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:11:57.850 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:12:08.384 INFO:teuthology.orchestra.run.trial114.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 3.8 MB/s | 130 MB 00:34 2026-02-24T19:12:08.384 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:08.385 INFO:teuthology.orchestra.run.trial114.stdout:Total 3.8 MB/s | 130 MB 00:34 2026-02-24T19:12:08.385 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:12:08.386 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:12:08.387 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:12:08.786 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:12:08.787 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:12:15.626 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:12:15.643 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:16.174 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:16.239 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:16.239 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:12:16.239 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:12:16.239 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:16.240 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:12:16.240 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:12:16.280 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:12:16.600 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:46:17 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:12:16.685 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:12:16.686 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:12:16.686 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:12:16.686 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:12:16.686 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:12:16.686 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:12:16.686 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:12:16.686 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:12:16.686 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:12:16.687 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:12:16.687 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:12:16.687 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 343 M 2026-02-24T19:12:16.687 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 1.6 G 2026-02-24T19:12:16.687 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:12:18.760 INFO:teuthology.orchestra.run.trial179.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.4 MB/s | 1.7 GB 21:31 2026-02-24T19:12:18.761 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:18.761 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.4 MB/s | 1.7 GB 21:31 2026-02-24T19:12:18.761 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:12:18.764 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:12:18.764 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:12:23.954 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:12:23.954 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:12:43.350 INFO:teuthology.orchestra.run.trial114.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 13 MB/s | 343 MB 00:26 2026-02-24T19:12:43.351 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:43.351 INFO:teuthology.orchestra.run.trial114.stdout:Total 13 MB/s | 343 MB 00:26 2026-02-24T19:12:43.351 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:12:43.353 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:12:43.353 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:12:44.380 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:12:44.381 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:12:54.120 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:12:54.141 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:57.314 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:57.377 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:12:57.377 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:12:57.377 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:12:57.377 INFO:teuthology.orchestra.run.trial194.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:57.377 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:12:57.377 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:12:57.578 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:12:57.894 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:45:58 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:12:57.960 INFO:teuthology.orchestra.run.trial194.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:12:57.979 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:12:57.980 INFO:teuthology.orchestra.run.trial194.stdout:Nothing to do. 2026-02-24T19:12:57.980 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:12:58.002 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:12:58.323 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:45:59 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:12:58.408 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:12:58.409 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:12:58.409 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 22 M 2026-02-24T19:12:58.410 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 146 M 2026-02-24T19:12:58.411 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:13:01.933 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:01.951 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:03.172 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:03.235 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:03.235 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:03.235 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:03.235 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:03.235 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:03.236 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:03.292 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:13:03.615 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:04 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:03.699 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:03.700 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:03.700 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:03.700 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:03.700 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:03.700 INFO:teuthology.orchestra.run.trial114.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:13:03.700 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:03.700 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:03.700 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:03.700 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:03.701 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:03.701 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 10 M 2026-02-24T19:13:03.701 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 51 M 2026-02-24T19:13:03.701 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:05.843 INFO:teuthology.orchestra.run.trial114.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 4.8 MB/s | 10 MB 00:02 2026-02-24T19:13:05.843 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:05.844 INFO:teuthology.orchestra.run.trial114.stdout:Total 4.7 MB/s | 10 MB 00:02 2026-02-24T19:13:05.844 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:05.845 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:05.845 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:05.892 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:05.892 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:06.445 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:06.462 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:06.564 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:06.629 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:06.629 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:06.629 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:06.629 INFO:teuthology.orchestra.run.trial114.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:06.629 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:06.629 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:06.660 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:13:06.974 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:07 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:07.057 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:07.058 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:07.058 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:07.058 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:07.058 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:07.058 INFO:teuthology.orchestra.run.trial114.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:13:07.059 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:07.059 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:07.059 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:07.059 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:07.059 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:07.059 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 144 k 2026-02-24T19:13:07.059 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 802 k 2026-02-24T19:13:07.059 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:07.334 INFO:teuthology.orchestra.run.trial114.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 520 kB/s | 144 kB 00:00 2026-02-24T19:13:07.335 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:07.335 INFO:teuthology.orchestra.run.trial114.stdout:Total 519 kB/s | 144 kB 00:00 2026-02-24T19:13:07.335 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:07.337 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:07.337 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:07.355 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:07.355 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:07.397 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:07.414 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:13:07.475 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:13:07.537 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:13:07.537 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:07.537 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:07.538 INFO:teuthology.orchestra.run.trial114.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:07.538 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:07.538 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:07.564 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:13:07.885 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:08 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:07.950 INFO:teuthology.orchestra.run.trial194.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.3 MB/s | 22 MB 00:09 2026-02-24T19:13:07.951 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:07.951 INFO:teuthology.orchestra.run.trial194.stdout:Total 2.3 MB/s | 22 MB 00:09 2026-02-24T19:13:07.952 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:13:07.954 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:13:07.954 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:13:07.968 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:07.969 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:07.969 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:07.969 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:07.969 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:07.970 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:13:07.970 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:07.970 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:07.970 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:07.970 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:07.970 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:07.970 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 9.1 M 2026-02-24T19:13:07.970 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 46 M 2026-02-24T19:13:07.970 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:08.035 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:13:08.035 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:13:09.288 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:13:09.305 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:09.346 INFO:teuthology.orchestra.run.trial114.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 6.6 MB/s | 9.1 MB 00:01 2026-02-24T19:13:09.347 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:09.347 INFO:teuthology.orchestra.run.trial114.stdout:Total 6.6 MB/s | 9.1 MB 00:01 2026-02-24T19:13:09.347 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:09.349 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:09.349 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:09.392 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:09.393 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:09.471 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:09.534 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:09.534 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:09.534 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:13:09.534 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:09.534 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:09.534 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:13:09.563 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:13:09.884 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:46:10 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:13:09.904 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:09.922 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:09.969 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:13:09.970 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:13:09.970 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:13:09.970 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:13:09.970 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:13:09.971 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:13:09.971 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:09.971 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:13:09.971 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:13:09.971 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:13:09.971 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:09.971 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 54 M 2026-02-24T19:13:09.971 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 221 M 2026-02-24T19:13:09.971 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:13:10.017 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:10.079 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:10.079 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:10.080 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:10.080 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:10.080 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:10.080 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:10.109 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados2-debuginfo 2026-02-24T19:13:10.425 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:11 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:10.508 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:10.509 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:10.509 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:10.509 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:10.509 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:10.510 INFO:teuthology.orchestra.run.trial114.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:13:10.510 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:10.510 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:10.510 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:10.510 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:10.510 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:10.510 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 63 M 2026-02-24T19:13:10.510 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 397 M 2026-02-24T19:13:10.510 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:15.351 INFO:teuthology.orchestra.run.trial194.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 10 MB/s | 54 MB 00:05 2026-02-24T19:13:15.352 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:15.352 INFO:teuthology.orchestra.run.trial194.stdout:Total 10 MB/s | 54 MB 00:05 2026-02-24T19:13:15.353 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:13:15.354 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:13:15.354 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:13:15.532 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:13:15.532 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:13:18.181 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:13:18.198 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:18.418 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:18.480 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:18.481 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:18.481 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:13:18.481 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:18.481 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:18.481 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:13:18.513 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:13:18.828 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:46:19 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:13:18.913 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:13:18.914 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:13:18.914 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:13:18.914 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:13:18.914 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:13:18.914 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:13:18.914 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:18.915 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:13:18.915 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:13:18.915 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:13:18.915 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:18.915 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 130 M 2026-02-24T19:13:18.915 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 643 M 2026-02-24T19:13:18.915 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:13:21.657 INFO:teuthology.orchestra.run.trial114.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 5.7 MB/s | 63 MB 00:11 2026-02-24T19:13:21.658 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:21.658 INFO:teuthology.orchestra.run.trial114.stdout:Total 5.7 MB/s | 63 MB 00:11 2026-02-24T19:13:21.658 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:21.660 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:21.660 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:21.868 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:21.868 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:25.382 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:25.399 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:25.755 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:25.818 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:25.819 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:25.819 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:25.819 INFO:teuthology.orchestra.run.trial114.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:25.819 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:25.819 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:25.852 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:13:26.172 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:27 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:26.257 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:26.258 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:26.258 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 80 M 2026-02-24T19:13:26.259 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 406 M 2026-02-24T19:13:26.260 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:30.970 INFO:teuthology.orchestra.run.trial194.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 11 MB/s | 130 MB 00:12 2026-02-24T19:13:30.971 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:30.971 INFO:teuthology.orchestra.run.trial194.stdout:Total 11 MB/s | 130 MB 00:12 2026-02-24T19:13:30.971 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:13:30.973 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:13:30.973 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:13:31.371 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:13:31.371 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:13:36.993 INFO:teuthology.orchestra.run.trial114.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 7.5 MB/s | 80 MB 00:10 2026-02-24T19:13:36.994 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:36.994 INFO:teuthology.orchestra.run.trial114.stdout:Total 7.5 MB/s | 80 MB 00:10 2026-02-24T19:13:36.994 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:36.996 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:36.996 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:37.252 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:37.252 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:37.984 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:13:38.004 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:38.021 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:13:38.039 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:38.577 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:38.639 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:38.639 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:38.639 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:13:38.639 INFO:teuthology.orchestra.run.trial194.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:38.639 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:38.640 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:13:38.680 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:13:38.998 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:46:39 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:13:39.084 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:13:39.085 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:13:39.085 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 343 M 2026-02-24T19:13:39.086 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 1.6 G 2026-02-24T19:13:39.087 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:13:41.234 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:41.295 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:41.296 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:41.296 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:13:41.296 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:41.296 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:41.296 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:13:41.409 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:41.427 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:41.495 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:13:41.778 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:41.818 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:47:36 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:13:41.842 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:41.842 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:41.842 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:41.843 INFO:teuthology.orchestra.run.trial114.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:41.843 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:41.843 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:41.879 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:13:41.883 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:13:41.902 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:13:41.903 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-24T19:13:41.903 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:13:41.924 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:13:42.197 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:43 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:42.243 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:47:37 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:13:42.280 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:42.281 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:42.282 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 645 k 2026-02-24T19:13:42.282 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 2.3 M 2026-02-24T19:13:42.282 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:42.328 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:13:42.329 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:13:42.329 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:13:42.329 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:13:42.329 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:13:42.329 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:13:42.329 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:42.330 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:13:42.330 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:13:42.330 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:13:42.330 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:42.330 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 22 M 2026-02-24T19:13:42.330 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 146 M 2026-02-24T19:13:42.330 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:13:42.798 INFO:teuthology.orchestra.run.trial114.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 1.2 MB/s | 645 kB 00:00 2026-02-24T19:13:42.799 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:42.799 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.2 MB/s | 645 kB 00:00 2026-02-24T19:13:42.799 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:42.801 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:42.801 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:42.820 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:42.821 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:42.886 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:42.903 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:13:42.968 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:13:43.031 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:13:43.031 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:43.031 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:43.031 INFO:teuthology.orchestra.run.trial114.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:43.032 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:43.032 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:43.057 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:13:43.377 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:44 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:43.460 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:43.461 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:43.461 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:43.461 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:43.461 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:43.461 INFO:teuthology.orchestra.run.trial114.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:13:43.461 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:43.462 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:43.462 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:43.462 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:43.462 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:43.462 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 802 k 2026-02-24T19:13:43.462 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 3.1 M 2026-02-24T19:13:43.462 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:44.023 INFO:teuthology.orchestra.run.trial114.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 1.4 MB/s | 802 kB 00:00 2026-02-24T19:13:44.024 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:44.024 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.4 MB/s | 802 kB 00:00 2026-02-24T19:13:44.024 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:44.025 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:44.026 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:44.046 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:44.046 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:44.118 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:44.135 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:13:44.198 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:13:44.261 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:13:44.261 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:44.262 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:44.262 INFO:teuthology.orchestra.run.trial114.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:44.262 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:44.262 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:44.288 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:13:44.602 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:45 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:44.685 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:44.686 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:44.686 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:44.686 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:44.686 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:44.686 INFO:teuthology.orchestra.run.trial114.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:13:44.687 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:44.687 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:44.687 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:44.687 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:44.687 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:44.687 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 1.2 M 2026-02-24T19:13:44.687 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 4.7 M 2026-02-24T19:13:44.687 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:45.631 INFO:teuthology.orchestra.run.trial045.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 6.6 MB/s | 22 MB 00:03 2026-02-24T19:13:45.631 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:45.632 INFO:teuthology.orchestra.run.trial045.stdout:Total 6.6 MB/s | 22 MB 00:03 2026-02-24T19:13:45.632 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:13:45.633 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:13:45.634 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:13:45.716 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:13:45.716 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:13:45.788 INFO:teuthology.orchestra.run.trial114.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 1.1 MB/s | 1.2 MB 00:01 2026-02-24T19:13:45.789 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:45.789 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.1 MB/s | 1.2 MB 00:01 2026-02-24T19:13:45.789 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:45.791 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:45.791 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:45.813 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:45.813 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:45.905 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:45.922 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:45.989 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:46.054 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:46.054 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:46.054 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:46.054 INFO:teuthology.orchestra.run.trial114.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:46.054 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:46.055 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:46.081 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:13:46.402 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:47 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:46.485 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:46.486 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 350 k 2026-02-24T19:13:46.487 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 1.1 M 2026-02-24T19:13:46.488 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:46.681 INFO:teuthology.orchestra.run.trial114.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 1.8 MB/s | 350 kB 00:00 2026-02-24T19:13:46.682 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:46.682 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.8 MB/s | 350 kB 00:00 2026-02-24T19:13:46.682 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:46.684 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:46.684 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:46.702 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:46.702 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:46.753 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:46.770 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:46.836 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:46.898 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:13:46.899 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:46.899 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:46.899 INFO:teuthology.orchestra.run.trial114.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:46.899 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:46.899 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:46.927 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:13:46.967 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:13:46.985 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:46.997 INFO:teuthology.orchestra.run.trial194.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 43 MB/s | 343 MB 00:07 2026-02-24T19:13:46.998 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:46.998 INFO:teuthology.orchestra.run.trial194.stdout:Total 43 MB/s | 343 MB 00:07 2026-02-24T19:13:46.998 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:13:47.000 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:13:47.000 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:13:47.150 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:47.212 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:47.212 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:47.212 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:13:47.212 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:47.212 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:47.212 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:13:47.241 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:13:47.243 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:48 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:47.326 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:47.327 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:47.327 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:47.327 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 1.5 M 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 7.9 M 2026-02-24T19:13:47.328 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:47.478 INFO:teuthology.orchestra.run.trial114.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 10 MB/s | 1.5 MB 00:00 2026-02-24T19:13:47.478 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:47.479 INFO:teuthology.orchestra.run.trial114.stdout:Total 10 MB/s | 1.5 MB 00:00 2026-02-24T19:13:47.479 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:47.480 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:47.480 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:47.502 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:47.502 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:47.554 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:47:42 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:13:47.615 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:47.633 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:47.640 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:13:47.641 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:47.642 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 54 M 2026-02-24T19:13:47.642 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 221 M 2026-02-24T19:13:47.642 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:13:47.699 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:47.762 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:47.762 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:47.762 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:47.762 INFO:teuthology.orchestra.run.trial114.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:47.762 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:47.762 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:47.788 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:13:48.023 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:13:48.023 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:13:48.099 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:49 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:48.183 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:48.184 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:48.184 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:48.184 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:48.184 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:48.184 INFO:teuthology.orchestra.run.trial114.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:13:48.184 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:48.184 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:48.184 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:48.185 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:48.185 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:48.185 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 79 M 2026-02-24T19:13:48.185 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 375 M 2026-02-24T19:13:48.185 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:51.742 INFO:teuthology.orchestra.run.trial114.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 22 MB/s | 79 MB 00:03 2026-02-24T19:13:51.743 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:51.743 INFO:teuthology.orchestra.run.trial114.stdout:Total 22 MB/s | 79 MB 00:03 2026-02-24T19:13:51.743 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:51.745 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:51.745 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:51.996 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:51.996 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:53.678 INFO:teuthology.orchestra.run.trial045.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 8.9 MB/s | 54 MB 00:06 2026-02-24T19:13:53.679 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:53.679 INFO:teuthology.orchestra.run.trial045.stdout:Total 8.9 MB/s | 54 MB 00:06 2026-02-24T19:13:53.679 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:13:53.681 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:13:53.681 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:13:53.857 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:13:53.857 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:13:56.238 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:56.255 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:56.563 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:13:56.581 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:56.604 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:56.669 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:13:56.669 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:56.669 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:56.669 INFO:teuthology.orchestra.run.trial114.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:56.669 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:56.669 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:56.706 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:13:56.806 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:56.868 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:56.868 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:56.868 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:13:56.868 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:56.869 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:56.869 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:13:56.899 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:13:57.023 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:47:58 ago on Tue 24 Feb 2026 06:25:59 PM UTC. 2026-02-24T19:13:57.107 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-24T19:13:57.108 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:57.109 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 2.4 M 2026-02-24T19:13:57.109 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 12 M 2026-02-24T19:13:57.109 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-24T19:13:57.214 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:47:52 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:13:57.266 INFO:teuthology.orchestra.run.trial114.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 15 MB/s | 2.4 MB 00:00 2026-02-24T19:13:57.267 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:57.267 INFO:teuthology.orchestra.run.trial114.stdout:Total 15 MB/s | 2.4 MB 00:00 2026-02-24T19:13:57.267 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-24T19:13:57.268 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-24T19:13:57.269 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-24T19:13:57.295 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-24T19:13:57.295 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-24T19:13:57.298 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:13:57.299 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:13:57.299 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:13:57.299 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:13:57.299 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:13:57.299 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:13:57.299 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:57.299 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:13:57.299 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:13:57.300 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:13:57.300 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:13:57.300 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 130 M 2026-02-24T19:13:57.300 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 643 M 2026-02-24T19:13:57.300 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:13:57.453 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-24T19:13:57.470 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:57.547 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:57.612 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:57.612 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:57.612 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-24T19:13:57.612 INFO:teuthology.orchestra.run.trial114.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:57.612 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:13:57.612 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-24T19:13:57.648 DEBUG:teuthology.parallel:result is None 2026-02-24T19:14:01.013 INFO:teuthology.orchestra.run.trial045.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 35 MB/s | 130 MB 00:03 2026-02-24T19:14:01.013 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:01.014 INFO:teuthology.orchestra.run.trial045.stdout:Total 35 MB/s | 130 MB 00:03 2026-02-24T19:14:01.014 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:14:01.015 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:14:01.015 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:14:01.413 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:14:01.413 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:14:04.165 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:14:04.185 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:05.215 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:05.232 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:06.480 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:06.542 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:06.542 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:06.543 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:06.543 INFO:teuthology.orchestra.run.trial194.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:06.543 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:06.543 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:06.600 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:14:06.913 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:07 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:06.996 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:06.997 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:06.997 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 10 M 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 51 M 2026-02-24T19:14:06.998 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:07.341 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:07.408 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:07.408 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:07.408 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:14:07.408 INFO:teuthology.orchestra.run.trial179.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:07.408 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:07.408 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:14:07.608 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:14:07.921 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:48:05 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:14:07.987 INFO:teuthology.orchestra.run.trial179.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:14:08.006 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:14:08.007 INFO:teuthology.orchestra.run.trial179.stdout:Nothing to do. 2026-02-24T19:14:08.007 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:14:08.028 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:14:08.050 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:14:08.067 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:08.345 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:48:06 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:14:08.430 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:14:08.431 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:08.431 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:14:08.431 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:08.431 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:14:08.431 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:14:08.431 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:08.431 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:14:08.431 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:08.431 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:14:08.432 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:08.432 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 22 M 2026-02-24T19:14:08.432 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 146 M 2026-02-24T19:14:08.432 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:14:08.598 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:08.660 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:08.660 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:14:08.660 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:14:08.660 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:08.660 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:14:08.660 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:14:08.696 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:14:09.011 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:48:04 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:14:09.095 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:14:09.096 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:14:09.096 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:14:09.096 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:14:09.096 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:14:09.096 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:14:09.096 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:14:09.096 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:14:09.096 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:14:09.096 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:14:09.097 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:14:09.097 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 343 M 2026-02-24T19:14:09.097 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 1.6 G 2026-02-24T19:14:09.097 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:14:09.685 INFO:teuthology.orchestra.run.trial194.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 3.8 MB/s | 10 MB 00:02 2026-02-24T19:14:09.686 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:09.686 INFO:teuthology.orchestra.run.trial194.stdout:Total 3.8 MB/s | 10 MB 00:02 2026-02-24T19:14:09.686 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:09.688 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:09.688 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:09.735 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:09.735 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:10.054 INFO:teuthology.orchestra.run.trial179.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 13 MB/s | 22 MB 00:01 2026-02-24T19:14:10.055 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:10.055 INFO:teuthology.orchestra.run.trial179.stdout:Total 13 MB/s | 22 MB 00:01 2026-02-24T19:14:10.055 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:14:10.057 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:14:10.057 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:14:10.140 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:14:10.140 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:14:10.285 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:10.303 INFO:teuthology.orchestra.run.trial194.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:10.398 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:10.461 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:10.461 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:10.462 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:10.462 INFO:teuthology.orchestra.run.trial194.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:10.462 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:10.462 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:10.490 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:14:10.806 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:11 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:10.889 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:10.890 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:10.890 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:10.890 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:10.890 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:10.890 INFO:teuthology.orchestra.run.trial194.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:14:10.890 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:10.891 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:10.891 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:10.891 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:10.891 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:10.891 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 144 k 2026-02-24T19:14:10.891 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 802 k 2026-02-24T19:14:10.891 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:11.142 INFO:teuthology.orchestra.run.trial194.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 570 kB/s | 144 kB 00:00 2026-02-24T19:14:11.143 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:11.143 INFO:teuthology.orchestra.run.trial194.stdout:Total 568 kB/s | 144 kB 00:00 2026-02-24T19:14:11.143 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:11.145 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:11.145 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:11.163 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:11.164 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:11.205 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:11.222 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:14:11.282 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:14:11.344 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:14:11.344 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:11.344 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:11.344 INFO:teuthology.orchestra.run.trial194.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:11.345 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:11.345 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:11.371 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:14:11.411 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:14:11.429 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:11.595 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:11.657 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:11.658 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:11.658 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:14:11.658 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:11.658 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:11.658 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:14:11.687 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:14:11.688 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:12 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:11.772 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:11.773 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:11.774 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:11.774 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:11.774 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:11.774 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:14:11.774 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:11.774 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:11.774 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:11.774 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:11.774 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:11.775 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 9.1 M 2026-02-24T19:14:11.775 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 46 M 2026-02-24T19:14:11.775 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:12.001 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:48:09 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:14:12.084 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:14:12.085 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:12.085 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:14:12.085 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:12.085 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:14:12.086 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:14:12.086 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:12.086 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:14:12.086 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:12.086 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:14:12.086 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:12.086 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 54 M 2026-02-24T19:14:12.086 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 221 M 2026-02-24T19:14:12.086 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:14:12.647 INFO:teuthology.orchestra.run.trial194.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 10 MB/s | 9.1 MB 00:00 2026-02-24T19:14:12.647 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:12.647 INFO:teuthology.orchestra.run.trial194.stdout:Total 10 MB/s | 9.1 MB 00:00 2026-02-24T19:14:12.648 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:12.649 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:12.649 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:12.693 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:12.694 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:13.194 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:13.212 INFO:teuthology.orchestra.run.trial194.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:14:13.305 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:14:13.369 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:14:13.370 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:13.370 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:13.370 INFO:teuthology.orchestra.run.trial194.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:13.370 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:13.370 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:13.396 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install librados2-debuginfo 2026-02-24T19:14:13.710 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:14 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:13.794 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:13.795 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:13.796 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 63 M 2026-02-24T19:14:13.797 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 397 M 2026-02-24T19:14:13.797 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:15.555 INFO:teuthology.orchestra.run.trial179.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 16 MB/s | 54 MB 00:03 2026-02-24T19:14:15.556 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:15.556 INFO:teuthology.orchestra.run.trial179.stdout:Total 16 MB/s | 54 MB 00:03 2026-02-24T19:14:15.556 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:14:15.558 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:14:15.558 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:14:15.734 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:14:15.734 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:14:17.874 INFO:teuthology.orchestra.run.trial194.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 16 MB/s | 63 MB 00:04 2026-02-24T19:14:17.875 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:17.875 INFO:teuthology.orchestra.run.trial194.stdout:Total 16 MB/s | 63 MB 00:04 2026-02-24T19:14:17.875 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:17.877 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:17.877 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:18.085 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:18.085 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:18.509 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:14:18.527 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:18.741 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:18.803 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:18.803 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:18.803 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:14:18.803 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:18.803 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:18.804 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:14:18.835 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:14:19.145 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:48:17 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:14:19.231 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:14:19.232 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:19.232 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:14:19.232 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:19.232 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:14:19.232 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:14:19.233 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:19.233 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:14:19.233 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:19.233 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:14:19.233 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:19.233 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 130 M 2026-02-24T19:14:19.233 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 643 M 2026-02-24T19:14:19.233 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:14:21.645 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:21.662 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:22.009 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:22.072 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:22.072 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:22.072 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:22.072 INFO:teuthology.orchestra.run.trial194.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:22.072 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:22.072 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:22.105 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:14:22.422 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:23 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:22.506 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:22.507 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:22.507 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:22.507 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:22.507 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:22.507 INFO:teuthology.orchestra.run.trial194.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:14:22.507 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:22.507 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:22.507 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:22.507 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:22.508 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:22.508 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 80 M 2026-02-24T19:14:22.508 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 406 M 2026-02-24T19:14:22.508 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:27.487 INFO:teuthology.orchestra.run.trial194.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 16 MB/s | 80 MB 00:04 2026-02-24T19:14:27.488 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:27.488 INFO:teuthology.orchestra.run.trial194.stdout:Total 16 MB/s | 80 MB 00:04 2026-02-24T19:14:27.488 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:27.490 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:27.490 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:27.747 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:27.747 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:31.916 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:31.933 INFO:teuthology.orchestra.run.trial194.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:32.294 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:32.359 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:32.359 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:32.359 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:32.359 INFO:teuthology.orchestra.run.trial194.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:32.360 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:32.360 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:32.392 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:14:32.706 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:33 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:32.789 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:32.790 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:32.790 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:32.790 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 645 k 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 2.3 M 2026-02-24T19:14:32.791 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:33.520 INFO:teuthology.orchestra.run.trial194.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 883 kB/s | 645 kB 00:00 2026-02-24T19:14:33.521 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:33.521 INFO:teuthology.orchestra.run.trial194.stdout:Total 883 kB/s | 645 kB 00:00 2026-02-24T19:14:33.521 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:33.523 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:33.523 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:33.543 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:33.543 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:33.608 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:33.626 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:14:33.689 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:14:33.751 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:14:33.752 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:33.752 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:33.752 INFO:teuthology.orchestra.run.trial194.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:33.752 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:33.752 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:33.777 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:14:34.089 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:35 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:34.172 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:34.173 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:34.173 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:34.173 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 802 k 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 3.1 M 2026-02-24T19:14:34.174 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:34.588 INFO:teuthology.orchestra.run.trial194.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 1.9 MB/s | 802 kB 00:00 2026-02-24T19:14:34.589 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:34.589 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.9 MB/s | 802 kB 00:00 2026-02-24T19:14:34.589 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:34.591 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:34.591 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:34.611 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:34.611 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:34.686 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:34.704 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:14:34.771 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:14:34.834 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:14:34.834 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:34.834 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:34.834 INFO:teuthology.orchestra.run.trial194.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:34.834 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:34.834 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:34.862 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:14:35.176 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:36 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:35.260 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:35.261 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:35.261 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:35.261 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:35.261 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:35.261 INFO:teuthology.orchestra.run.trial194.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:14:35.261 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:35.261 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:35.262 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:35.262 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:35.262 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:35.262 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 1.2 M 2026-02-24T19:14:35.262 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 4.7 M 2026-02-24T19:14:35.262 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:35.687 INFO:teuthology.orchestra.run.trial194.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 2.7 MB/s | 1.2 MB 00:00 2026-02-24T19:14:35.687 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:35.688 INFO:teuthology.orchestra.run.trial194.stdout:Total 2.7 MB/s | 1.2 MB 00:00 2026-02-24T19:14:35.688 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:35.689 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:35.689 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:35.709 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:35.710 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:35.802 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:35.820 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:14:35.881 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:14:35.943 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:14:35.944 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:35.944 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:35.944 INFO:teuthology.orchestra.run.trial194.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:35.944 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:35.944 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:35.971 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:14:36.289 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:37 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:36.372 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:36.373 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:36.373 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:36.373 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:36.373 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:36.373 INFO:teuthology.orchestra.run.trial194.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:14:36.373 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:36.373 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:36.374 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:36.374 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:36.374 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:36.374 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 350 k 2026-02-24T19:14:36.374 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 1.1 M 2026-02-24T19:14:36.374 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:36.675 INFO:teuthology.orchestra.run.trial194.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 1.1 MB/s | 350 kB 00:00 2026-02-24T19:14:36.676 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:36.676 INFO:teuthology.orchestra.run.trial194.stdout:Total 1.1 MB/s | 350 kB 00:00 2026-02-24T19:14:36.677 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:36.678 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:36.678 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:36.697 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:36.698 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:36.747 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:36.764 INFO:teuthology.orchestra.run.trial194.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:14:36.829 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:14:36.892 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:14:36.893 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:36.893 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:36.893 INFO:teuthology.orchestra.run.trial194.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:36.893 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:36.893 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:36.920 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:14:37.237 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:38 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:37.320 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:37.321 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:37.321 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 1.5 M 2026-02-24T19:14:37.322 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 7.9 M 2026-02-24T19:14:37.323 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:37.860 INFO:teuthology.orchestra.run.trial194.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.8 MB/s | 1.5 MB 00:00 2026-02-24T19:14:37.861 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:37.861 INFO:teuthology.orchestra.run.trial194.stdout:Total 2.8 MB/s | 1.5 MB 00:00 2026-02-24T19:14:37.862 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:37.863 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:37.863 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:37.885 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:37.885 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:37.988 INFO:teuthology.orchestra.run.trial179.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 6.9 MB/s | 130 MB 00:18 2026-02-24T19:14:37.989 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:37.989 INFO:teuthology.orchestra.run.trial179.stdout:Total 6.9 MB/s | 130 MB 00:18 2026-02-24T19:14:37.989 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:14:37.991 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:14:37.991 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:14:37.998 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:38.015 INFO:teuthology.orchestra.run.trial194.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:38.080 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:38.141 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:38.141 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:38.142 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:38.142 INFO:teuthology.orchestra.run.trial194.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:38.142 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:38.142 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:38.169 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:14:38.392 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:14:38.392 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:14:38.485 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:39 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:38.571 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:38.572 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:38.572 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:38.572 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 79 M 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 375 M 2026-02-24T19:14:38.573 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:45.243 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:14:45.260 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:45.797 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:45.858 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:45.859 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:45.859 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:14:45.859 INFO:teuthology.orchestra.run.trial179.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:45.859 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:45.859 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:14:45.897 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:14:46.208 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:48:44 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:14:46.292 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:14:46.292 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:14:46.293 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 343 M 2026-02-24T19:14:46.294 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 1.6 G 2026-02-24T19:14:46.294 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:14:47.617 INFO:teuthology.orchestra.run.trial194.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 8.8 MB/s | 79 MB 00:09 2026-02-24T19:14:47.617 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:47.618 INFO:teuthology.orchestra.run.trial194.stdout:Total 8.8 MB/s | 79 MB 00:09 2026-02-24T19:14:47.618 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:47.620 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:47.620 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:47.870 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:47.870 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:52.010 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:52.028 INFO:teuthology.orchestra.run.trial194.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:14:52.356 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:14:52.417 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:14:52.418 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:52.418 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:52.418 INFO:teuthology.orchestra.run.trial194.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:52.418 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:52.418 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:52.454 DEBUG:teuthology.orchestra.run.trial194:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:14:52.777 INFO:teuthology.orchestra.run.trial194.stdout:Last metadata expiration check: 0:47:53 ago on Tue 24 Feb 2026 06:26:59 PM UTC. 2026-02-24T19:14:52.863 INFO:teuthology.orchestra.run.trial194.stdout:Dependencies resolved. 2026-02-24T19:14:52.864 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:52.864 INFO:teuthology.orchestra.run.trial194.stdout: Package Arch Version Repo Size 2026-02-24T19:14:52.864 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:52.864 INFO:teuthology.orchestra.run.trial194.stdout:Installing: 2026-02-24T19:14:52.864 INFO:teuthology.orchestra.run.trial194.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:14:52.864 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:52.864 INFO:teuthology.orchestra.run.trial194.stdout:Transaction Summary 2026-02-24T19:14:52.864 INFO:teuthology.orchestra.run.trial194.stdout:================================================================================ 2026-02-24T19:14:52.864 INFO:teuthology.orchestra.run.trial194.stdout:Install 1 Package 2026-02-24T19:14:52.865 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:52.865 INFO:teuthology.orchestra.run.trial194.stdout:Total download size: 2.4 M 2026-02-24T19:14:52.865 INFO:teuthology.orchestra.run.trial194.stdout:Installed size: 12 M 2026-02-24T19:14:52.865 INFO:teuthology.orchestra.run.trial194.stdout:Downloading Packages: 2026-02-24T19:14:53.512 INFO:teuthology.orchestra.run.trial194.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 3.8 MB/s | 2.4 MB 00:00 2026-02-24T19:14:53.513 INFO:teuthology.orchestra.run.trial194.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:53.513 INFO:teuthology.orchestra.run.trial194.stdout:Total 3.8 MB/s | 2.4 MB 00:00 2026-02-24T19:14:53.513 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction check 2026-02-24T19:14:53.515 INFO:teuthology.orchestra.run.trial194.stdout:Transaction check succeeded. 2026-02-24T19:14:53.515 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction test 2026-02-24T19:14:53.539 INFO:teuthology.orchestra.run.trial194.stdout:Transaction test succeeded. 2026-02-24T19:14:53.540 INFO:teuthology.orchestra.run.trial194.stdout:Running transaction 2026-02-24T19:14:53.700 INFO:teuthology.orchestra.run.trial194.stdout: Preparing : 1/1 2026-02-24T19:14:53.718 INFO:teuthology.orchestra.run.trial194.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:53.787 INFO:teuthology.orchestra.run.trial194.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:53.850 INFO:teuthology.orchestra.run.trial194.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:53.851 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:53.851 INFO:teuthology.orchestra.run.trial194.stdout:Installed: 2026-02-24T19:14:53.851 INFO:teuthology.orchestra.run.trial194.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:53.851 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:14:53.851 INFO:teuthology.orchestra.run.trial194.stdout:Complete! 2026-02-24T19:14:53.885 DEBUG:teuthology.parallel:result is None 2026-02-24T19:15:22.521 INFO:teuthology.orchestra.run.trial179.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 9.5 MB/s | 343 MB 00:36 2026-02-24T19:15:22.522 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:22.522 INFO:teuthology.orchestra.run.trial179.stdout:Total 9.5 MB/s | 343 MB 00:36 2026-02-24T19:15:22.522 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:15:22.524 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:15:22.524 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:15:23.555 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:15:23.555 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:15:30.209 INFO:teuthology.orchestra.run.trial045.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 4.2 MB/s | 343 MB 01:21 2026-02-24T19:15:30.210 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:30.210 INFO:teuthology.orchestra.run.trial045.stdout:Total 4.2 MB/s | 343 MB 01:21 2026-02-24T19:15:30.210 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:15:30.212 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:15:30.212 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:15:31.235 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:15:31.235 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:15:40.829 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:15:40.846 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:42.091 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:42.152 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:42.152 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:42.153 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:15:42.153 INFO:teuthology.orchestra.run.trial179.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:42.153 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:42.153 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:15:42.209 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:15:42.525 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:49:40 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 10 M 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 51 M 2026-02-24T19:15:42.611 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:15:43.018 INFO:teuthology.orchestra.run.trial179.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 25 MB/s | 10 MB 00:00 2026-02-24T19:15:43.018 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:43.019 INFO:teuthology.orchestra.run.trial179.stdout:Total 25 MB/s | 10 MB 00:00 2026-02-24T19:15:43.019 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:15:43.021 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:15:43.021 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:15:43.068 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:15:43.068 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:15:43.622 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:15:43.639 INFO:teuthology.orchestra.run.trial179.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:43.741 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:43.802 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:43.802 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:43.802 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:15:43.802 INFO:teuthology.orchestra.run.trial179.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:43.803 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:43.803 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:15:43.831 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:15:44.145 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:49:42 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 144 k 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 802 k 2026-02-24T19:15:44.228 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:15:44.315 INFO:teuthology.orchestra.run.trial179.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 1.6 MB/s | 144 kB 00:00 2026-02-24T19:15:44.315 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:44.315 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.6 MB/s | 144 kB 00:00 2026-02-24T19:15:44.315 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:15:44.317 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:15:44.317 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:15:44.334 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:15:44.335 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:15:44.375 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:15:44.392 INFO:teuthology.orchestra.run.trial179.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:44.451 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:44.512 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:44.512 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:44.512 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:15:44.512 INFO:teuthology.orchestra.run.trial179.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:44.512 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:44.512 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:15:44.538 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:15:44.850 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:49:42 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:15:44.934 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 9.1 M 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 46 M 2026-02-24T19:15:44.935 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:15:45.231 INFO:teuthology.orchestra.run.trial179.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 31 MB/s | 9.1 MB 00:00 2026-02-24T19:15:45.232 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:45.232 INFO:teuthology.orchestra.run.trial179.stdout:Total 31 MB/s | 9.1 MB 00:00 2026-02-24T19:15:45.232 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:15:45.234 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:15:45.234 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:15:45.278 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:15:45.279 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:15:45.803 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:15:45.821 INFO:teuthology.orchestra.run.trial179.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:45.916 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:45.977 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:45.978 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:45.978 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:15:45.978 INFO:teuthology.orchestra.run.trial179.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:45.978 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:45.978 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:15:46.005 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install librados2-debuginfo 2026-02-24T19:15:46.315 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:49:44 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:15:46.398 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:15:46.398 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:46.398 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 63 M 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 397 M 2026-02-24T19:15:46.399 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:15:48.238 INFO:teuthology.orchestra.run.trial179.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 35 MB/s | 63 MB 00:01 2026-02-24T19:15:48.239 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:48.239 INFO:teuthology.orchestra.run.trial179.stdout:Total 35 MB/s | 63 MB 00:01 2026-02-24T19:15:48.239 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:15:48.241 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:15:48.241 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:15:48.447 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:15:48.448 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:15:48.464 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:15:48.481 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:49.732 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:49.795 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:49.795 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:49.795 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:15:49.795 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:49.795 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:49.795 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:15:49.850 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:15:50.165 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:49:45 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:15:50.249 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:15:50.250 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:50.251 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 10 M 2026-02-24T19:15:50.252 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 51 M 2026-02-24T19:15:50.252 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:15:50.535 INFO:teuthology.orchestra.run.trial045.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 36 MB/s | 10 MB 00:00 2026-02-24T19:15:50.536 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:50.536 INFO:teuthology.orchestra.run.trial045.stdout:Total 36 MB/s | 10 MB 00:00 2026-02-24T19:15:50.537 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:15:50.538 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:15:50.538 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:15:50.584 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:15:50.585 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:15:51.133 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:15:51.151 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:51.248 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:51.310 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:51.310 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:51.310 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:15:51.310 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:51.311 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:51.311 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:15:51.338 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:15:51.653 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:49:46 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:15:51.736 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:15:51.736 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:51.737 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 144 k 2026-02-24T19:15:51.738 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 802 k 2026-02-24T19:15:51.738 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:15:51.822 INFO:teuthology.orchestra.run.trial045.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 1.7 MB/s | 144 kB 00:00 2026-02-24T19:15:51.822 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:51.823 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.6 MB/s | 144 kB 00:00 2026-02-24T19:15:51.823 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:15:51.824 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:15:51.825 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:15:51.842 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:15:51.842 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:15:51.883 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:15:51.900 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:51.959 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:52.016 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:15:52.021 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:52.021 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:52.021 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:15:52.021 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:52.021 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:52.022 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:15:52.033 INFO:teuthology.orchestra.run.trial179.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:52.047 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:15:52.364 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:49:47 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:15:52.377 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:52.438 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:52.438 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:52.438 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:15:52.438 INFO:teuthology.orchestra.run.trial179.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:52.439 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:52.439 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:15:52.446 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:15:52.447 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:52.447 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:15:52.447 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:52.447 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:15:52.447 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:15:52.447 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:52.447 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:15:52.448 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:52.448 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:15:52.448 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:52.448 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 9.1 M 2026-02-24T19:15:52.448 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 46 M 2026-02-24T19:15:52.448 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:15:52.471 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:15:52.782 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:49:50 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:15:52.866 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:15:52.867 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:52.867 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:15:52.867 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 80 M 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 406 M 2026-02-24T19:15:52.868 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:15:53.723 INFO:teuthology.orchestra.run.trial045.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 7.1 MB/s | 9.1 MB 00:01 2026-02-24T19:15:53.724 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:53.724 INFO:teuthology.orchestra.run.trial045.stdout:Total 7.1 MB/s | 9.1 MB 00:01 2026-02-24T19:15:53.724 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:15:53.726 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:15:53.726 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:15:53.769 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:15:53.770 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:15:54.266 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:15:54.284 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:54.377 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:54.439 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:54.439 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:54.439 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:15:54.439 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:54.439 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:54.439 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:15:54.466 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados2-debuginfo 2026-02-24T19:15:54.778 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:49:49 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:15:54.861 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:15:54.862 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:54.862 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:15:54.862 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:54.862 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:15:54.862 INFO:teuthology.orchestra.run.trial045.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:15:54.862 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:54.862 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:15:54.862 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:15:54.863 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:15:54.863 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:15:54.863 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 63 M 2026-02-24T19:15:54.863 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 397 M 2026-02-24T19:15:54.863 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:15:55.155 INFO:teuthology.orchestra.run.trial179.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 35 MB/s | 80 MB 00:02 2026-02-24T19:15:55.156 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:55.156 INFO:teuthology.orchestra.run.trial179.stdout:Total 35 MB/s | 80 MB 00:02 2026-02-24T19:15:55.156 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:15:55.158 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:15:55.158 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:15:55.413 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:15:55.414 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:15:56.341 INFO:teuthology.orchestra.run.trial045.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 43 MB/s | 63 MB 00:01 2026-02-24T19:15:56.342 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:56.342 INFO:teuthology.orchestra.run.trial045.stdout:Total 43 MB/s | 63 MB 00:01 2026-02-24T19:15:56.342 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:15:56.344 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:15:56.344 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:15:56.549 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:15:56.549 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:15:59.662 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:15:59.680 INFO:teuthology.orchestra.run.trial179.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:00.040 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:00.102 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:00.102 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:00.102 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:16:00.102 INFO:teuthology.orchestra.run.trial179.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:00.102 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:00.102 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:16:00.103 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:16:00.119 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:16:00.137 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:16:00.446 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:49:58 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:16:00.474 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:16:00.528 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:16:00.529 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:00.529 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:16:00.529 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 645 k 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 2.3 M 2026-02-24T19:16:00.530 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:16:00.537 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:16:00.537 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:00.538 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:16:00.538 INFO:teuthology.orchestra.run.trial045.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:00.538 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:00.538 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:16:00.571 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:16:00.639 INFO:teuthology.orchestra.run.trial179.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 5.7 MB/s | 645 kB 00:00 2026-02-24T19:16:00.640 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:00.641 INFO:teuthology.orchestra.run.trial179.stdout:Total 5.7 MB/s | 645 kB 00:00 2026-02-24T19:16:00.641 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:16:00.642 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:16:00.642 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:16:00.662 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:16:00.662 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:16:00.729 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:16:00.746 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:16:00.810 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:16:00.871 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:16:00.871 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:00.872 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:16:00.872 INFO:teuthology.orchestra.run.trial179.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:00.872 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:00.872 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:16:00.888 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:49:55 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:00.899 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:16:00.975 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:16:00.976 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:00.976 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:16:00.976 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:00.976 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:16:00.976 INFO:teuthology.orchestra.run.trial045.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:16:00.976 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:00.976 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:16:00.977 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:00.977 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:16:00.977 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:00.977 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 80 M 2026-02-24T19:16:00.977 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 406 M 2026-02-24T19:16:00.977 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:16:01.212 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:49:59 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:16:01.296 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:16:01.297 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:01.297 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:16:01.297 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:01.297 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:16:01.297 INFO:teuthology.orchestra.run.trial179.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:16:01.297 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:01.297 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:16:01.297 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:01.298 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:16:01.298 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:01.298 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 802 k 2026-02-24T19:16:01.298 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 3.1 M 2026-02-24T19:16:01.298 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:16:01.980 INFO:teuthology.orchestra.run.trial179.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 1.1 MB/s | 802 kB 00:00 2026-02-24T19:16:01.981 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:01.981 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.1 MB/s | 802 kB 00:00 2026-02-24T19:16:01.981 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:16:01.983 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:16:01.983 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:16:02.003 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:16:02.003 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:16:02.075 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:16:02.092 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:16:02.153 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:16:02.214 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:16:02.215 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:02.215 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:16:02.215 INFO:teuthology.orchestra.run.trial179.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:02.215 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:02.215 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:16:02.241 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:16:02.552 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:50:00 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:16:02.637 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:16:02.638 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:02.638 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 1.2 M 2026-02-24T19:16:02.639 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 4.7 M 2026-02-24T19:16:02.640 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:16:03.693 INFO:teuthology.orchestra.run.trial179.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 1.1 MB/s | 1.2 MB 00:01 2026-02-24T19:16:03.693 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:03.693 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.1 MB/s | 1.2 MB 00:01 2026-02-24T19:16:03.694 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:16:03.695 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:16:03.695 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:16:03.717 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:16:03.717 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:16:03.813 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:16:03.830 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:03.892 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:03.954 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:03.954 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:03.954 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:16:03.954 INFO:teuthology.orchestra.run.trial179.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:03.954 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:03.954 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:16:03.980 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:16:04.293 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:50:02 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:16:04.378 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:16:04.379 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:04.380 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:16:04.380 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:04.380 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:16:04.380 INFO:teuthology.orchestra.run.trial179.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:16:04.380 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:04.380 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:16:04.380 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:04.380 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:16:04.380 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:04.381 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 350 k 2026-02-24T19:16:04.381 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 1.1 M 2026-02-24T19:16:04.381 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:16:04.605 INFO:teuthology.orchestra.run.trial179.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 1.5 MB/s | 350 kB 00:00 2026-02-24T19:16:04.605 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:04.605 INFO:teuthology.orchestra.run.trial179.stdout:Total 1.5 MB/s | 350 kB 00:00 2026-02-24T19:16:04.606 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:16:04.607 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:16:04.607 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:16:04.626 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:16:04.627 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:16:04.677 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:16:04.694 INFO:teuthology.orchestra.run.trial179.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:04.737 INFO:teuthology.orchestra.run.trial045.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 21 MB/s | 80 MB 00:03 2026-02-24T19:16:04.738 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:04.738 INFO:teuthology.orchestra.run.trial045.stdout:Total 21 MB/s | 80 MB 00:03 2026-02-24T19:16:04.739 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:16:04.740 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:16:04.741 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:16:04.756 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:04.818 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:04.818 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:04.818 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:16:04.818 INFO:teuthology.orchestra.run.trial179.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:04.818 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:04.818 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:16:04.845 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:16:04.996 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:16:04.996 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:16:05.158 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:50:03 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:16:05.244 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:16:05.245 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:05.246 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 1.5 M 2026-02-24T19:16:05.246 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 7.9 M 2026-02-24T19:16:05.246 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:16:05.749 INFO:teuthology.orchestra.run.trial179.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 3.0 MB/s | 1.5 MB 00:00 2026-02-24T19:16:05.749 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:05.749 INFO:teuthology.orchestra.run.trial179.stdout:Total 3.0 MB/s | 1.5 MB 00:00 2026-02-24T19:16:05.749 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:16:05.752 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:16:05.752 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:16:05.775 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:16:05.775 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:16:05.889 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:16:05.906 INFO:teuthology.orchestra.run.trial179.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:05.970 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:06.032 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:06.032 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:06.032 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:16:06.032 INFO:teuthology.orchestra.run.trial179.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:06.032 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:06.032 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:16:06.058 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:16:06.374 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:50:04 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:16:06.458 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 79 M 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 375 M 2026-02-24T19:16:06.459 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:16:09.117 INFO:teuthology.orchestra.run.trial179.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 30 MB/s | 79 MB 00:02 2026-02-24T19:16:09.118 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:09.118 INFO:teuthology.orchestra.run.trial179.stdout:Total 30 MB/s | 79 MB 00:02 2026-02-24T19:16:09.118 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:16:09.120 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:16:09.120 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:16:09.239 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:16:09.259 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:09.373 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:16:09.373 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:16:09.606 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:09.669 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:09.669 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:09.669 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:16:09.669 INFO:teuthology.orchestra.run.trial045.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:09.669 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:09.669 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:16:09.701 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:16:10.020 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:50:05 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:10.102 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 645 k 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 2.3 M 2026-02-24T19:16:10.103 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:16:10.585 INFO:teuthology.orchestra.run.trial045.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 1.3 MB/s | 645 kB 00:00 2026-02-24T19:16:10.586 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:10.586 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.3 MB/s | 645 kB 00:00 2026-02-24T19:16:10.586 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:16:10.588 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:16:10.588 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:16:10.607 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:16:10.608 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:16:10.672 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:16:10.689 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:16:10.750 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:16:10.811 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:16:10.812 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:10.812 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:16:10.812 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:10.812 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:10.812 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:16:10.837 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:16:11.151 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:50:06 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:11.234 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:16:11.235 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:11.236 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 802 k 2026-02-24T19:16:11.236 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 3.1 M 2026-02-24T19:16:11.236 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:16:11.846 INFO:teuthology.orchestra.run.trial045.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 1.3 MB/s | 802 kB 00:00 2026-02-24T19:16:11.846 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:11.846 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.3 MB/s | 802 kB 00:00 2026-02-24T19:16:11.846 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:16:11.848 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:16:11.848 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:16:11.868 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:16:11.868 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:16:11.941 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:16:11.958 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:16:12.020 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:16:12.082 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:16:12.082 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:12.082 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:16:12.082 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:12.083 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:12.083 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:16:12.109 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:16:12.424 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:50:07 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:12.507 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:16:12.507 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:12.508 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:16:12.508 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:12.508 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:16:12.508 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:16:12.508 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:12.508 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:16:12.508 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:12.508 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:16:12.509 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:12.509 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 1.2 M 2026-02-24T19:16:12.509 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 4.7 M 2026-02-24T19:16:12.509 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:16:12.628 INFO:teuthology.orchestra.run.trial045.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 9.7 MB/s | 1.2 MB 00:00 2026-02-24T19:16:12.629 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:12.629 INFO:teuthology.orchestra.run.trial045.stdout:Total 9.6 MB/s | 1.2 MB 00:00 2026-02-24T19:16:12.629 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:16:12.631 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:16:12.631 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:16:12.651 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:16:12.652 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:16:12.744 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:16:12.761 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:12.821 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:12.884 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:12.884 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:12.884 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:16:12.884 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:12.884 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:12.884 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:16:12.911 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:16:13.224 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:50:08 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:13.309 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:16:13.310 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:13.310 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:16:13.310 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:13.310 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:16:13.311 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:16:13.311 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:13.311 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:16:13.311 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:13.311 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:16:13.311 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:13.311 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 350 k 2026-02-24T19:16:13.311 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 1.1 M 2026-02-24T19:16:13.311 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:16:13.406 INFO:teuthology.orchestra.run.trial045.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 3.6 MB/s | 350 kB 00:00 2026-02-24T19:16:13.407 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:13.407 INFO:teuthology.orchestra.run.trial045.stdout:Total 3.5 MB/s | 350 kB 00:00 2026-02-24T19:16:13.408 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:16:13.409 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:16:13.409 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:16:13.428 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:16:13.429 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:16:13.479 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:16:13.496 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:13.554 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:13.583 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:16:13.601 INFO:teuthology.orchestra.run.trial179.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:13.616 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:13.616 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:13.616 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:16:13.616 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:13.616 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:13.616 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:16:13.642 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:16:13.928 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:13.955 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:50:08 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:13.989 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:13.989 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:13.990 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:16:13.990 INFO:teuthology.orchestra.run.trial179.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:13.990 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:13.990 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:16:14.024 DEBUG:teuthology.orchestra.run.trial179:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:16:14.039 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:16:14.040 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:14.041 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 1.5 M 2026-02-24T19:16:14.041 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 7.9 M 2026-02-24T19:16:14.041 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:16:14.164 INFO:teuthology.orchestra.run.trial045.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 12 MB/s | 1.5 MB 00:00 2026-02-24T19:16:14.164 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:14.165 INFO:teuthology.orchestra.run.trial045.stdout:Total 12 MB/s | 1.5 MB 00:00 2026-02-24T19:16:14.165 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:16:14.166 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:16:14.166 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:16:14.188 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:16:14.188 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:16:14.301 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:16:14.318 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:14.343 INFO:teuthology.orchestra.run.trial179.stdout:Last metadata expiration check: 0:50:12 ago on Tue 24 Feb 2026 06:26:02 PM UTC. 2026-02-24T19:16:14.387 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:14.429 INFO:teuthology.orchestra.run.trial179.stdout:Dependencies resolved. 2026-02-24T19:16:14.429 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout: Package Arch Version Repo Size 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout:Installing: 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout:Transaction Summary 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout:================================================================================ 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout:Install 1 Package 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:14.430 INFO:teuthology.orchestra.run.trial179.stdout:Total download size: 2.4 M 2026-02-24T19:16:14.431 INFO:teuthology.orchestra.run.trial179.stdout:Installed size: 12 M 2026-02-24T19:16:14.431 INFO:teuthology.orchestra.run.trial179.stdout:Downloading Packages: 2026-02-24T19:16:14.451 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:14.451 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:14.451 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:16:14.451 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:14.452 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:14.452 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:16:14.480 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:16:14.573 INFO:teuthology.orchestra.run.trial179.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 17 MB/s | 2.4 MB 00:00 2026-02-24T19:16:14.574 INFO:teuthology.orchestra.run.trial179.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:14.574 INFO:teuthology.orchestra.run.trial179.stdout:Total 17 MB/s | 2.4 MB 00:00 2026-02-24T19:16:14.574 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction check 2026-02-24T19:16:14.575 INFO:teuthology.orchestra.run.trial179.stdout:Transaction check succeeded. 2026-02-24T19:16:14.575 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction test 2026-02-24T19:16:14.601 INFO:teuthology.orchestra.run.trial179.stdout:Transaction test succeeded. 2026-02-24T19:16:14.601 INFO:teuthology.orchestra.run.trial179.stdout:Running transaction 2026-02-24T19:16:14.761 INFO:teuthology.orchestra.run.trial179.stdout: Preparing : 1/1 2026-02-24T19:16:14.778 INFO:teuthology.orchestra.run.trial179.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:14.797 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:50:09 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:14.854 INFO:teuthology.orchestra.run.trial179.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:14.882 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:16:14.882 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:14.883 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 79 M 2026-02-24T19:16:14.884 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 375 M 2026-02-24T19:16:14.884 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:16:14.916 INFO:teuthology.orchestra.run.trial179.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:14.917 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:14.917 INFO:teuthology.orchestra.run.trial179.stdout:Installed: 2026-02-24T19:16:14.917 INFO:teuthology.orchestra.run.trial179.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:14.917 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:14.917 INFO:teuthology.orchestra.run.trial179.stdout:Complete! 2026-02-24T19:16:14.947 DEBUG:teuthology.parallel:result is None 2026-02-24T19:16:16.605 INFO:teuthology.orchestra.run.trial045.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 46 MB/s | 79 MB 00:01 2026-02-24T19:16:16.606 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:16.606 INFO:teuthology.orchestra.run.trial045.stdout:Total 46 MB/s | 79 MB 00:01 2026-02-24T19:16:16.606 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:16:16.608 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:16:16.608 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:16:16.857 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:16:16.857 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:16:20.904 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:16:20.922 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:21.263 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:21.325 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:21.325 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:21.325 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:16:21.325 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:21.325 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:21.326 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:16:21.359 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:16:21.681 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:50:16 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:21.765 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-24T19:16:21.766 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:21.766 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-24T19:16:21.766 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:21.766 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-24T19:16:21.767 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:16:21.767 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:21.767 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-24T19:16:21.767 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-24T19:16:21.767 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-24T19:16:21.767 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:21.767 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 2.4 M 2026-02-24T19:16:21.767 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 12 M 2026-02-24T19:16:21.767 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-24T19:16:21.904 INFO:teuthology.orchestra.run.trial045.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 18 MB/s | 2.4 MB 00:00 2026-02-24T19:16:21.905 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:21.906 INFO:teuthology.orchestra.run.trial045.stdout:Total 17 MB/s | 2.4 MB 00:00 2026-02-24T19:16:21.906 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-24T19:16:21.907 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-24T19:16:21.907 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-24T19:16:21.933 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-24T19:16:21.933 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-24T19:16:22.093 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-24T19:16:22.111 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:22.180 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:22.242 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:22.242 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:22.243 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-24T19:16:22.243 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:22.243 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:22.243 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-24T19:16:22.274 DEBUG:teuthology.parallel:result is None 2026-02-24T19:16:22.275 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:16:22.441 DEBUG:teuthology.orchestra.run.trial045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:16:22.462 INFO:teuthology.orchestra.run.trial045.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:16:22.463 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:16:22.463 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:16:22.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:16:22.621 DEBUG:teuthology.orchestra.run.trial114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:16:22.643 INFO:teuthology.orchestra.run.trial114.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:16:22.643 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:16:22.643 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:16:22.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:16:22.798 DEBUG:teuthology.orchestra.run.trial179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:16:22.820 INFO:teuthology.orchestra.run.trial179.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:16:22.820 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:16:22.820 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:16:22.823 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:16:22.975 DEBUG:teuthology.orchestra.run.trial194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:16:22.996 INFO:teuthology.orchestra.run.trial194.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:16:22.997 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:16:22.997 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:16:23.000 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T19:16:23.000 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:23.000 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:16:23.028 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:23.028 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:16:23.053 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:23.054 DEBUG:teuthology.orchestra.run.trial179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:16:23.080 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:23.080 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:16:23.106 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T19:16:23.106 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:23.106 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:16:23.132 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:16:23.197 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:23.197 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:16:23.223 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:16:23.287 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:23.287 DEBUG:teuthology.orchestra.run.trial179:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:16:23.313 DEBUG:teuthology.orchestra.run.trial179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:16:23.376 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:23.377 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:16:23.402 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:16:23.466 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T19:16:23.466 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:23.467 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:16:23.492 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:16:23.556 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:23.556 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:16:23.581 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:16:23.645 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:23.646 DEBUG:teuthology.orchestra.run.trial179:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:16:23.671 DEBUG:teuthology.orchestra.run.trial179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:16:23.734 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:23.735 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:16:23.760 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:16:23.823 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T19:16:23.823 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:23.824 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:16:23.849 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:16:23.913 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:23.913 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:16:23.938 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:16:24.002 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:24.003 DEBUG:teuthology.orchestra.run.trial179:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:16:24.029 DEBUG:teuthology.orchestra.run.trial179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:16:24.093 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:24.093 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:16:24.119 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:16:24.182 INFO:teuthology.run_tasks:Running task ceph... 2026-02-24T19:16:24.297 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-24T19:16:24.298 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 777 /var/log/ceph 2026-02-24T19:16:24.299 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod 777 /var/log/ceph 2026-02-24T19:16:24.301 DEBUG:teuthology.orchestra.run.trial179:> sudo chmod 777 /var/log/ceph 2026-02-24T19:16:24.303 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod 777 /var/log/ceph 2026-02-24T19:16:24.327 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-24T19:16:24.327 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:16:24.364 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:16:24.367 DEBUG:teuthology.orchestra.run.trial179:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:16:24.369 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:16:24.392 INFO:tasks.ceph:Creating extra log directories... 2026-02-24T19:16:24.392 DEBUG:teuthology.orchestra.run.trial045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:16:24.428 DEBUG:teuthology.orchestra.run.trial114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:16:24.431 DEBUG:teuthology.orchestra.run.trial179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:16:24.433 DEBUG:teuthology.orchestra.run.trial194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:16:24.476 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-24T19:16:24.477 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-24T19:16:24.477 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688', 'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '68688', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'mon_bind_msgr2': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'owner': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 6877, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'targets': {'trial045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQHeVSiN7CqUHqrDxllnAKEkjPldQNVegkA9MljbIPMOXF4Ws3JKqfjlX9nAloTi9qyu4sK9Jnf/hMq4FQ5OCE=', 'trial114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOjgYlDhcMVpDDg3QOjc+bUhS5mYCPOk5c5J1iXGI2Wc0GYLDfGWJSJRdztrIHpSzdU4JEmlaId5bFALtu6R6nE=', 'trial179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBGULFW0EaBE4lgocfn7NHbfH5zh0UZNaVQMA50Qa0bhW5foMqUaLZmi6HSc3IRl3nQ28psJkOoJ2Md5nmchilY=', 'trial194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCXICk0rxqUzCYyNuL17SLiFiaomCsuBXi/rwuFEIvJlEc9R9oJdwduGHS9tTtuAnOnwvU/F0XMAESc9H5OLeMw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-24_16:27:17', 'tube': 'trial', 'user': 'jayaprakash', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-24T19:16:24.478 DEBUG:teuthology.orchestra.run.trial045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:16:24.492 DEBUG:teuthology.orchestra.run.trial114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:16:24.496 DEBUG:teuthology.orchestra.run.trial179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:16:24.498 DEBUG:teuthology.orchestra.run.trial194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:16:24.514 DEBUG:teuthology.orchestra.run.trial045:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:16:24.548 DEBUG:teuthology.orchestra.run.trial114:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:16:24.552 DEBUG:teuthology.orchestra.run.trial179:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:16:24.555 DEBUG:teuthology.orchestra.run.trial194:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:16:24.579 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:24.579 DEBUG:teuthology.orchestra.run.trial045:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:16:24.626 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:16:24.627 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_1 2026-02-24T19:16:24.683 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:16:24.683 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:24.683 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 918 Links: 1 2026-02-24T19:16:24.684 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:24.684 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:24.684 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-24 18:28:13.118547412 +0000 2026-02-24T19:16:24.684 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-24 18:25:31.491992242 +0000 2026-02-24T19:16:24.684 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-24 18:25:31.491992242 +0000 2026-02-24T19:16:24.684 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-24 18:25:31.491992242 +0000 2026-02-24T19:16:24.684 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:16:24.746 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-24T19:16:24.747 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-24T19:16:24.747 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000154285 s, 3.3 MB/s 2026-02-24T19:16:24.748 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:16:24.805 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_2 2026-02-24T19:16:24.860 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:16:24.861 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:24.861 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 943 Links: 1 2026-02-24T19:16:24.861 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:24.861 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:24.861 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-24 18:28:13.118547412 +0000 2026-02-24T19:16:24.861 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-24 18:25:31.727983131 +0000 2026-02-24T19:16:24.861 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-24 18:25:31.727983131 +0000 2026-02-24T19:16:24.861 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-24 18:25:31.727983131 +0000 2026-02-24T19:16:24.862 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:16:24.922 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-24T19:16:24.923 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-24T19:16:24.923 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000141713 s, 3.6 MB/s 2026-02-24T19:16:24.924 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:16:24.981 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_3 2026-02-24T19:16:25.037 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:16:25.037 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:25.037 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 972 Links: 1 2026-02-24T19:16:25.037 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:25.037 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:25.037 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-24 18:28:13.118547412 +0000 2026-02-24T19:16:25.037 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-24 18:25:31.980973364 +0000 2026-02-24T19:16:25.037 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-24 18:25:31.980973364 +0000 2026-02-24T19:16:25.037 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-24 18:25:31.980973364 +0000 2026-02-24T19:16:25.038 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:16:25.098 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-24T19:16:25.099 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-24T19:16:25.099 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000152212 s, 3.4 MB/s 2026-02-24T19:16:25.100 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:16:25.156 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_4 2026-02-24T19:16:25.212 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:16:25.212 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:25.213 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 1001 Links: 1 2026-02-24T19:16:25.213 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:25.213 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:25.213 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-24 18:28:13.118547412 +0000 2026-02-24T19:16:25.213 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-24 18:25:32.239963366 +0000 2026-02-24T19:16:25.213 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-24 18:25:32.239963366 +0000 2026-02-24T19:16:25.213 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-24 18:25:32.239963366 +0000 2026-02-24T19:16:25.213 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:16:25.275 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-24T19:16:25.275 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-24T19:16:25.275 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000163002 s, 3.1 MB/s 2026-02-24T19:16:25.277 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:16:25.334 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:25.334 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:25.334 DEBUG:teuthology.orchestra.run.trial114:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:16:25.353 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:16:25.353 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_1 2026-02-24T19:16:25.409 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:16:25.409 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:25.409 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 908 Links: 1 2026-02-24T19:16:25.409 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:25.409 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:25.409 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-24 18:27:59.645066139 +0000 2026-02-24T19:16:25.409 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-24 18:25:23.976161932 +0000 2026-02-24T19:16:25.409 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-24 18:25:23.976161932 +0000 2026-02-24T19:16:25.410 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-24 18:25:23.976161932 +0000 2026-02-24T19:16:25.410 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:16:25.471 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-24T19:16:25.472 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-24T19:16:25.472 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000157733 s, 3.2 MB/s 2026-02-24T19:16:25.473 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:16:25.530 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_2 2026-02-24T19:16:25.586 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:16:25.586 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:25.586 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 937 Links: 1 2026-02-24T19:16:25.586 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:25.587 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:25.587 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-24 18:27:59.645066139 +0000 2026-02-24T19:16:25.587 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-24 18:25:24.212152793 +0000 2026-02-24T19:16:25.587 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-24 18:25:24.212152793 +0000 2026-02-24T19:16:25.587 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-24 18:25:24.212152793 +0000 2026-02-24T19:16:25.587 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:16:25.649 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-24T19:16:25.649 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-24T19:16:25.649 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000142655 s, 3.6 MB/s 2026-02-24T19:16:25.650 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:16:25.709 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_3 2026-02-24T19:16:25.765 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:16:25.765 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:25.765 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 965 Links: 1 2026-02-24T19:16:25.765 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:25.765 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:25.765 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-24 18:27:59.646066116 +0000 2026-02-24T19:16:25.765 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-24 18:25:24.449143615 +0000 2026-02-24T19:16:25.765 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-24 18:25:24.449143615 +0000 2026-02-24T19:16:25.766 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-24 18:25:24.449143615 +0000 2026-02-24T19:16:25.766 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:16:25.827 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-24T19:16:25.827 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-24T19:16:25.827 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000156552 s, 3.3 MB/s 2026-02-24T19:16:25.829 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:16:25.885 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_4 2026-02-24T19:16:25.941 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:16:25.942 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:25.942 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 993 Links: 1 2026-02-24T19:16:25.942 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:25.942 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:25.942 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-24 18:27:59.646066116 +0000 2026-02-24T19:16:25.942 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-24 18:25:24.680134670 +0000 2026-02-24T19:16:25.942 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-24 18:25:24.680134670 +0000 2026-02-24T19:16:25.942 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-24 18:25:24.680134670 +0000 2026-02-24T19:16:25.943 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:16:26.005 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-24T19:16:26.005 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-24T19:16:26.005 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000142726 s, 3.6 MB/s 2026-02-24T19:16:26.006 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:16:26.063 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:26.064 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:26.064 DEBUG:teuthology.orchestra.run.trial179:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:16:26.082 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:16:26.082 DEBUG:teuthology.orchestra.run.trial179:> stat /dev/vg_nvme/lv_1 2026-02-24T19:16:26.138 INFO:teuthology.orchestra.run.trial179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:16:26.138 INFO:teuthology.orchestra.run.trial179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:26.138 INFO:teuthology.orchestra.run.trial179.stdout:Device: 6h/6d Inode: 902 Links: 1 2026-02-24T19:16:26.138 INFO:teuthology.orchestra.run.trial179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:26.138 INFO:teuthology.orchestra.run.trial179.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:26.139 INFO:teuthology.orchestra.run.trial179.stdout:Access: 2026-02-24 18:27:43.216358195 +0000 2026-02-24T19:16:26.139 INFO:teuthology.orchestra.run.trial179.stdout:Modify: 2026-02-24 18:25:23.490874435 +0000 2026-02-24T19:16:26.139 INFO:teuthology.orchestra.run.trial179.stdout:Change: 2026-02-24 18:25:23.490874435 +0000 2026-02-24T19:16:26.139 INFO:teuthology.orchestra.run.trial179.stdout: Birth: 2026-02-24 18:25:23.490874435 +0000 2026-02-24T19:16:26.139 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:16:26.200 INFO:teuthology.orchestra.run.trial179.stderr:1+0 records in 2026-02-24T19:16:26.200 INFO:teuthology.orchestra.run.trial179.stderr:1+0 records out 2026-02-24T19:16:26.200 INFO:teuthology.orchestra.run.trial179.stderr:512 bytes copied, 0.00015062 s, 3.4 MB/s 2026-02-24T19:16:26.202 DEBUG:teuthology.orchestra.run.trial179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:16:26.259 DEBUG:teuthology.orchestra.run.trial179:> stat /dev/vg_nvme/lv_2 2026-02-24T19:16:26.315 INFO:teuthology.orchestra.run.trial179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:16:26.315 INFO:teuthology.orchestra.run.trial179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:26.315 INFO:teuthology.orchestra.run.trial179.stdout:Device: 6h/6d Inode: 929 Links: 1 2026-02-24T19:16:26.316 INFO:teuthology.orchestra.run.trial179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:26.316 INFO:teuthology.orchestra.run.trial179.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:26.316 INFO:teuthology.orchestra.run.trial179.stdout:Access: 2026-02-24 18:27:43.216358195 +0000 2026-02-24T19:16:26.316 INFO:teuthology.orchestra.run.trial179.stdout:Modify: 2026-02-24 18:25:23.721865472 +0000 2026-02-24T19:16:26.316 INFO:teuthology.orchestra.run.trial179.stdout:Change: 2026-02-24 18:25:23.721865472 +0000 2026-02-24T19:16:26.316 INFO:teuthology.orchestra.run.trial179.stdout: Birth: 2026-02-24 18:25:23.721865472 +0000 2026-02-24T19:16:26.316 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:16:26.379 INFO:teuthology.orchestra.run.trial179.stderr:1+0 records in 2026-02-24T19:16:26.379 INFO:teuthology.orchestra.run.trial179.stderr:1+0 records out 2026-02-24T19:16:26.379 INFO:teuthology.orchestra.run.trial179.stderr:512 bytes copied, 0.000151271 s, 3.4 MB/s 2026-02-24T19:16:26.380 DEBUG:teuthology.orchestra.run.trial179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:16:26.437 DEBUG:teuthology.orchestra.run.trial179:> stat /dev/vg_nvme/lv_3 2026-02-24T19:16:26.494 INFO:teuthology.orchestra.run.trial179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:16:26.494 INFO:teuthology.orchestra.run.trial179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:26.494 INFO:teuthology.orchestra.run.trial179.stdout:Device: 6h/6d Inode: 957 Links: 1 2026-02-24T19:16:26.494 INFO:teuthology.orchestra.run.trial179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:26.494 INFO:teuthology.orchestra.run.trial179.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:26.494 INFO:teuthology.orchestra.run.trial179.stdout:Access: 2026-02-24 18:27:43.216358195 +0000 2026-02-24T19:16:26.494 INFO:teuthology.orchestra.run.trial179.stdout:Modify: 2026-02-24 18:25:23.970855810 +0000 2026-02-24T19:16:26.494 INFO:teuthology.orchestra.run.trial179.stdout:Change: 2026-02-24 18:25:23.970855810 +0000 2026-02-24T19:16:26.494 INFO:teuthology.orchestra.run.trial179.stdout: Birth: 2026-02-24 18:25:23.970855810 +0000 2026-02-24T19:16:26.495 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:16:26.557 INFO:teuthology.orchestra.run.trial179.stderr:1+0 records in 2026-02-24T19:16:26.557 INFO:teuthology.orchestra.run.trial179.stderr:1+0 records out 2026-02-24T19:16:26.557 INFO:teuthology.orchestra.run.trial179.stderr:512 bytes copied, 0.000145401 s, 3.5 MB/s 2026-02-24T19:16:26.558 DEBUG:teuthology.orchestra.run.trial179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:16:26.614 DEBUG:teuthology.orchestra.run.trial179:> stat /dev/vg_nvme/lv_4 2026-02-24T19:16:26.670 INFO:teuthology.orchestra.run.trial179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:16:26.670 INFO:teuthology.orchestra.run.trial179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:26.670 INFO:teuthology.orchestra.run.trial179.stdout:Device: 6h/6d Inode: 986 Links: 1 2026-02-24T19:16:26.670 INFO:teuthology.orchestra.run.trial179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:26.671 INFO:teuthology.orchestra.run.trial179.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:26.671 INFO:teuthology.orchestra.run.trial179.stdout:Access: 2026-02-24 18:27:43.217358177 +0000 2026-02-24T19:16:26.671 INFO:teuthology.orchestra.run.trial179.stdout:Modify: 2026-02-24 18:25:24.194847119 +0000 2026-02-24T19:16:26.671 INFO:teuthology.orchestra.run.trial179.stdout:Change: 2026-02-24 18:25:24.194847119 +0000 2026-02-24T19:16:26.671 INFO:teuthology.orchestra.run.trial179.stdout: Birth: 2026-02-24 18:25:24.194847119 +0000 2026-02-24T19:16:26.671 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:16:26.732 INFO:teuthology.orchestra.run.trial179.stderr:1+0 records in 2026-02-24T19:16:26.732 INFO:teuthology.orchestra.run.trial179.stderr:1+0 records out 2026-02-24T19:16:26.732 INFO:teuthology.orchestra.run.trial179.stderr:512 bytes copied, 0.000143858 s, 3.6 MB/s 2026-02-24T19:16:26.733 DEBUG:teuthology.orchestra.run.trial179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:16:26.791 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:26.791 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:26.791 DEBUG:teuthology.orchestra.run.trial194:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:16:26.810 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:16:26.810 DEBUG:teuthology.orchestra.run.trial194:> stat /dev/vg_nvme/lv_1 2026-02-24T19:16:26.866 INFO:teuthology.orchestra.run.trial194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:16:26.866 INFO:teuthology.orchestra.run.trial194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:26.866 INFO:teuthology.orchestra.run.trial194.stdout:Device: 6h/6d Inode: 982 Links: 1 2026-02-24T19:16:26.866 INFO:teuthology.orchestra.run.trial194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:26.867 INFO:teuthology.orchestra.run.trial194.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:26.867 INFO:teuthology.orchestra.run.trial194.stdout:Access: 2026-02-24 18:29:17.021065049 +0000 2026-02-24T19:16:26.867 INFO:teuthology.orchestra.run.trial194.stdout:Modify: 2026-02-24 18:25:24.539079745 +0000 2026-02-24T19:16:26.867 INFO:teuthology.orchestra.run.trial194.stdout:Change: 2026-02-24 18:25:24.539079745 +0000 2026-02-24T19:16:26.867 INFO:teuthology.orchestra.run.trial194.stdout: Birth: 2026-02-24 18:25:24.539079745 +0000 2026-02-24T19:16:26.867 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:16:26.929 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records in 2026-02-24T19:16:26.929 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records out 2026-02-24T19:16:26.930 INFO:teuthology.orchestra.run.trial194.stderr:512 bytes copied, 0.000162001 s, 3.2 MB/s 2026-02-24T19:16:26.931 DEBUG:teuthology.orchestra.run.trial194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:16:26.989 DEBUG:teuthology.orchestra.run.trial194:> stat /dev/vg_nvme/lv_2 2026-02-24T19:16:27.045 INFO:teuthology.orchestra.run.trial194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:16:27.045 INFO:teuthology.orchestra.run.trial194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:27.045 INFO:teuthology.orchestra.run.trial194.stdout:Device: 6h/6d Inode: 1010 Links: 1 2026-02-24T19:16:27.045 INFO:teuthology.orchestra.run.trial194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:27.045 INFO:teuthology.orchestra.run.trial194.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:27.046 INFO:teuthology.orchestra.run.trial194.stdout:Access: 2026-02-24 18:29:17.022065036 +0000 2026-02-24T19:16:27.046 INFO:teuthology.orchestra.run.trial194.stdout:Modify: 2026-02-24 18:25:24.777073056 +0000 2026-02-24T19:16:27.046 INFO:teuthology.orchestra.run.trial194.stdout:Change: 2026-02-24 18:25:24.777073056 +0000 2026-02-24T19:16:27.046 INFO:teuthology.orchestra.run.trial194.stdout: Birth: 2026-02-24 18:25:24.777073056 +0000 2026-02-24T19:16:27.046 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:16:27.107 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records in 2026-02-24T19:16:27.107 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records out 2026-02-24T19:16:27.107 INFO:teuthology.orchestra.run.trial194.stderr:512 bytes copied, 0.000144459 s, 3.5 MB/s 2026-02-24T19:16:27.109 DEBUG:teuthology.orchestra.run.trial194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:16:27.165 DEBUG:teuthology.orchestra.run.trial194:> stat /dev/vg_nvme/lv_3 2026-02-24T19:16:27.221 INFO:teuthology.orchestra.run.trial194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:16:27.221 INFO:teuthology.orchestra.run.trial194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:27.222 INFO:teuthology.orchestra.run.trial194.stdout:Device: 6h/6d Inode: 1043 Links: 1 2026-02-24T19:16:27.222 INFO:teuthology.orchestra.run.trial194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:27.222 INFO:teuthology.orchestra.run.trial194.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:27.222 INFO:teuthology.orchestra.run.trial194.stdout:Access: 2026-02-24 18:29:17.022065036 +0000 2026-02-24T19:16:27.222 INFO:teuthology.orchestra.run.trial194.stdout:Modify: 2026-02-24 18:25:25.000066789 +0000 2026-02-24T19:16:27.222 INFO:teuthology.orchestra.run.trial194.stdout:Change: 2026-02-24 18:25:25.000066789 +0000 2026-02-24T19:16:27.222 INFO:teuthology.orchestra.run.trial194.stdout: Birth: 2026-02-24 18:25:25.000066789 +0000 2026-02-24T19:16:27.222 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:16:27.283 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records in 2026-02-24T19:16:27.283 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records out 2026-02-24T19:16:27.284 INFO:teuthology.orchestra.run.trial194.stderr:512 bytes copied, 0.00016122 s, 3.2 MB/s 2026-02-24T19:16:27.285 DEBUG:teuthology.orchestra.run.trial194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:16:27.342 DEBUG:teuthology.orchestra.run.trial194:> stat /dev/vg_nvme/lv_4 2026-02-24T19:16:27.399 INFO:teuthology.orchestra.run.trial194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:16:27.399 INFO:teuthology.orchestra.run.trial194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:27.399 INFO:teuthology.orchestra.run.trial194.stdout:Device: 6h/6d Inode: 1072 Links: 1 2026-02-24T19:16:27.399 INFO:teuthology.orchestra.run.trial194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:27.399 INFO:teuthology.orchestra.run.trial194.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:27.399 INFO:teuthology.orchestra.run.trial194.stdout:Access: 2026-02-24 18:29:17.023065022 +0000 2026-02-24T19:16:27.399 INFO:teuthology.orchestra.run.trial194.stdout:Modify: 2026-02-24 18:25:25.236060157 +0000 2026-02-24T19:16:27.399 INFO:teuthology.orchestra.run.trial194.stdout:Change: 2026-02-24 18:25:25.236060157 +0000 2026-02-24T19:16:27.399 INFO:teuthology.orchestra.run.trial194.stdout: Birth: 2026-02-24 18:25:25.236060157 +0000 2026-02-24T19:16:27.400 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:16:27.460 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records in 2026-02-24T19:16:27.460 INFO:teuthology.orchestra.run.trial194.stderr:1+0 records out 2026-02-24T19:16:27.461 INFO:teuthology.orchestra.run.trial194.stderr:512 bytes copied, 0.000131925 s, 3.9 MB/s 2026-02-24T19:16:27.462 DEBUG:teuthology.orchestra.run.trial194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:16:27.518 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:27.518 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial114.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial179.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial194.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-24T19:16:27.518 INFO:tasks.ceph:Generating config... 2026-02-24T19:16:27.520 INFO:tasks.ceph:[client] debug monc = 20 2026-02-24T19:16:27.521 INFO:tasks.ceph:[client] debug ms = 1 2026-02-24T19:16:27.521 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-24T19:16:27.521 INFO:tasks.ceph:[client] debug rados = 20 2026-02-24T19:16:27.521 INFO:tasks.ceph:[client] rados replica read policy = balance 2026-02-24T19:16:27.521 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-24T19:16:27.521 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-24T19:16:27.521 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-24T19:16:27.521 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-24T19:16:27.521 INFO:tasks.ceph:[global] ms type = async 2026-02-24T19:16:27.521 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-24T19:16:27.521 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-24T19:16:27.522 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-24T19:16:27.523 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] bluestore allocator = btree 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] bluestore onode segment size = 0 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] crush location = root=default host=host-$id 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-24T19:16:27.523 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-24T19:16:27.524 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-24T19:16:27.525 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-24T19:16:27.525 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-24T19:16:27.525 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-24T19:16:27.525 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-24T19:16:27.525 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-24T19:16:27.525 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-24T19:16:27.525 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-24T19:16:27.525 INFO:tasks.ceph:Setting up mon.a... 2026-02-24T19:16:27.525 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-24T19:16:27.561 INFO:teuthology.orchestra.run.trial045.stdout:creating /etc/ceph/ceph.keyring 2026-02-24T19:16:27.564 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-24T19:16:27.640 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:27.703 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.45:6789]'), ('mon.b', '[v1:10.20.193.114:6789]'), ('mon.c', '[v1:10.20.193.179:6789]')] 2026-02-24T19:16:27.704 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.45:6789],[v1:10.20.193.114:6789],[v1:10.20.193.179:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-24T19:16:27.706 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:27.706 DEBUG:teuthology.orchestra.run.trial045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T19:16:27.760 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.45:6789]' --addv b '[v1:10.20.193.114:6789]' --addv c '[v1:10.20.193.179:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:27.835 INFO:teuthology.orchestra.run.trial045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:27.835 INFO:teuthology.orchestra.run.trial045.stdout:monmaptool: generated fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:16:27.835 INFO:teuthology.orchestra.run.trial045.stdout:setting min_mon_release = tentacle 2026-02-24T19:16:27.835 INFO:teuthology.orchestra.run.trial045.stdout:epoch 0 2026-02-24T19:16:27.835 INFO:teuthology.orchestra.run.trial045.stdout:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:16:27.835 INFO:teuthology.orchestra.run.trial045.stdout:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:16:27.835 INFO:teuthology.orchestra.run.trial045.stdout:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:16:27.835 INFO:teuthology.orchestra.run.trial045.stdout:min_mon_release 20 (tentacle) 2026-02-24T19:16:27.836 INFO:teuthology.orchestra.run.trial045.stdout:election_strategy: 3 2026-02-24T19:16:27.836 INFO:teuthology.orchestra.run.trial045.stdout:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:16:27.836 INFO:teuthology.orchestra.run.trial045.stdout:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:16:27.836 INFO:teuthology.orchestra.run.trial045.stdout:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:16:27.836 INFO:teuthology.orchestra.run.trial045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-24T19:16:27.837 DEBUG:teuthology.orchestra.run.trial045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T19:16:27.892 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 738dd6f3-d81f-41eb-89dc-068883b21f11... 2026-02-24T19:16:27.894 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:16:27.935 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:16:27.937 DEBUG:teuthology.orchestra.run.trial179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:16:27.940 DEBUG:teuthology.orchestra.run.trial194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:16:27.973 INFO:teuthology.orchestra.run.trial045.stdout:[global] 2026-02-24T19:16:27.973 INFO:teuthology.orchestra.run.trial045.stdout: chdir = "" 2026-02-24T19:16:27.973 INFO:teuthology.orchestra.run.trial045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:16:27.973 INFO:teuthology.orchestra.run.trial045.stdout: auth supported = cephx 2026-02-24T19:16:27.973 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.973 INFO:teuthology.orchestra.run.trial045.stdout: filestore xattr use omap = true 2026-02-24T19:16:27.973 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.973 INFO:teuthology.orchestra.run.trial045.stdout: mon clock drift allowed = 1.000 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: osd crush chooseleaf type = 0 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: auth debug = true 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: ms die on old message = true 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: ms die on bug = true 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: mon pg warn max object skew = 0 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:16:27.974 INFO:teuthology.orchestra.run.trial045.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: osd pool default size = 2 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: mon osd allow primary affinity = true 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: mon osd allow pg remap = true 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on no sortbitwise = false 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on too few osds = false 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:16:27.975 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: mon_allow_pool_size_one = true 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: osd default data pool replay window = 5 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: mon allow pool delete = true 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: mon cluster log file level = debug 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: debug asserts on shutdown = true 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: mon health detail to clog = false 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: mon host = "[v1:10.20.193.45:6789],[v1:10.20.193.114:6789],[v1:10.20.193.179:6789]" 2026-02-24T19:16:27.976 INFO:teuthology.orchestra.run.trial045.stdout: mon client directed command retry = 5 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: mon election default strategy = 3 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: ms bind msgr2 = False 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: ms inject socket failures = 5000 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: ms type = async 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: osd heartbeat grace = 160 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: osd op thread timeout = 150 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: fsid = 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout:[osd] 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: osd journal size = 100 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.977 INFO:teuthology.orchestra.run.trial045.stdout: osd scrub load threshold = 5.0 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd scrub max interval = 600 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd mclock skip benchmark = True 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd recover clone overlap = true 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd recovery max chunk = 1048576 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd debug shutdown = true 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd debug op order = true 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd debug verify stray on activate = true 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd debug trim objects = true 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.978 INFO:teuthology.orchestra.run.trial045.stdout: osd open classes on start = true 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: osd debug pg log writeout = true 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: osd map max advance = 10 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: journal zero on create = true 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: filestore apply finisher threads = 3 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: bdev debug aio = true 2026-02-24T19:16:27.979 INFO:teuthology.orchestra.run.trial045.stdout: osd debug misdirected ops = true 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: bdev async discard = True 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: bdev enable discard = True 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: bluestore allocator = btree 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: bluestore block size = 96636764160 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: bluestore fsck on mount = True 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: bluestore onode segment size = 0 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: bluestore write v2 random = True 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: bluestore zero block detection = True 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: crush location = root=default host=host-$id 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: debug bluefs = 1 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: debug bluestore = 1 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: debug monc = 20 2026-02-24T19:16:27.980 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: debug osd = 20 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: debug rocksdb = 10 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: mon osd full ratio = 0.9 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: osd class default list = * 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: osd class load list = * 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: osd client watch timeout = 240 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: osd debug verify cached snaps = True 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: osd debug verify missing on start = True 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: osd fast shutdown = False 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: osd mclock override recovery settings = True 2026-02-24T19:16:27.981 INFO:teuthology.orchestra.run.trial045.stdout: osd objectstore = bluestore 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: osd op queue = debug_random 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: osd op queue cut off = debug_random 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: osd shutdown pgref assert = True 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout:[mgr] 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: debug mgr = 20 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: debug mon = 20 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: debug auth = 20 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:27.982 INFO:teuthology.orchestra.run.trial045.stdout: mgr/telemetry/nag = false 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout:[mon] 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: debug mon = 20 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: debug paxos = 20 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: debug auth = 20 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: mon data avail warn = 5 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: mon mgr mkfs grace = 240 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: mon osd reporter subtree level = osd 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: mon osd prime pg temp = true 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:27.983 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: # 1m isn't quite enough 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.984 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: mon min osdmap epochs = 50 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: mon osd crush smoke test = False 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: mon osdmap full prune interval = 2 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: mon osdmap full prune min = 15 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: mon scrub interval = 300 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on pool no app = False 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: paxos service trim min = 10 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout:[client] 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: rgw cache enabled = true 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: rgw enable ops log = true 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: rgw enable usage log = true 2026-02-24T19:16:27.985 INFO:teuthology.orchestra.run.trial045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:16:27.986 INFO:teuthology.orchestra.run.trial045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:16:27.986 INFO:teuthology.orchestra.run.trial045.stdout: debug monc = 20 2026-02-24T19:16:27.986 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-24T19:16:27.986 INFO:teuthology.orchestra.run.trial045.stdout: debug objecter = 20 2026-02-24T19:16:27.986 INFO:teuthology.orchestra.run.trial045.stdout: debug rados = 20 2026-02-24T19:16:27.986 INFO:teuthology.orchestra.run.trial045.stdout: rados replica read policy = balance 2026-02-24T19:16:27.986 INFO:teuthology.orchestra.run.trial045.stdout:[mon.a] 2026-02-24T19:16:27.986 INFO:teuthology.orchestra.run.trial045.stdout:[mon.b] 2026-02-24T19:16:27.986 INFO:teuthology.orchestra.run.trial045.stdout:[mon.c] 2026-02-24T19:16:27.987 INFO:teuthology.orchestra.run.trial194.stdout:[global] 2026-02-24T19:16:27.987 INFO:teuthology.orchestra.run.trial194.stdout: chdir = "" 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: auth supported = cephx 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: filestore xattr use omap = true 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: mon clock drift allowed = 1.000 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: osd crush chooseleaf type = 0 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: auth debug = true 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.988 INFO:teuthology.orchestra.run.trial194.stdout: ms die on old message = true 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: ms die on bug = true 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: mon pg warn max object skew = 0 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: osd pool default size = 2 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: mon osd allow primary affinity = true 2026-02-24T19:16:27.989 INFO:teuthology.orchestra.run.trial194.stdout: mon osd allow pg remap = true 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: mon warn on no sortbitwise = false 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: mon warn on too few osds = false 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: mon_allow_pool_size_one = true 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: osd default data pool replay window = 5 2026-02-24T19:16:27.990 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: mon allow pool delete = true 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: mon cluster log file level = debug 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: debug asserts on shutdown = true 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: mon health detail to clog = false 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: mon host = "[v1:10.20.193.45:6789],[v1:10.20.193.114:6789],[v1:10.20.193.179:6789]" 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: mon client directed command retry = 5 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: mon election default strategy = 3 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: ms bind msgr2 = False 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: ms inject socket failures = 5000 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: ms type = async 2026-02-24T19:16:27.991 INFO:teuthology.orchestra.run.trial194.stdout: osd heartbeat grace = 160 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: osd op thread timeout = 150 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: fsid = 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout:[osd] 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: osd journal size = 100 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: osd scrub load threshold = 5.0 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: osd scrub max interval = 600 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: osd mclock skip benchmark = True 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: osd recover clone overlap = true 2026-02-24T19:16:27.992 INFO:teuthology.orchestra.run.trial194.stdout: osd recovery max chunk = 1048576 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: osd debug shutdown = true 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: osd debug op order = true 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: osd debug verify stray on activate = true 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: osd debug trim objects = true 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: osd open classes on start = true 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: osd debug pg log writeout = true 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.993 INFO:teuthology.orchestra.run.trial194.stdout: osd map max advance = 10 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: journal zero on create = true 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: filestore apply finisher threads = 3 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: bdev debug aio = true 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: osd debug misdirected ops = true 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: bdev async discard = True 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: bdev enable discard = True 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: bluestore allocator = btree 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: bluestore block size = 96636764160 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: bluestore fsck on mount = True 2026-02-24T19:16:27.994 INFO:teuthology.orchestra.run.trial194.stdout: bluestore onode segment size = 0 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: bluestore write v2 random = True 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: bluestore zero block detection = True 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: crush location = root=default host=host-$id 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: debug bluefs = 1 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: debug bluestore = 1 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: debug monc = 20 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: debug ms = 1 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: debug osd = 20 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: debug rocksdb = 10 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: mon osd full ratio = 0.9 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:16:27.995 INFO:teuthology.orchestra.run.trial194.stdout: osd class default list = * 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd class load list = * 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd client watch timeout = 240 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd debug verify cached snaps = True 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd debug verify missing on start = True 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd fast shutdown = False 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd mclock override recovery settings = True 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd objectstore = bluestore 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd op queue = debug_random 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd op queue cut off = debug_random 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: osd shutdown pgref assert = True 2026-02-24T19:16:27.996 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout:[mgr] 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: debug ms = 1 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: debug mgr = 20 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: debug mon = 20 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: debug auth = 20 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: mgr/telemetry/nag = false 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout:[mon] 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: debug ms = 1 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: debug mon = 20 2026-02-24T19:16:27.997 INFO:teuthology.orchestra.run.trial194.stdout: debug paxos = 20 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: debug auth = 20 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: mon data avail warn = 5 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: mon mgr mkfs grace = 240 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: mon osd reporter subtree level = osd 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: mon osd prime pg temp = true 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.998 INFO:teuthology.orchestra.run.trial194.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: # 1m isn't quite enough 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon min osdmap epochs = 50 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon osd crush smoke test = False 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon osdmap full prune interval = 2 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon osdmap full prune min = 15 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:16:27.999 INFO:teuthology.orchestra.run.trial194.stdout: mon scrub interval = 300 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: mon warn on pool no app = False 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: paxos service trim min = 10 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout:[client] 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: rgw cache enabled = true 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: rgw enable ops log = true 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: rgw enable usage log = true 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: debug monc = 20 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: debug ms = 1 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: debug objecter = 20 2026-02-24T19:16:28.000 INFO:teuthology.orchestra.run.trial194.stdout: debug rados = 20 2026-02-24T19:16:28.001 INFO:teuthology.orchestra.run.trial194.stdout: rados replica read policy = balance 2026-02-24T19:16:28.001 INFO:teuthology.orchestra.run.trial194.stdout:[mon.a] 2026-02-24T19:16:28.001 INFO:teuthology.orchestra.run.trial194.stdout:[mon.b] 2026-02-24T19:16:28.001 INFO:teuthology.orchestra.run.trial194.stdout:[mon.c] 2026-02-24T19:16:28.003 INFO:teuthology.orchestra.run.trial179.stdout:[global] 2026-02-24T19:16:28.003 INFO:teuthology.orchestra.run.trial179.stdout: chdir = "" 2026-02-24T19:16:28.003 INFO:teuthology.orchestra.run.trial179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:16:28.003 INFO:teuthology.orchestra.run.trial179.stdout: auth supported = cephx 2026-02-24T19:16:28.003 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.003 INFO:teuthology.orchestra.run.trial179.stdout: filestore xattr use omap = true 2026-02-24T19:16:28.003 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.003 INFO:teuthology.orchestra.run.trial179.stdout: mon clock drift allowed = 1.000 2026-02-24T19:16:28.003 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: osd crush chooseleaf type = 0 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: auth debug = true 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: ms die on old message = true 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: ms die on bug = true 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: mon pg warn max object skew = 0 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:16:28.004 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: osd pool default size = 2 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon osd allow primary affinity = true 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon osd allow pg remap = true 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon warn on no sortbitwise = false 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon warn on too few osds = false 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: mon_allow_pool_size_one = true 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.005 INFO:teuthology.orchestra.run.trial179.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: osd default data pool replay window = 5 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: mon allow pool delete = true 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: mon cluster log file level = debug 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: debug asserts on shutdown = true 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: mon health detail to clog = false 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: mon host = "[v1:10.20.193.45:6789],[v1:10.20.193.114:6789],[v1:10.20.193.179:6789]" 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: mon client directed command retry = 5 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: mon election default strategy = 3 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: ms bind msgr2 = False 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: ms inject socket failures = 5000 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: ms type = async 2026-02-24T19:16:28.006 INFO:teuthology.orchestra.run.trial179.stdout: osd heartbeat grace = 160 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: osd op thread timeout = 150 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: fsid = 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout:[osd] 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: osd journal size = 100 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: osd scrub load threshold = 5.0 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: osd scrub max interval = 600 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: osd mclock skip benchmark = True 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: osd recover clone overlap = true 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: osd recovery max chunk = 1048576 2026-02-24T19:16:28.007 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: osd debug shutdown = true 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: osd debug op order = true 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: osd debug verify stray on activate = true 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: osd debug trim objects = true 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: osd open classes on start = true 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: osd debug pg log writeout = true 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: osd map max advance = 10 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: journal zero on create = true 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.008 INFO:teuthology.orchestra.run.trial179.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: filestore apply finisher threads = 3 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: bdev debug aio = true 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: osd debug misdirected ops = true 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: bdev async discard = True 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: bdev enable discard = True 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: bluestore allocator = btree 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: bluestore block size = 96636764160 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: bluestore fsck on mount = True 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: bluestore onode segment size = 0 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: bluestore write v2 random = True 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: bluestore zero block detection = True 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: crush location = root=default host=host-$id 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: debug bluefs = 1 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: debug bluestore = 1 2026-02-24T19:16:28.009 INFO:teuthology.orchestra.run.trial179.stdout: debug monc = 20 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: debug ms = 1 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: debug osd = 20 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: debug rocksdb = 10 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: mon osd full ratio = 0.9 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd class default list = * 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd class load list = * 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd client watch timeout = 240 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd debug verify cached snaps = True 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd debug verify missing on start = True 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd fast shutdown = False 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd mclock override recovery settings = True 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd objectstore = bluestore 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd op queue = debug_random 2026-02-24T19:16:28.010 INFO:teuthology.orchestra.run.trial179.stdout: osd op queue cut off = debug_random 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: osd shutdown pgref assert = True 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout:[mgr] 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: debug ms = 1 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: debug mgr = 20 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: debug mon = 20 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: debug auth = 20 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: mgr/telemetry/nag = false 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout:[mon] 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: debug ms = 1 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: debug mon = 20 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: debug paxos = 20 2026-02-24T19:16:28.011 INFO:teuthology.orchestra.run.trial179.stdout: debug auth = 20 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: mon data avail warn = 5 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: mon mgr mkfs grace = 240 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: mon osd reporter subtree level = osd 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: mon osd prime pg temp = true 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: # 1m isn't quite enough 2026-02-24T19:16:28.012 INFO:teuthology.orchestra.run.trial179.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: mon min osdmap epochs = 50 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: mon osd crush smoke test = False 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: mon osdmap full prune interval = 2 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: mon osdmap full prune min = 15 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: mon scrub interval = 300 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: mon warn on pool no app = False 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: paxos service trim min = 10 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout:[client] 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: rgw cache enabled = true 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: rgw enable ops log = true 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: rgw enable usage log = true 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:16:28.013 INFO:teuthology.orchestra.run.trial179.stdout: debug monc = 20 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial179.stdout: debug ms = 1 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial179.stdout: debug objecter = 20 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial179.stdout: debug rados = 20 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial179.stdout: rados replica read policy = balance 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial179.stdout:[mon.a] 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial179.stdout:[mon.b] 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial179.stdout:[mon.c] 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial114.stdout:[global] 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial114.stdout: chdir = "" 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial114.stdout: auth supported = cephx 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial114.stdout: filestore xattr use omap = true 2026-02-24T19:16:28.014 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: mon clock drift allowed = 1.000 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: osd crush chooseleaf type = 0 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: auth debug = true 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: ms die on old message = true 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: ms die on bug = true 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: mon pg warn max object skew = 0 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: osd pool default size = 2 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: mon osd allow primary affinity = true 2026-02-24T19:16:28.015 INFO:teuthology.orchestra.run.trial114.stdout: mon osd allow pg remap = true 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on no sortbitwise = false 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on too few osds = false 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon_allow_pool_size_one = true 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: osd default data pool replay window = 5 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon allow pool delete = true 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon cluster log file level = debug 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: debug asserts on shutdown = true 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon health detail to clog = false 2026-02-24T19:16:28.016 INFO:teuthology.orchestra.run.trial114.stdout: mon host = "[v1:10.20.193.45:6789],[v1:10.20.193.114:6789],[v1:10.20.193.179:6789]" 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: mon client directed command retry = 5 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: mon election default strategy = 3 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: ms bind msgr2 = False 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: ms inject socket failures = 5000 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: ms type = async 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: osd heartbeat grace = 160 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: osd op thread timeout = 150 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: fsid = 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout:[osd] 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: osd journal size = 100 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: osd scrub load threshold = 5.0 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: osd scrub max interval = 600 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: osd mclock skip benchmark = True 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: osd recover clone overlap = true 2026-02-24T19:16:28.017 INFO:teuthology.orchestra.run.trial114.stdout: osd recovery max chunk = 1048576 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: osd debug shutdown = true 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: osd debug op order = true 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: osd debug verify stray on activate = true 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: osd debug trim objects = true 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: osd open classes on start = true 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: osd debug pg log writeout = true 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: osd map max advance = 10 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: journal zero on create = true 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: filestore apply finisher threads = 3 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: bdev debug aio = true 2026-02-24T19:16:28.018 INFO:teuthology.orchestra.run.trial114.stdout: osd debug misdirected ops = true 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: bdev async discard = True 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: bdev enable discard = True 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: bluestore allocator = btree 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: bluestore block size = 96636764160 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: bluestore fsck on mount = True 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: bluestore onode segment size = 0 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: bluestore write v2 random = True 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: bluestore zero block detection = True 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: crush location = root=default host=host-$id 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: debug bluefs = 1 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: debug bluestore = 1 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: debug monc = 20 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: debug ms = 1 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: debug osd = 20 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: debug rocksdb = 10 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: mon osd full ratio = 0.9 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:16:28.019 INFO:teuthology.orchestra.run.trial114.stdout: osd class default list = * 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd class load list = * 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd client watch timeout = 240 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd debug verify cached snaps = True 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd debug verify missing on start = True 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd fast shutdown = False 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd mclock override recovery settings = True 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd objectstore = bluestore 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd op queue = debug_random 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd op queue cut off = debug_random 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: osd shutdown pgref assert = True 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout:[mgr] 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: debug ms = 1 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: debug mgr = 20 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: debug mon = 20 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: debug auth = 20 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: mgr/telemetry/nag = false 2026-02-24T19:16:28.020 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout:[mon] 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: debug ms = 1 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: debug mon = 20 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: debug paxos = 20 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: debug auth = 20 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: mon data avail warn = 5 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: mon mgr mkfs grace = 240 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: mon osd reporter subtree level = osd 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: mon osd prime pg temp = true 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.021 INFO:teuthology.orchestra.run.trial114.stdout: # 1m isn't quite enough 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: mon min osdmap epochs = 50 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: mon osd crush smoke test = False 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: mon osdmap full prune interval = 2 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: mon osdmap full prune min = 15 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: mon scrub interval = 300 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on pool no app = False 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: paxos service trim min = 10 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout:[client] 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: rgw cache enabled = true 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: rgw enable ops log = true 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: rgw enable usage log = true 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: debug monc = 20 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: debug ms = 1 2026-02-24T19:16:28.022 INFO:teuthology.orchestra.run.trial114.stdout: debug objecter = 20 2026-02-24T19:16:28.023 INFO:teuthology.orchestra.run.trial114.stdout: debug rados = 20 2026-02-24T19:16:28.023 INFO:teuthology.orchestra.run.trial114.stdout: rados replica read policy = balance 2026-02-24T19:16:28.023 INFO:teuthology.orchestra.run.trial114.stdout:[mon.a] 2026-02-24T19:16:28.023 INFO:teuthology.orchestra.run.trial114.stdout:[mon.b] 2026-02-24T19:16:28.023 INFO:teuthology.orchestra.run.trial114.stdout:[mon.c] 2026-02-24T19:16:28.023 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-24T19:16:28.024 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-24T19:16:28.086 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-24T19:16:28.086 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:28.086 DEBUG:teuthology.orchestra.run.trial045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-24T19:16:28.142 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:28.142 DEBUG:teuthology.orchestra.run.trial045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-24T19:16:28.198 INFO:tasks.ceph:Sending monmap to node ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:16:28.198 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:28.198 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:16:28.198 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:28.270 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:28.270 DEBUG:teuthology.orchestra.run.trial045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:28.326 INFO:tasks.ceph:Sending monmap to node ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:16:28.326 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:28.327 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:16:28.327 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:28.361 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:28.361 DEBUG:teuthology.orchestra.run.trial114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:28.418 INFO:tasks.ceph:Sending monmap to node ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:16:28.418 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:28.418 DEBUG:teuthology.orchestra.run.trial179:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:16:28.418 DEBUG:teuthology.orchestra.run.trial179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:28.452 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:28.452 DEBUG:teuthology.orchestra.run.trial179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:28.509 INFO:tasks.ceph:Sending monmap to node ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:16:28.509 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:28.509 DEBUG:teuthology.orchestra.run.trial194:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:16:28.509 DEBUG:teuthology.orchestra.run.trial194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:28.542 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:28.542 DEBUG:teuthology.orchestra.run.trial194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:28.598 INFO:tasks.ceph:Setting up mon nodes... 2026-02-24T19:16:28.598 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-24T19:16:28.599 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-24T19:16:28.645 INFO:teuthology.orchestra.run.trial045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-24T19:16:28.647 DEBUG:teuthology.orchestra.run.trial194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T19:16:28.691 INFO:teuthology.orchestra.run.trial194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T19:16:28.694 INFO:tasks.ceph:Setting up mds nodes... 2026-02-24T19:16:28.694 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-24T19:16:28.694 DEBUG:teuthology.orchestra.run.trial194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T19:16:28.728 INFO:teuthology.orchestra.run.trial194.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-24T19:16:28.739 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-24T19:16:28.740 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial114.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial179.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial194.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-24T19:16:28.740 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:28.765 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:28.765 INFO:tasks.ceph:role: osd.0 2026-02-24T19:16:28.765 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:16:28.765 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:28.829 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:28.829 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:28.829 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:28.829 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:28.829 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:28.829 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:28.830 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:28.830 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:28.830 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:28.830 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:29.403 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-24T19:16:29.405 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-24T19:16:29.405 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:29.473 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:29.540 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:29.603 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:29.603 INFO:tasks.ceph:role: osd.4 2026-02-24T19:16:29.603 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:16:29.604 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:29.668 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:29.668 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:29.668 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:29.668 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:29.668 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:29.668 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:29.669 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:29.669 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:29.669 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:29.669 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:30.228 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-24T19:16:30.230 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-24T19:16:30.230 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:30.298 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:30.364 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:30.428 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:30.428 INFO:tasks.ceph:role: osd.8 2026-02-24T19:16:30.428 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:16:30.428 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:30.492 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:30.492 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:30.492 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:30.492 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:30.493 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:30.493 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:30.493 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:30.493 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:30.493 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:30.493 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:31.054 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-24T19:16:31.056 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-24T19:16:31.057 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:31.125 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:31.190 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:31.253 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:31.253 INFO:tasks.ceph:role: osd.12 2026-02-24T19:16:31.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:16:31.254 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:31.318 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:31.318 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:31.318 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:31.318 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:31.318 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:31.318 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:31.318 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:31.319 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:31.319 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:31.319 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:31.877 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-24T19:16:31.880 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-24T19:16:31.880 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:31.955 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:32.021 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:32.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:32.096+0000 7f383b4fe900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-24T19:16:32.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:32.096+0000 7f383b4fe900 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-24T19:16:32.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:32.096+0000 7f383b4fe900 -1 bdev(0x5644a4979800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:32.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:32.096+0000 7f383b4fe900 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-24T19:16:32.593 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:32.658 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:32.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:32.733+0000 7fe76aa53900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-24T19:16:32.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:32.733+0000 7fe76aa53900 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-24T19:16:32.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:32.733+0000 7fe76aa53900 -1 bdev(0x562570fe1800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:32.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:32.733+0000 7fe76aa53900 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-24T19:16:33.198 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:33.263 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:33.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:33.338+0000 7f5a64810900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-24T19:16:33.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:33.338+0000 7f5a64810900 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-24T19:16:33.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:33.338+0000 7f5a64810900 -1 bdev(0x5590985db800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:33.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:33.338+0000 7f5a64810900 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-24T19:16:33.859 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:33.924 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:34.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:34.000+0000 7fe1ecd51900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-24T19:16:34.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:34.000+0000 7fe1ecd51900 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-24T19:16:34.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:34.000+0000 7fe1ecd51900 -1 bdev(0x561cafb61800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:34.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:34.000+0000 7fe1ecd51900 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-24T19:16:34.498 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:34.564 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:34.590 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:34.590 INFO:tasks.ceph:role: osd.1 2026-02-24T19:16:34.590 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:16:34.590 DEBUG:teuthology.orchestra.run.trial114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:34.654 INFO:teuthology.orchestra.run.trial114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:34.654 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:34.654 INFO:teuthology.orchestra.run.trial114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:34.655 INFO:teuthology.orchestra.run.trial114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:34.655 INFO:teuthology.orchestra.run.trial114.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:34.655 INFO:teuthology.orchestra.run.trial114.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:34.655 INFO:teuthology.orchestra.run.trial114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:34.655 INFO:teuthology.orchestra.run.trial114.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:34.655 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:34.655 INFO:teuthology.orchestra.run.trial114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:35.227 INFO:teuthology.orchestra.run.trial114.stdout:Discarding blocks...Done. 2026-02-24T19:16:35.229 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial114.front.sepia.ceph.com -o noatime 2026-02-24T19:16:35.230 DEBUG:teuthology.orchestra.run.trial114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:35.299 DEBUG:teuthology.orchestra.run.trial114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:35.368 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:35.435 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:35.435 INFO:tasks.ceph:role: osd.5 2026-02-24T19:16:35.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:16:35.435 DEBUG:teuthology.orchestra.run.trial114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:35.503 INFO:teuthology.orchestra.run.trial114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:35.503 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:35.503 INFO:teuthology.orchestra.run.trial114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:35.503 INFO:teuthology.orchestra.run.trial114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:35.503 INFO:teuthology.orchestra.run.trial114.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:35.503 INFO:teuthology.orchestra.run.trial114.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:35.503 INFO:teuthology.orchestra.run.trial114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:35.503 INFO:teuthology.orchestra.run.trial114.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:35.503 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:35.504 INFO:teuthology.orchestra.run.trial114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:36.067 INFO:teuthology.orchestra.run.trial114.stdout:Discarding blocks...Done. 2026-02-24T19:16:36.069 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial114.front.sepia.ceph.com -o noatime 2026-02-24T19:16:36.069 DEBUG:teuthology.orchestra.run.trial114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:36.137 DEBUG:teuthology.orchestra.run.trial114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:36.203 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:36.267 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:36.267 INFO:tasks.ceph:role: osd.9 2026-02-24T19:16:36.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:16:36.268 DEBUG:teuthology.orchestra.run.trial114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:36.332 INFO:teuthology.orchestra.run.trial114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:36.333 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:36.333 INFO:teuthology.orchestra.run.trial114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:36.333 INFO:teuthology.orchestra.run.trial114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:36.333 INFO:teuthology.orchestra.run.trial114.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:36.333 INFO:teuthology.orchestra.run.trial114.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:36.333 INFO:teuthology.orchestra.run.trial114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:36.333 INFO:teuthology.orchestra.run.trial114.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:36.333 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:36.333 INFO:teuthology.orchestra.run.trial114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:36.891 INFO:teuthology.orchestra.run.trial114.stdout:Discarding blocks...Done. 2026-02-24T19:16:36.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial114.front.sepia.ceph.com -o noatime 2026-02-24T19:16:36.894 DEBUG:teuthology.orchestra.run.trial114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:36.962 DEBUG:teuthology.orchestra.run.trial114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:37.029 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:37.093 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:37.093 INFO:tasks.ceph:role: osd.13 2026-02-24T19:16:37.093 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:16:37.093 DEBUG:teuthology.orchestra.run.trial114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:37.158 INFO:teuthology.orchestra.run.trial114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:37.158 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:37.158 INFO:teuthology.orchestra.run.trial114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:37.158 INFO:teuthology.orchestra.run.trial114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:37.158 INFO:teuthology.orchestra.run.trial114.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:37.158 INFO:teuthology.orchestra.run.trial114.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:37.158 INFO:teuthology.orchestra.run.trial114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:37.158 INFO:teuthology.orchestra.run.trial114.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:37.158 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:37.159 INFO:teuthology.orchestra.run.trial114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:37.715 INFO:teuthology.orchestra.run.trial114.stdout:Discarding blocks...Done. 2026-02-24T19:16:37.717 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial114.front.sepia.ceph.com -o noatime 2026-02-24T19:16:37.717 DEBUG:teuthology.orchestra.run.trial114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:37.793 DEBUG:teuthology.orchestra.run.trial114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:37.860 DEBUG:teuthology.orchestra.run.trial114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:37.939 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:37.938+0000 7fac5d4ec900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-24T19:16:37.940 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:37.938+0000 7fac5d4ec900 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-24T19:16:37.940 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:37.938+0000 7fac5d4ec900 -1 bdev(0x55668fc7f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:37.940 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:37.938+0000 7fac5d4ec900 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-24T19:16:38.427 DEBUG:teuthology.orchestra.run.trial114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:38.491 DEBUG:teuthology.orchestra.run.trial114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:38.570 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:38.568+0000 7f5f4e66e900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-24T19:16:38.571 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:38.569+0000 7f5f4e66e900 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-24T19:16:38.571 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:38.569+0000 7f5f4e66e900 -1 bdev(0x562b4a2a7800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:38.571 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:38.569+0000 7f5f4e66e900 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-24T19:16:39.029 DEBUG:teuthology.orchestra.run.trial114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:39.094 DEBUG:teuthology.orchestra.run.trial114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:39.171 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:39.169+0000 7f1f6cdde900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-24T19:16:39.172 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:39.170+0000 7f1f6cdde900 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-24T19:16:39.172 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:39.170+0000 7f1f6cdde900 -1 bdev(0x55d4edc67800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:39.172 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:39.170+0000 7f1f6cdde900 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-24T19:16:39.664 DEBUG:teuthology.orchestra.run.trial114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:39.728 DEBUG:teuthology.orchestra.run.trial114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:39.807 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:39.805+0000 7f6dac39d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-24T19:16:39.807 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:39.805+0000 7f6dac39d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-24T19:16:39.807 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:39.805+0000 7f6dac39d900 -1 bdev(0x55c31ac1d800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:39.807 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-24T19:16:39.805+0000 7f6dac39d900 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-24T19:16:40.299 DEBUG:teuthology.orchestra.run.trial114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:40.364 DEBUG:teuthology.orchestra.run.trial179:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:40.390 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:40.390 INFO:tasks.ceph:role: osd.2 2026-02-24T19:16:40.391 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:16:40.391 DEBUG:teuthology.orchestra.run.trial179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:40.456 INFO:teuthology.orchestra.run.trial179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:40.456 INFO:teuthology.orchestra.run.trial179.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:40.456 INFO:teuthology.orchestra.run.trial179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:40.456 INFO:teuthology.orchestra.run.trial179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:40.456 INFO:teuthology.orchestra.run.trial179.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:40.456 INFO:teuthology.orchestra.run.trial179.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:40.456 INFO:teuthology.orchestra.run.trial179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:40.456 INFO:teuthology.orchestra.run.trial179.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:40.457 INFO:teuthology.orchestra.run.trial179.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:40.457 INFO:teuthology.orchestra.run.trial179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:41.028 INFO:teuthology.orchestra.run.trial179.stdout:Discarding blocks...Done. 2026-02-24T19:16:41.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial179.front.sepia.ceph.com -o noatime 2026-02-24T19:16:41.029 DEBUG:teuthology.orchestra.run.trial179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:41.100 DEBUG:teuthology.orchestra.run.trial179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:41.166 DEBUG:teuthology.orchestra.run.trial179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:41.231 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:41.231 INFO:tasks.ceph:role: osd.6 2026-02-24T19:16:41.231 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:16:41.231 DEBUG:teuthology.orchestra.run.trial179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:41.295 INFO:teuthology.orchestra.run.trial179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:41.296 INFO:teuthology.orchestra.run.trial179.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:41.296 INFO:teuthology.orchestra.run.trial179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:41.296 INFO:teuthology.orchestra.run.trial179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:41.296 INFO:teuthology.orchestra.run.trial179.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:41.296 INFO:teuthology.orchestra.run.trial179.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:41.296 INFO:teuthology.orchestra.run.trial179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:41.296 INFO:teuthology.orchestra.run.trial179.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:41.296 INFO:teuthology.orchestra.run.trial179.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:41.296 INFO:teuthology.orchestra.run.trial179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:41.852 INFO:teuthology.orchestra.run.trial179.stdout:Discarding blocks...Done. 2026-02-24T19:16:41.854 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial179.front.sepia.ceph.com -o noatime 2026-02-24T19:16:41.854 DEBUG:teuthology.orchestra.run.trial179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:41.921 DEBUG:teuthology.orchestra.run.trial179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:41.989 DEBUG:teuthology.orchestra.run.trial179:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:42.053 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:42.053 INFO:tasks.ceph:role: osd.10 2026-02-24T19:16:42.053 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:16:42.053 DEBUG:teuthology.orchestra.run.trial179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:42.118 INFO:teuthology.orchestra.run.trial179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:42.118 INFO:teuthology.orchestra.run.trial179.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:42.118 INFO:teuthology.orchestra.run.trial179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:42.118 INFO:teuthology.orchestra.run.trial179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:42.119 INFO:teuthology.orchestra.run.trial179.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:42.119 INFO:teuthology.orchestra.run.trial179.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:42.119 INFO:teuthology.orchestra.run.trial179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:42.119 INFO:teuthology.orchestra.run.trial179.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:42.119 INFO:teuthology.orchestra.run.trial179.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:42.119 INFO:teuthology.orchestra.run.trial179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:42.683 INFO:teuthology.orchestra.run.trial179.stdout:Discarding blocks...Done. 2026-02-24T19:16:42.685 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial179.front.sepia.ceph.com -o noatime 2026-02-24T19:16:42.685 DEBUG:teuthology.orchestra.run.trial179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:42.752 DEBUG:teuthology.orchestra.run.trial179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:42.818 DEBUG:teuthology.orchestra.run.trial179:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:42.883 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:42.883 INFO:tasks.ceph:role: osd.14 2026-02-24T19:16:42.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:16:42.883 DEBUG:teuthology.orchestra.run.trial179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:42.947 INFO:teuthology.orchestra.run.trial179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:42.948 INFO:teuthology.orchestra.run.trial179.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:42.948 INFO:teuthology.orchestra.run.trial179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:42.948 INFO:teuthology.orchestra.run.trial179.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:42.948 INFO:teuthology.orchestra.run.trial179.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:42.948 INFO:teuthology.orchestra.run.trial179.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:42.948 INFO:teuthology.orchestra.run.trial179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:42.948 INFO:teuthology.orchestra.run.trial179.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:42.948 INFO:teuthology.orchestra.run.trial179.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:42.948 INFO:teuthology.orchestra.run.trial179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:43.509 INFO:teuthology.orchestra.run.trial179.stdout:Discarding blocks...Done. 2026-02-24T19:16:43.511 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial179.front.sepia.ceph.com -o noatime 2026-02-24T19:16:43.511 DEBUG:teuthology.orchestra.run.trial179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:43.582 DEBUG:teuthology.orchestra.run.trial179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:43.648 DEBUG:teuthology.orchestra.run.trial179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:43.729 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:43.726+0000 7f9c889e0900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-24T19:16:43.729 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:43.727+0000 7f9c889e0900 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-24T19:16:43.729 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:43.727+0000 7f9c889e0900 -1 bdev(0x55c89cd3b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:43.729 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:43.727+0000 7f9c889e0900 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-24T19:16:44.218 DEBUG:teuthology.orchestra.run.trial179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:44.283 DEBUG:teuthology.orchestra.run.trial179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:44.361 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:44.359+0000 7f3e5fb2d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-24T19:16:44.362 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:44.359+0000 7f3e5fb2d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-24T19:16:44.362 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:44.359+0000 7f3e5fb2d900 -1 bdev(0x557ec4063800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:44.362 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:44.359+0000 7f3e5fb2d900 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-24T19:16:44.844 DEBUG:teuthology.orchestra.run.trial179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:44.908 DEBUG:teuthology.orchestra.run.trial179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:44.985 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:44.983+0000 7f75bd1a2900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-24T19:16:44.986 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:44.983+0000 7f75bd1a2900 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-24T19:16:44.986 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:44.983+0000 7f75bd1a2900 -1 bdev(0x55b1488b3800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:44.986 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:44.983+0000 7f75bd1a2900 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-24T19:16:45.483 DEBUG:teuthology.orchestra.run.trial179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:45.548 DEBUG:teuthology.orchestra.run.trial179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:45.627 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:45.625+0000 7fde89272900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-24T19:16:45.628 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:45.625+0000 7fde89272900 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-24T19:16:45.628 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:45.625+0000 7fde89272900 -1 bdev(0x55b3225db800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:45.628 INFO:teuthology.orchestra.run.trial179.stderr:2026-02-24T19:16:45.625+0000 7fde89272900 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-24T19:16:46.127 DEBUG:teuthology.orchestra.run.trial179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:46.193 DEBUG:teuthology.orchestra.run.trial194:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:46.219 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:46.219 INFO:tasks.ceph:role: osd.3 2026-02-24T19:16:46.219 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:16:46.219 DEBUG:teuthology.orchestra.run.trial194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:46.283 INFO:teuthology.orchestra.run.trial194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:46.283 INFO:teuthology.orchestra.run.trial194.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:46.284 INFO:teuthology.orchestra.run.trial194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:46.284 INFO:teuthology.orchestra.run.trial194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:46.284 INFO:teuthology.orchestra.run.trial194.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:46.284 INFO:teuthology.orchestra.run.trial194.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:46.284 INFO:teuthology.orchestra.run.trial194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:46.284 INFO:teuthology.orchestra.run.trial194.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:46.284 INFO:teuthology.orchestra.run.trial194.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:46.284 INFO:teuthology.orchestra.run.trial194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:46.853 INFO:teuthology.orchestra.run.trial194.stdout:Discarding blocks...Done. 2026-02-24T19:16:46.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial194.front.sepia.ceph.com -o noatime 2026-02-24T19:16:46.855 DEBUG:teuthology.orchestra.run.trial194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:46.924 DEBUG:teuthology.orchestra.run.trial194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:46.991 DEBUG:teuthology.orchestra.run.trial194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:47.055 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:47.055 INFO:tasks.ceph:role: osd.7 2026-02-24T19:16:47.055 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:16:47.056 DEBUG:teuthology.orchestra.run.trial194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:47.122 INFO:teuthology.orchestra.run.trial194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:47.122 INFO:teuthology.orchestra.run.trial194.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:47.122 INFO:teuthology.orchestra.run.trial194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:47.122 INFO:teuthology.orchestra.run.trial194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:47.122 INFO:teuthology.orchestra.run.trial194.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:47.122 INFO:teuthology.orchestra.run.trial194.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:47.122 INFO:teuthology.orchestra.run.trial194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:47.122 INFO:teuthology.orchestra.run.trial194.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:47.122 INFO:teuthology.orchestra.run.trial194.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:47.123 INFO:teuthology.orchestra.run.trial194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:47.682 INFO:teuthology.orchestra.run.trial194.stdout:Discarding blocks...Done. 2026-02-24T19:16:47.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial194.front.sepia.ceph.com -o noatime 2026-02-24T19:16:47.684 DEBUG:teuthology.orchestra.run.trial194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:47.752 DEBUG:teuthology.orchestra.run.trial194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:47.818 DEBUG:teuthology.orchestra.run.trial194:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:47.882 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:47.882 INFO:tasks.ceph:role: osd.11 2026-02-24T19:16:47.882 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:16:47.882 DEBUG:teuthology.orchestra.run.trial194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:47.946 INFO:teuthology.orchestra.run.trial194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:47.947 INFO:teuthology.orchestra.run.trial194.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:47.947 INFO:teuthology.orchestra.run.trial194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:47.947 INFO:teuthology.orchestra.run.trial194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:47.947 INFO:teuthology.orchestra.run.trial194.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:47.947 INFO:teuthology.orchestra.run.trial194.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:47.947 INFO:teuthology.orchestra.run.trial194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:47.947 INFO:teuthology.orchestra.run.trial194.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:47.947 INFO:teuthology.orchestra.run.trial194.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:47.947 INFO:teuthology.orchestra.run.trial194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:48.507 INFO:teuthology.orchestra.run.trial194.stdout:Discarding blocks...Done. 2026-02-24T19:16:48.509 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial194.front.sepia.ceph.com -o noatime 2026-02-24T19:16:48.509 DEBUG:teuthology.orchestra.run.trial194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:48.583 DEBUG:teuthology.orchestra.run.trial194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:48.649 DEBUG:teuthology.orchestra.run.trial194:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:48.712 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:48.713 INFO:tasks.ceph:role: osd.15 2026-02-24T19:16:48.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:16:48.713 DEBUG:teuthology.orchestra.run.trial194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:48.777 INFO:teuthology.orchestra.run.trial194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:49.334 INFO:teuthology.orchestra.run.trial194.stdout:Discarding blocks...Done. 2026-02-24T19:16:49.336 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial194.front.sepia.ceph.com -o noatime 2026-02-24T19:16:49.337 DEBUG:teuthology.orchestra.run.trial194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:49.413 DEBUG:teuthology.orchestra.run.trial194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:49.480 DEBUG:teuthology.orchestra.run.trial194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:49.559 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:49.556+0000 7f82ab27f900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-24T19:16:49.560 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:49.557+0000 7f82ab27f900 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-24T19:16:49.560 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:49.557+0000 7f82ab27f900 -1 bdev(0x556883c01800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:49.560 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:49.557+0000 7f82ab27f900 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-24T19:16:50.065 DEBUG:teuthology.orchestra.run.trial194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:50.129 DEBUG:teuthology.orchestra.run.trial194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:50.207 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:50.204+0000 7ff75808f900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-24T19:16:50.207 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:50.205+0000 7ff75808f900 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-24T19:16:50.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:50.205+0000 7ff75808f900 -1 bdev(0x56267a23d800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:50.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:50.205+0000 7ff75808f900 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-24T19:16:50.691 DEBUG:teuthology.orchestra.run.trial194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:50.755 DEBUG:teuthology.orchestra.run.trial194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:50.834 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:50.831+0000 7f667f40e900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-24T19:16:50.834 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:50.831+0000 7f667f40e900 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-24T19:16:50.834 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:50.831+0000 7f667f40e900 -1 bdev(0x5616259e7800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:50.834 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:50.831+0000 7f667f40e900 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-24T19:16:51.311 DEBUG:teuthology.orchestra.run.trial194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:51.376 DEBUG:teuthology.orchestra.run.trial194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:51.456 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:51.453+0000 7f232700d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-24T19:16:51.456 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:51.453+0000 7f232700d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-24T19:16:51.456 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:51.453+0000 7f232700d900 -1 bdev(0x55f998627800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:51.456 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:16:51.453+0000 7f232700d900 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-24T19:16:51.962 DEBUG:teuthology.orchestra.run.trial194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:52.027 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-24T19:16:52.028 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:52.028 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-24T19:16:52.054 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:52.055 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-24T19:16:52.118 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:52.118 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-24T19:16:52.181 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:52.182 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-24T19:16:52.245 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:16:52.245 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-24T19:16:52.308 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:52.308 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-24T19:16:52.335 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:52.335 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-24T19:16:52.399 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:52.399 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-24T19:16:52.463 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:16:52.463 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-24T19:16:52.527 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:52.527 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-24T19:16:52.553 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:52.553 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-24T19:16:52.617 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:52.617 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-24T19:16:52.681 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:16:52.681 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-24T19:16:52.745 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:52.745 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-24T19:16:52.771 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:52.771 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-24T19:16:52.835 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:52.835 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-24T19:16:52.899 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:52.899 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-24T19:16:52.962 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:52.962 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-24T19:16:53.025 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:16:53.026 DEBUG:teuthology.orchestra.run.trial194:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-24T19:16:53.082 INFO:tasks.ceph:Adding keys to all mons... 2026-02-24T19:16:53.082 DEBUG:teuthology.orchestra.run.trial045:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T19:16:53.085 DEBUG:teuthology.orchestra.run.trial114:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T19:16:53.087 DEBUG:teuthology.orchestra.run.trial179:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T19:16:53.105 INFO:teuthology.orchestra.run.trial045.stdout:[mgr.y] 2026-02-24T19:16:53.105 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAM+Z1peJ1bJhAANKh1ACEpqH8APZZzRKfrvg== 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout:[osd.0] 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAQ+Z1pjinOBRAARx/WlleaNa3MXfFa6a+v2A== 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout:[osd.4] 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAQ+Z1p9J7DKxAAEAJ3cJdfkRVuJsa4hts04g== 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout:[osd.8] 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAR+Z1plyY8FBAAzS4S8aiWgpU1oLw2Gafmag== 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout:[osd.12] 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAS+Z1pfIMUABAAAI7UwCKfnUVis6BXZbdLAg== 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout:[osd.1] 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAV+Z1pzCn2NxAAzFPeaZVIpv+bCuBG4g7xIg== 2026-02-24T19:16:53.106 INFO:teuthology.orchestra.run.trial045.stdout:[osd.5] 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAW+Z1pmUDzIRAAesw6i8qzGm1IuVf0HNfzPg== 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout:[osd.9] 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAX+Z1pqbkrChAAhsSvs1Ou4jQmP8+79erC9A== 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout:[osd.13] 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAX+Z1pIIcHMBAANw9oWhwTj0uk94nJF0/Dtg== 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout:[osd.2] 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAb+Z1pKX5hKxAAsYN/GmTaw/1T6McumvcztA== 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout:[osd.6] 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAc+Z1pwp99FRAA3rH4FiKNbKj2VAcgSWjmoQ== 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout:[osd.10] 2026-02-24T19:16:53.107 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAc+Z1pf2OsOhAAj8/b0Z1pK8ECPlSE9jGZQQ== 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout:[osd.14] 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAd+Z1pSFpWJRAA0nx2vsl205SQm6UAMZWsnA== 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout:[mgr.x] 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAM+Z1pXiEpKRAAtMLJEpPTIhYHayXKlJMC9Q== 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout:[osd.3] 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAh+Z1pc+ZGIRAAFtRqFLE5QcvpqcnzlIIb+w== 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout:[osd.7] 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAi+Z1p+aRIDBAApSBlaUKecFUQ5CZ13nEP1w== 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout:[osd.11] 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAi+Z1pXx6hMRAAzL8Kn//0WW4YJ7CynHpazA== 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout:[osd.15] 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAj+Z1pLcsXGxAApGDmFraU4UJTQAmF0BsOkQ== 2026-02-24T19:16:53.108 INFO:teuthology.orchestra.run.trial045.stdout:[client.0] 2026-02-24T19:16:53.109 INFO:teuthology.orchestra.run.trial045.stdout: key = AQAM+Z1pZttbKxAAWh3ULN2BSe4L5orubxTwAA== 2026-02-24T19:16:53.110 INFO:teuthology.orchestra.run.trial114.stdout:[mgr.y] 2026-02-24T19:16:53.111 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAM+Z1peJ1bJhAANKh1ACEpqH8APZZzRKfrvg== 2026-02-24T19:16:53.111 INFO:teuthology.orchestra.run.trial114.stdout:[osd.0] 2026-02-24T19:16:53.111 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAQ+Z1pjinOBRAARx/WlleaNa3MXfFa6a+v2A== 2026-02-24T19:16:53.111 INFO:teuthology.orchestra.run.trial114.stdout:[osd.4] 2026-02-24T19:16:53.111 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAQ+Z1p9J7DKxAAEAJ3cJdfkRVuJsa4hts04g== 2026-02-24T19:16:53.111 INFO:teuthology.orchestra.run.trial114.stdout:[osd.8] 2026-02-24T19:16:53.111 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAR+Z1plyY8FBAAzS4S8aiWgpU1oLw2Gafmag== 2026-02-24T19:16:53.111 INFO:teuthology.orchestra.run.trial114.stdout:[osd.12] 2026-02-24T19:16:53.111 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAS+Z1pfIMUABAAAI7UwCKfnUVis6BXZbdLAg== 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout:[osd.1] 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAV+Z1pzCn2NxAAzFPeaZVIpv+bCuBG4g7xIg== 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout:[osd.5] 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAW+Z1pmUDzIRAAesw6i8qzGm1IuVf0HNfzPg== 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout:[osd.9] 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAX+Z1pqbkrChAAhsSvs1Ou4jQmP8+79erC9A== 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout:[osd.13] 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAX+Z1pIIcHMBAANw9oWhwTj0uk94nJF0/Dtg== 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout:[osd.2] 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAb+Z1pKX5hKxAAsYN/GmTaw/1T6McumvcztA== 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout:[osd.6] 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAc+Z1pwp99FRAA3rH4FiKNbKj2VAcgSWjmoQ== 2026-02-24T19:16:53.112 INFO:teuthology.orchestra.run.trial114.stdout:[osd.10] 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAc+Z1pf2OsOhAAj8/b0Z1pK8ECPlSE9jGZQQ== 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout:[osd.14] 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAd+Z1pSFpWJRAA0nx2vsl205SQm6UAMZWsnA== 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout:[mgr.x] 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAM+Z1pXiEpKRAAtMLJEpPTIhYHayXKlJMC9Q== 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout:[osd.3] 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAh+Z1pc+ZGIRAAFtRqFLE5QcvpqcnzlIIb+w== 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout:[osd.7] 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAi+Z1p+aRIDBAApSBlaUKecFUQ5CZ13nEP1w== 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout:[osd.11] 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAi+Z1pXx6hMRAAzL8Kn//0WW4YJ7CynHpazA== 2026-02-24T19:16:53.113 INFO:teuthology.orchestra.run.trial114.stdout:[osd.15] 2026-02-24T19:16:53.114 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAj+Z1pLcsXGxAApGDmFraU4UJTQAmF0BsOkQ== 2026-02-24T19:16:53.114 INFO:teuthology.orchestra.run.trial114.stdout:[client.0] 2026-02-24T19:16:53.114 INFO:teuthology.orchestra.run.trial114.stdout: key = AQAM+Z1pZttbKxAAWh3ULN2BSe4L5orubxTwAA== 2026-02-24T19:16:53.115 INFO:teuthology.orchestra.run.trial179.stdout:[mgr.y] 2026-02-24T19:16:53.115 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAM+Z1peJ1bJhAANKh1ACEpqH8APZZzRKfrvg== 2026-02-24T19:16:53.115 INFO:teuthology.orchestra.run.trial179.stdout:[osd.0] 2026-02-24T19:16:53.115 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAQ+Z1pjinOBRAARx/WlleaNa3MXfFa6a+v2A== 2026-02-24T19:16:53.115 INFO:teuthology.orchestra.run.trial179.stdout:[osd.4] 2026-02-24T19:16:53.115 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAQ+Z1p9J7DKxAAEAJ3cJdfkRVuJsa4hts04g== 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout:[osd.8] 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAR+Z1plyY8FBAAzS4S8aiWgpU1oLw2Gafmag== 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout:[osd.12] 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAS+Z1pfIMUABAAAI7UwCKfnUVis6BXZbdLAg== 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout:[osd.1] 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAV+Z1pzCn2NxAAzFPeaZVIpv+bCuBG4g7xIg== 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout:[osd.5] 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAW+Z1pmUDzIRAAesw6i8qzGm1IuVf0HNfzPg== 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout:[osd.9] 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAX+Z1pqbkrChAAhsSvs1Ou4jQmP8+79erC9A== 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout:[osd.13] 2026-02-24T19:16:53.116 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAX+Z1pIIcHMBAANw9oWhwTj0uk94nJF0/Dtg== 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout:[osd.2] 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAb+Z1pKX5hKxAAsYN/GmTaw/1T6McumvcztA== 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout:[osd.6] 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAc+Z1pwp99FRAA3rH4FiKNbKj2VAcgSWjmoQ== 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout:[osd.10] 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAc+Z1pf2OsOhAAj8/b0Z1pK8ECPlSE9jGZQQ== 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout:[osd.14] 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAd+Z1pSFpWJRAA0nx2vsl205SQm6UAMZWsnA== 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout:[mgr.x] 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAM+Z1pXiEpKRAAtMLJEpPTIhYHayXKlJMC9Q== 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout:[osd.3] 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAh+Z1pc+ZGIRAAFtRqFLE5QcvpqcnzlIIb+w== 2026-02-24T19:16:53.117 INFO:teuthology.orchestra.run.trial179.stdout:[osd.7] 2026-02-24T19:16:53.118 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAi+Z1p+aRIDBAApSBlaUKecFUQ5CZ13nEP1w== 2026-02-24T19:16:53.118 INFO:teuthology.orchestra.run.trial179.stdout:[osd.11] 2026-02-24T19:16:53.118 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAi+Z1pXx6hMRAAzL8Kn//0WW4YJ7CynHpazA== 2026-02-24T19:16:53.118 INFO:teuthology.orchestra.run.trial179.stdout:[osd.15] 2026-02-24T19:16:53.118 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAj+Z1pLcsXGxAApGDmFraU4UJTQAmF0BsOkQ== 2026-02-24T19:16:53.118 INFO:teuthology.orchestra.run.trial179.stdout:[client.0] 2026-02-24T19:16:53.118 INFO:teuthology.orchestra.run.trial179.stdout: key = AQAM+Z1pZttbKxAAWh3ULN2BSe4L5orubxTwAA== 2026-02-24T19:16:53.118 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:53.153 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:53.155 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:53.197 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.233 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.236 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.275 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.312 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.315 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.354 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.391 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.394 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.434 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.471 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.473 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.515 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.552 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.554 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.594 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.632 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.634 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.674 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.713 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.716 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.755 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.793 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.797 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.838 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.872 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.876 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.917 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.952 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.955 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:53.996 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.032 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.035 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.075 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.112 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.114 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.154 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:54.191 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:54.194 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:54.234 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.272 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.274 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.314 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.352 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.354 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.393 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.431 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.434 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.474 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.511 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.514 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:16:54.554 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T19:16:54.591 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T19:16:54.594 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T19:16:54.635 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-24T19:16:54.635 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-24T19:16:54.695 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T19:16:54.783 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-24T19:16:54.806 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-24T19:16:54.832 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T19:16:54.919 DEBUG:teuthology.orchestra.run.trial114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-24T19:16:54.944 DEBUG:teuthology.orchestra.run.trial179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-24T19:16:54.969 DEBUG:teuthology.orchestra.run.trial179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T19:16:55.057 DEBUG:teuthology.orchestra.run.trial179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-24T19:16:55.082 DEBUG:teuthology.orchestra.run.trial045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:55.084 DEBUG:teuthology.orchestra.run.trial114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:55.087 DEBUG:teuthology.orchestra.run.trial179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:55.138 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-24T19:16:55.139 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-24T19:16:55.139 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-24T19:16:55.139 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-24T19:16:55.142 INFO:tasks.ceph.mon.a:Started 2026-02-24T19:16:55.142 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-24T19:16:55.142 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-24T19:16:55.142 DEBUG:teuthology.orchestra.run.trial114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-24T19:16:55.145 INFO:tasks.ceph.mon.b:Started 2026-02-24T19:16:55.145 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-24T19:16:55.145 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-24T19:16:55.145 DEBUG:teuthology.orchestra.run.trial179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-24T19:16:55.181 INFO:tasks.ceph.mon.c:Started 2026-02-24T19:16:55.181 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-24T19:16:55.181 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-24T19:16:55.182 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-24T19:16:55.184 INFO:tasks.ceph.mgr.y:Started 2026-02-24T19:16:55.184 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-24T19:16:55.184 DEBUG:teuthology.orchestra.run.trial194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-24T19:16:55.187 INFO:tasks.ceph.mgr.x:Started 2026-02-24T19:16:55.187 DEBUG:tasks.ceph:set 0 configs 2026-02-24T19:16:55.187 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph config dump 2026-02-24T19:16:55.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.249+0000 7fe813913640 10 monclient: get_monmap_and_config 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.249+0000 7fe813913640 10 monclient: build_initial_monmap 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.249+0000 7fe813913640 10 monclient: monmap: 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:55.250963+0000 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:55.250963+0000 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:16:55.253 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:16:55.254 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:16:55.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 1 Processor -- start 2026-02-24T19:16:55.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 1 -- start start 2026-02-24T19:16:55.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 10 monclient: init 2026-02-24T19:16:55.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 10 monclient: _reopen_session rank -1 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 10 monclient(hunting): picked mon.noname-c con 0x7fe80c058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 10 monclient(hunting): picked mon.noname-b con 0x7fe80c0b0410 addr v1:10.20.193.114:6789/0 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 10 monclient(hunting): picked mon.noname-a con 0x7fe80c1626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c1655c0 con 0x7fe80c1626a0 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0b12b0 con 0x7fe80c0b0410 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0b1590 con 0x7fe80c058da0 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe813913640 10 monclient(hunting): authenticate will time out at 3586.889876s 2026-02-24T19:16:55.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.250+0000 7fe811e89640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe80c1c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:16:55.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.258+0000 7fe811688640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe80c1647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:16:55.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.258+0000 7fe810e87640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe80c164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:16:55.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.451+0000 7fe811e89640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe80c1c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:16:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.459+0000 7fe810e87640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe80c164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:16:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.459+0000 7fe811688640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe80c1647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:16:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.852+0000 7fe811e89640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe80c1c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:16:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.860+0000 7fe810e87640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe80c164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:16:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:55.860+0000 7fe811688640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe80c1647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:16:56.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:56.653+0000 7fe811e89640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe80c1c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:16:56.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:56.661+0000 7fe810e87640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe80c164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:16:56.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:56.661+0000 7fe811688640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe80c1647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:16:57.222 INFO:tasks.ceph.mon.b.trial114.stderr:--00:00:00:02.028 43721-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-24T19:16:57.227 INFO:tasks.ceph.mon.a.trial045.stderr:--00:00:00:02.035 44996-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-24T19:16:57.285 INFO:tasks.ceph.mon.c.trial179.stderr:--00:00:00:02.054 43655-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-24T19:16:58.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 10 monclient(hunting): tick 2026-02-24T19:16:58.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:16:58.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 1 monclient(hunting): continuing hunt 2026-02-24T19:16:58.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:16:58.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe80c1647a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:58.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe80c164eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:58.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe80c1c6d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:16:58.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:16:58.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 10 monclient(hunting): picked mon.noname-c con 0x7fe80c058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:16:58.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 10 monclient(hunting): picked mon.noname-a con 0x7fe80c1626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:16:58.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 10 monclient(hunting): picked mon.noname-b con 0x7fe80c0b0410 addr v1:10.20.193.114:6789/0 2026-02-24T19:16:58.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0b1870 con 0x7fe80c1626a0 2026-02-24T19:16:58.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe810e87640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:16:58.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c1655c0 con 0x7fe80c0b0410 2026-02-24T19:16:58.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0b12b0 con 0x7fe80c058da0 2026-02-24T19:16:58.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe7faffd640 10 monclient(hunting): _renew_subs 2026-02-24T19:16:58.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.250+0000 7fe811688640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f00237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:16:58.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.251+0000 7fe811e89640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f0066820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:16:58.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.451+0000 7fe810e87640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:16:58.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.452+0000 7fe811e89640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f0066820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:16:58.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.452+0000 7fe811688640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f00237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:16:58.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.852+0000 7fe810e87640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:16:58.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.853+0000 7fe811e89640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f0066820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:16:58.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:58.853+0000 7fe811688640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f00237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:16:59.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:59.653+0000 7fe810e87640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:16:59.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:59.654+0000 7fe811e89640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f0066820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:16:59.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:16:59.654+0000 7fe811688640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f00237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:17:01.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 10 monclient(hunting): tick 2026-02-24T19:17:01.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:17:01.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 1 monclient(hunting): continuing hunt 2026-02-24T19:17:01.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:17:01.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f00237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:01.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f0066820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:01.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 10 monclient(hunting): picked mon.noname-b con 0x7fe80c0b0410 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 10 monclient(hunting): picked mon.noname-c con 0x7fe80c058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 10 monclient(hunting): picked mon.noname-a con 0x7fe80c1626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0b1590 con 0x7fe80c1626a0 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0b1870 con 0x7fe80c0b0410 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c1655c0 con 0x7fe80c058da0 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe7faffd640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe811e89640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe811688640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f00667c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:17:01.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.251+0000 7fe810e87640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f0023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:17:01.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.452+0000 7fe811e89640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:17:01.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.452+0000 7fe811688640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f00667c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:17:01.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.452+0000 7fe810e87640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f0023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:17:01.476 INFO:tasks.ceph.mon.b.trial114.stderr:--00:00:00:06.282 43721-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-24T19:17:01.496 INFO:tasks.ceph.mon.a.trial045.stderr:--00:00:00:06.304 44996-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-24T19:17:01.573 INFO:tasks.ceph.mon.c.trial179.stderr:--00:00:00:06.342 43655-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-24T19:17:01.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.853+0000 7fe811e89640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:17:01.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.854+0000 7fe811688640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f00667c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:17:01.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:01.854+0000 7fe810e87640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f0023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:17:02.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:02.654+0000 7fe811e89640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-24T19:17:02.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:02.655+0000 7fe810e87640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f0023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.179:6789/0 2026-02-24T19:17:02.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:02.655+0000 7fe811688640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f00667c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.114:6789/0 2026-02-24T19:17:02.989 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:00:07.795 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:02.995 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:00:07.803 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:03.077 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:00:07.846 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:03.138 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:00:07.944 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:03.144 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:00:07.952 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:03.226 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:00:07.995 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:04.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 10 monclient(hunting): tick 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 1 monclient(hunting): continuing hunt 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 1 -- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f0023720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 1 -- >> v1:10.20.193.114:6789/0 conn(0x7fe80c0b0410 legacy=0x7fe7f00667c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 10 monclient(hunting): picked mon.noname-b con 0x7fe7f006a110 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 10 monclient(hunting): picked mon.noname-a con 0x7fe80c1626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:04.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 10 monclient(hunting): picked mon.noname-c con 0x7fe80c058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:04.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0b12b0 con 0x7fe80c1626a0 2026-02-24T19:17:04.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0b1590 con 0x7fe7f006a110 2026-02-24T19:17:04.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0b1870 con 0x7fe80c058da0 2026-02-24T19:17:04.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe7faffd640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:04.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe811688640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fe7f006a110 0x7fe7f006a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:44386/0 (socket says 10.20.193.45:44386) 2026-02-24T19:17:04.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:04.251+0000 7fe811688640 1 -- 10.20.193.45:0/3519609162 learned_addr learned my addr 10.20.193.45:0/3519609162 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:05.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.433+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795353574 0 0) 0x7fe80c0b1590 con 0x7fe7f006a110 2026-02-24T19:17:05.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.433+0000 7fe7fbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.433+0000 7fe7fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.433+0000 7fe7fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.433+0000 7fe7fbfff640 10 monclient(hunting): my global_id is 4105 2026-02-24T19:17:05.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.433+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7f4003610 con 0x7fe7f006a110 2026-02-24T19:17:05.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.446+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619968070 0 0) 0x7fe80c0b12b0 con 0x7fe80c1626a0 2026-02-24T19:17:05.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.446+0000 7fe7fbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.446+0000 7fe7fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.446+0000 7fe7fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.446+0000 7fe7fbfff640 10 monclient(hunting): my global_id is 4101 2026-02-24T19:17:05.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.446+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe80c0b1590 con 0x7fe80c1626a0 2026-02-24T19:17:05.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.461+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986465681 0 0) 0x7fe80c0b1870 con 0x7fe80c058da0 2026-02-24T19:17:05.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.461+0000 7fe7fbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.461+0000 7fe7fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.461+0000 7fe7fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.461+0000 7fe7fbfff640 10 monclient(hunting): my global_id is 4106 2026-02-24T19:17:05.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.461+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe80c0b12b0 con 0x7fe80c058da0 2026-02-24T19:17:05.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 375362011 0 0) 0x7fe7f4003610 con 0x7fe7f006a110 2026-02-24T19:17:05.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe7f0023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe7f0044f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 1 monclient: found mon.noname-b 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c1655c0 con 0x7fe7f006a110 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe7fc0040b0 con 0x7fe7f006a110 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:05.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe7fbfff640 10 monclient: dump: 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe813913640 5 monclient: authenticate success, global_id 4105 2026-02-24T19:17:05.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.462+0000 7fe813913640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:05.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7fc0042f0 con 0x7fe7f006a110 2026-02-24T19:17:05.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe7fbfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:05.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe7fbfff640 1 -- 10.20.193.45:0/3519609162 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe7fc004700 con 0x7fe7f006a110 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe7fbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe7fbfff640 10 monclient: dump: 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:05.494 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe813913640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe813913640 4 set_mon_vals no callback set 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe813913640 10 monclient: shutdown 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe813913640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe813913640 1 -- 10.20.193.45:0/3519609162 >> v1:10.20.193.114:6789/0 conn(0x7fe7f006a110 legacy=0x7fe7f006a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe813913640 1 -- 10.20.193.45:0/3519609162 shutdown_connections 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe813913640 1 -- 10.20.193.45:0/3519609162 >> 10.20.193.45:0/3519609162 conn(0x7fe80c0b65f0 msgr2=0x7fe80c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe813913640 1 -- 10.20.193.45:0/3519609162 shutdown_connections 2026-02-24T19:17:05.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.490+0000 7fe813913640 1 -- 10.20.193.45:0/3519609162 wait complete. 2026-02-24T19:17:05.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 10 monclient: build_initial_monmap 2026-02-24T19:17:05.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 10 monclient: monmap: 2026-02-24T19:17:05.497 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 1 librados: starting msgr at 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 1 librados: starting objecter 2026-02-24T19:17:05.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 1 Processor -- start 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 1 -- start start 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 1 librados: setting wanted keys 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 1 librados: calling monclient init 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.491+0000 7fe813913640 10 monclient: init 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 10 monclient(hunting): picked mon.noname-b con 0x7fe7f006a110 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 10 monclient(hunting): picked mon.noname-c con 0x7fe80c058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 10 monclient(hunting): picked mon.noname-a con 0x7fe80c1626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c14b840 con 0x7fe80c1626a0 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c134db0 con 0x7fe7f006a110 2026-02-24T19:17:05.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c135090 con 0x7fe80c058da0 2026-02-24T19:17:05.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:05.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.492+0000 7fe813913640 10 monclient(hunting): authenticate will time out at 3597.131130s 2026-02-24T19:17:05.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.494+0000 7fe810e87640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 0x7fe80c13dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:56286/0 (socket says 10.20.193.45:56286) 2026-02-24T19:17:05.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.494+0000 7fe810e87640 1 -- 10.20.193.45:0/1640496566 learned_addr learned my addr 10.20.193.45:0/1640496566 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:05.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.494+0000 7fe7f9ffb640 10 client.?.objecter ms_handle_connect 0x7fe80c058da0 2026-02-24T19:17:05.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.494+0000 7fe7f9ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:05.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.498+0000 7fe7f9ffb640 10 client.?.objecter ms_handle_connect 0x7fe7f006a110 2026-02-24T19:17:05.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.498+0000 7fe7f9ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:05.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.521+0000 7fe7f9ffb640 10 client.?.objecter ms_handle_connect 0x7fe80c1626a0 2026-02-24T19:17:05.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.521+0000 7fe7f9ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:05.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.538+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131003673 0 0) 0x7fe80c14b840 con 0x7fe80c1626a0 2026-02-24T19:17:05.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.538+0000 7fe7f9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.538+0000 7fe7f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.538+0000 7fe7f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.538+0000 7fe7f9ffb640 10 monclient(hunting): my global_id is 4110 2026-02-24T19:17:05.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.538+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7dc003610 con 0x7fe80c1626a0 2026-02-24T19:17:05.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.541+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181321893 0 0) 0x7fe80c134db0 con 0x7fe7f006a110 2026-02-24T19:17:05.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.541+0000 7fe7f9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.541+0000 7fe7f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.541+0000 7fe7f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.541+0000 7fe7f9ffb640 10 monclient(hunting): my global_id is 4111 2026-02-24T19:17:05.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.541+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe80c14b840 con 0x7fe7f006a110 2026-02-24T19:17:05.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.546+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291395151 0 0) 0x7fe80c135090 con 0x7fe80c058da0 2026-02-24T19:17:05.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.546+0000 7fe7f9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.546+0000 7fe7f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.546+0000 7fe7f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.546+0000 7fe7f9ffb640 10 monclient(hunting): my global_id is 4112 2026-02-24T19:17:05.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.546+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe80c134db0 con 0x7fe80c058da0 2026-02-24T19:17:05.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.551+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1685762490 0 0) 0x7fe7dc003610 con 0x7fe80c1626a0 2026-02-24T19:17:05.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.551+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe80c135090 con 0x7fe80c1626a0 2026-02-24T19:17:05.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.551+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe808004650 con 0x7fe80c1626a0 2026-02-24T19:17:05.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.551+0000 7fe7f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:05.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.551+0000 7fe7f9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:05.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.551+0000 7fe7f9ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.551+0000 7fe7f9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:05.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3470599543 0 0) 0x7fe80c135090 con 0x7fe80c1626a0 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 >> v1:10.20.193.179:6789/0 conn(0x7fe80c058da0 legacy=0x7fe80c13dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 >> v1:10.20.193.114:6789/0 conn(0x7fe7f006a110 legacy=0x7fe80c14b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 1 monclient: found mon.a 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c135370 con 0x7fe80c1626a0 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.603+0000 7fe7f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:05.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 5 monclient: authenticate success, global_id 4110 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 10 monclient: _renew_subs 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 1 -- 10.20.193.45:0/1640496566 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe80c135650 con 0x7fe80c1626a0 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 10 client.4110.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 10 monclient: _renew_subs 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 1 -- 10.20.193.45:0/1640496566 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe80c135c10 con 0x7fe80c1626a0 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 1 librados: init done 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.604+0000 7fe813913640 1 -- 10.20.193.45:0/1640496566 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe80c11a820 con 0x7fe80c1626a0 2026-02-24T19:17:05.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe808004aa0 con 0x7fe80c1626a0 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe808004e70 con 0x7fe80c1626a0 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7fb7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 10 monclient: dump: 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fe808005460 con 0x7fe80c1626a0 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 660270599 0 0) 0x7fe808006ee0 con 0x7fe80c1626a0 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 10 client.4110.objecter ms_dispatch2 0x7fe80c000b90 osd_map(1..1 src has 1..1) 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 3 client.4110.objecter handle_osd_map got epochs [1,1] > 0 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 3 client.4110.objecter handle_osd_map decoding full epoch 1 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 20 client.4110.objecter dump_active .. 0 homeless 2026-02-24T19:17:05.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fe80c11a820 con 0x7fe80c1626a0 2026-02-24T19:17:05.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:05.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.685+0000 7fe7f9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:05.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.714+0000 7fe813913640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-24T19:17:05.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.714+0000 7fe813913640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-24T19:17:05.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.714+0000 7fe813913640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.714+0000 7fe813913640 1 -- 10.20.193.45:0/1640496566 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe80c118e40 con 0x7fe80c1626a0 2026-02-24T19:17:05.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.732+0000 7fe7f9ffb640 1 -- 10.20.193.45:0/1640496566 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7fe8080073b0 con 0x7fe80c1626a0 2026-02-24T19:17:05.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.732+0000 7fe7f9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-24T19:17:05.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.732+0000 7fe7f9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:05.736 INFO:teuthology.orchestra.run.trial045.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T19:17:05.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 10 librados: watch_flush enter 2026-02-24T19:17:05.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 10 librados: watch_flush exit 2026-02-24T19:17:05.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 20 client.4110.objecter shutdown clearing up homeless session... 2026-02-24T19:17:05.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 10 client.4110.objecter successfully canceled tick 2026-02-24T19:17:05.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 10 monclient: shutdown 2026-02-24T19:17:05.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:05.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 1 -- 10.20.193.45:0/1640496566 >> v1:10.20.193.45:6789/0 conn(0x7fe80c1626a0 legacy=0x7fe80c1190e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 1 -- 10.20.193.45:0/1640496566 shutdown_connections 2026-02-24T19:17:05.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 1 -- 10.20.193.45:0/1640496566 >> 10.20.193.45:0/1640496566 conn(0x7fe80c0b65f0 msgr2=0x7fe80c059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:05.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 1 -- 10.20.193.45:0/1640496566 shutdown_connections 2026-02-24T19:17:05.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 1 -- 10.20.193.45:0/1640496566 wait complete. 2026-02-24T19:17:05.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.733+0000 7fe813913640 1 librados: shutdown 2026-02-24T19:17:05.744 INFO:tasks.ceph:Setting crush tunables to default 2026-02-24T19:17:05.744 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph osd crush tunables default 2026-02-24T19:17:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.807+0000 7fe9c64c7640 10 monclient: get_monmap_and_config 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.807+0000 7fe9c64c7640 10 monclient: build_initial_monmap 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.807+0000 7fe9c64c7640 10 monclient: monmap: 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:05.808957+0000 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:05.808957+0000 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:05.811 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:05.812 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:05.812 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 1 Processor -- start 2026-02-24T19:17:05.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 1 -- start start 2026-02-24T19:17:05.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 10 monclient: init 2026-02-24T19:17:05.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:05.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:05.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 10 monclient(hunting): picked mon.noname-a con 0x7fe9c0159b90 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:05.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 10 monclient(hunting): picked mon.noname-c con 0x7fe9c0163c60 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:05.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 10 monclient(hunting): picked mon.noname-b con 0x7fe9c005daa0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:05.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c01640c0 con 0x7fe9c0159b90 2026-02-24T19:17:05.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c00b0f40 con 0x7fe9c005daa0 2026-02-24T19:17:05.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c00b1220 con 0x7fe9c0163c60 2026-02-24T19:17:05.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:05.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.808+0000 7fe9c64c7640 10 monclient(hunting): authenticate will time out at 3597.447856s 2026-02-24T19:17:05.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.809+0000 7fe9bf7fe640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fe9c0163c60 0x7fe9c005d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:56296/0 (socket says 10.20.193.45:56296) 2026-02-24T19:17:05.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.809+0000 7fe9bf7fe640 1 -- 10.20.193.45:0/412517467 learned_addr learned my addr 10.20.193.45:0/412517467 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:05.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.814+0000 7fe9beffd640 1 -- 10.20.193.45:0/412517467 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700867622 0 0) 0x7fe9c01640c0 con 0x7fe9c0159b90 2026-02-24T19:17:05.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.814+0000 7fe9beffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.814+0000 7fe9beffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.814+0000 7fe9beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.814+0000 7fe9beffd640 10 monclient(hunting): my global_id is 4116 2026-02-24T19:17:05.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.814+0000 7fe9beffd640 1 -- 10.20.193.45:0/412517467 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9a4003610 con 0x7fe9c0159b90 2026-02-24T19:17:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 1 -- 10.20.193.45:0/412517467 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4192658875 0 0) 0x7fe9a4003610 con 0x7fe9c0159b90 2026-02-24T19:17:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 1 -- 10.20.193.45:0/412517467 >> v1:10.20.193.179:6789/0 conn(0x7fe9c0163c60 legacy=0x7fe9c005d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 1 -- 10.20.193.45:0/412517467 >> v1:10.20.193.114:6789/0 conn(0x7fe9c005daa0 legacy=0x7fe9c01c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 1 -- 10.20.193.45:0/412517467 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c00b1500 con 0x7fe9c0159b90 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 1 -- 10.20.193.45:0/412517467 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe9ac002df0 con 0x7fe9c0159b90 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9beffd640 10 monclient: dump: 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:05.821 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9c64c7640 5 monclient: authenticate success, global_id 4116 2026-02-24T19:17:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.817+0000 7fe9c64c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.819+0000 7fe9beffd640 1 -- 10.20.193.45:0/412517467 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9ac003000 con 0x7fe9c0159b90 2026-02-24T19:17:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.819+0000 7fe9beffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.819+0000 7fe9beffd640 1 -- 10.20.193.45:0/412517467 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe9ac003400 con 0x7fe9c0159b90 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.819+0000 7fe9beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.819+0000 7fe9beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.819+0000 7fe9beffd640 10 monclient: dump: 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:05.826 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.819+0000 7fe9c64c7640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.819+0000 7fe9c64c7640 4 set_mon_vals no callback set 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 10 monclient: shutdown 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 -- 10.20.193.45:0/412517467 >> v1:10.20.193.45:6789/0 conn(0x7fe9c0159b90 legacy=0x7fe9c00b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 -- 10.20.193.45:0/412517467 shutdown_connections 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 -- 10.20.193.45:0/412517467 >> 10.20.193.45:0/412517467 conn(0x7fe9c00b2f10 msgr2=0x7fe9c00b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 -- 10.20.193.45:0/412517467 shutdown_connections 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 -- 10.20.193.45:0/412517467 wait complete. 2026-02-24T19:17:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 10 monclient: build_initial_monmap 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 10 monclient: monmap: 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 librados: starting msgr at 2026-02-24T19:17:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 librados: starting objecter 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 Processor -- start 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 -- start start 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 librados: setting wanted keys 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 1 librados: calling monclient init 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.820+0000 7fe9c64c7640 10 monclient: init 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 10 monclient(hunting): picked mon.noname-b con 0x7fe9c005daa0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 10 monclient(hunting): picked mon.noname-c con 0x7fe9c0159b90 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 10 monclient(hunting): picked mon.noname-a con 0x7fe9c0163c60 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c013d050 con 0x7fe9c0163c60 2026-02-24T19:17:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c013d330 con 0x7fe9c005daa0 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9c013d610 con 0x7fe9c0159b90 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c64c7640 10 monclient(hunting): authenticate will time out at 3597.460389s 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c4a3d640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe9c0163c60 0x7fe9c015f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:55702/0 (socket says 10.20.193.45:55702) 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9c4a3d640 1 -- 10.20.193.45:0/3834519694 learned_addr learned my addr 10.20.193.45:0/3834519694 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9bcff9640 10 client.?.objecter ms_handle_connect 0x7fe9c0163c60 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.821+0000 7fe9bcff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.822+0000 7fe9bcff9640 10 client.?.objecter ms_handle_connect 0x7fe9c005daa0 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.822+0000 7fe9bcff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.822+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919297952 0 0) 0x7fe9c013d050 con 0x7fe9c0163c60 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.822+0000 7fe9bcff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.822+0000 7fe9bcff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.822+0000 7fe9bcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.822+0000 7fe9bcff9640 10 monclient(hunting): my global_id is 4119 2026-02-24T19:17:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.822+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe990003610 con 0x7fe9c0163c60 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.825+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 453852700 0 0) 0x7fe990003610 con 0x7fe9c0163c60 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.825+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9c013d050 con 0x7fe9c0163c60 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.825+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe9b4003490 con 0x7fe9c0163c60 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.825+0000 7fe9bcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.825+0000 7fe9bcff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.825+0000 7fe9bcff9640 10 monclient(hunting): dump: 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.833 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.825+0000 7fe9bcff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1925851569 0 0) 0x7fe9c013d050 con 0x7fe9c0163c60 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 >> v1:10.20.193.179:6789/0 conn(0x7fe9c0159b90 legacy=0x7fe9c01fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 >> v1:10.20.193.114:6789/0 conn(0x7fe9c005daa0 legacy=0x7fe9c01fe340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 1 monclient: found mon.a 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c01fcba0 con 0x7fe9c0163c60 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9bcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9c64c7640 5 monclient: authenticate success, global_id 4119 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9c64c7640 10 monclient: _renew_subs 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9c64c7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9c64c7640 1 -- 10.20.193.45:0/3834519694 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c01fce80 con 0x7fe9c0163c60 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9c64c7640 10 client.4119.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9c64c7640 10 monclient: _renew_subs 2026-02-24T19:17:05.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9c64c7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9c64c7640 1 -- 10.20.193.45:0/3834519694 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe9c013cd30 con 0x7fe9c0163c60 2026-02-24T19:17:05.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.827+0000 7fe9c64c7640 1 librados: init done 2026-02-24T19:17:05.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.828+0000 7fe9c64c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:05.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.828+0000 7fe9c64c7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:05.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.828+0000 7fe9c64c7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.828+0000 7fe9c64c7640 1 -- 10.20.193.45:0/3834519694 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c00589b0 con 0x7fe9c0163c60 2026-02-24T19:17:05.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9b4003840 con 0x7fe9c0163c60 2026-02-24T19:17:05.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:05.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe9b4003f10 con 0x7fe9c0163c60 2026-02-24T19:17:05.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9be7fc640 4 set_mon_vals no callback set 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 10 monclient: dump: 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:05.879 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fe9b4004500 con 0x7fe9c0163c60 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 660270599 0 0) 0x7fe9b4006ec0 con 0x7fe9c0163c60 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 10 client.4119.objecter ms_dispatch2 0x7fe9c0000b90 osd_map(1..1 src has 1..1) 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 3 client.4119.objecter handle_osd_map got epochs [1,1] > 0 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 3 client.4119.objecter handle_osd_map decoding full epoch 1 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 20 client.4119.objecter dump_active .. 0 homeless 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fe9b40072a0 con 0x7fe9c0163c60 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:05.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.875+0000 7fe9bcff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:05.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.904+0000 7fe9c64c7640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-24T19:17:05.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.904+0000 7fe9c64c7640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-24T19:17:05.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.904+0000 7fe9c64c7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:05.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.904+0000 7fe9c64c7640 1 -- 10.20.193.45:0/3834519694 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe9c00b08c0 con 0x7fe9c0163c60 2026-02-24T19:17:05.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.982+0000 7fe9bcff9640 1 -- 10.20.193.45:0/3834519694 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7fe9b4007660 con 0x7fe9c0163c60 2026-02-24T19:17:05.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.982+0000 7fe9bcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-24T19:17:05.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.982+0000 7fe9bcff9640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-24T19:17:05.985 INFO:teuthology.orchestra.run.trial045.stderr:adjusted tunables profile to default 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 10 librados: watch_flush enter 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 10 librados: watch_flush exit 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 20 client.4119.objecter shutdown clearing up homeless session... 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 10 client.4119.objecter successfully canceled tick 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 10 monclient: shutdown 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 1 -- 10.20.193.45:0/3834519694 >> v1:10.20.193.45:6789/0 conn(0x7fe9c0163c60 legacy=0x7fe9c015f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 1 -- 10.20.193.45:0/3834519694 shutdown_connections 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 1 -- 10.20.193.45:0/3834519694 >> 10.20.193.45:0/3834519694 conn(0x7fe9c00b2f10 msgr2=0x7fe9c0059af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 1 -- 10.20.193.45:0/3834519694 shutdown_connections 2026-02-24T19:17:05.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 1 -- 10.20.193.45:0/3834519694 wait complete. 2026-02-24T19:17:05.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:05.983+0000 7fe9c64c7640 1 librados: shutdown 2026-02-24T19:17:05.994 INFO:tasks.ceph:check_enable_crimson: False 2026-02-24T19:17:05.994 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-24T19:17:05.994 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:17:05.994 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-24T19:17:06.018 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:17:06.019 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-24T19:17:06.083 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:17:06.084 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-24T19:17:06.150 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-24T19:17:06.150 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-24T19:17:06.212 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:17:06.213 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-24T19:17:06.239 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:17:06.239 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-24T19:17:06.303 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:17:06.303 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-24T19:17:06.368 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-24T19:17:06.368 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-24T19:17:06.380 INFO:tasks.ceph.mgr.y.trial045.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T19:17:06.380 INFO:tasks.ceph.mgr.y.trial045.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T19:17:06.381 INFO:tasks.ceph.mgr.y.trial045.stderr: from numpy import show_config as show_numpy_config 2026-02-24T19:17:06.432 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:17:06.432 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-24T19:17:06.458 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:17:06.458 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-24T19:17:06.522 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:17:06.522 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-24T19:17:06.548 INFO:tasks.ceph.mgr.x.trial194.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T19:17:06.549 INFO:tasks.ceph.mgr.x.trial194.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T19:17:06.549 INFO:tasks.ceph.mgr.x.trial194.stderr: from numpy import show_config as show_numpy_config 2026-02-24T19:17:06.586 DEBUG:teuthology.orchestra.run.trial179:> set -ex 2026-02-24T19:17:06.586 DEBUG:teuthology.orchestra.run.trial179:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-24T19:17:06.654 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:17:06.654 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-24T19:17:06.686 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:17:06.686 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-24T19:17:06.753 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:17:06.753 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-24T19:17:06.819 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:17:06.819 DEBUG:teuthology.orchestra.run.trial194:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-24T19:17:06.883 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new 53650ce1-deec-4943-ba8b-cdf389f4e5e7 0 2026-02-24T19:17:06.989 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.985+0000 7fe67cce8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:06.989 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.985+0000 7fe67cce8640 10 monclient: build_initial_monmap 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.985+0000 7fe67cce8640 10 monclient: monmap: 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:06.987019+0000 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:06.987019+0000 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:06.990 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.985+0000 7fe67cce8640 1 Processor -- start 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 1 -- start start 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 10 monclient: init 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 10 monclient(hunting): picked mon.noname-b con 0x7fe67811fa30 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 10 monclient(hunting): picked mon.noname-c con 0x7fe678142940 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 10 monclient(hunting): picked mon.noname-a con 0x7fe6781644a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe678186250 con 0x7fe6781644a0 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe678187450 con 0x7fe67811fa30 2026-02-24T19:17:06.991 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe678188650 con 0x7fe678142940 2026-02-24T19:17:06.992 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:06.992 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe67cce8640 10 monclient(hunting): authenticate will time out at 3600.643196s 2026-02-24T19:17:06.992 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe676d76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe6781644a0 0x7fe678184950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39742/0 (socket says 10.20.193.194:39742) 2026-02-24T19:17:06.992 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.986+0000 7fe676d76640 1 -- 10.20.193.194:0/418630583 learned_addr learned my addr 10.20.193.194:0/418630583 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117295869 0 0) 0x7fe678186250 con 0x7fe6781644a0 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): my global_id is 4122 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe664003610 con 0x7fe6781644a0 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800143527 0 0) 0x7fe678188650 con 0x7fe678142940 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:06.999 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): my global_id is 4118 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe678186250 con 0x7fe678142940 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854343060 0 0) 0x7fe678187450 con 0x7fe67811fa30 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 10 monclient(hunting): my global_id is 4117 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.988+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe678188650 con 0x7fe67811fa30 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4092905872 0 0) 0x7fe664003610 con 0x7fe6781644a0 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 >> v1:10.20.193.179:6789/0 conn(0x7fe678142940 legacy=0x7fe678162d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 >> v1:10.20.193.114:6789/0 conn(0x7fe67811fa30 legacy=0x7fe67811fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.000 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 1 monclient: found mon.noname-a 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6781898f0 con 0x7fe6781644a0 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 10 monclient: _finish_auth 0 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe668003170 con 0x7fe6781644a0 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe675573640 10 monclient: dump: 2026-02-24T19:17:07.001 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe67cce8640 5 monclient: authenticate success, global_id 4122 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.989+0000 7fe67cce8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:07.002 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6680033b0 con 0x7fe6781644a0 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe675573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe675573640 1 -- 10.20.193.194:0/418630583 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe6680037f0 con 0x7fe6781644a0 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe675573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe675573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe675573640 10 monclient: dump: 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.003 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe67cce8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe67cce8640 4 set_mon_vals no callback set 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe67cce8640 10 monclient: shutdown 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe67cce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe67cce8640 1 -- 10.20.193.194:0/418630583 >> v1:10.20.193.45:6789/0 conn(0x7fe6781644a0 legacy=0x7fe678184950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe67cce8640 1 -- 10.20.193.194:0/418630583 shutdown_connections 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe67cce8640 1 -- 10.20.193.194:0/418630583 >> 10.20.193.194:0/418630583 conn(0x7fe678058810 msgr2=0x7fe678058c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.990+0000 7fe67cce8640 1 -- 10.20.193.194:0/418630583 shutdown_connections 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 -- 10.20.193.194:0/418630583 wait complete. 2026-02-24T19:17:07.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient: build_initial_monmap 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient: monmap: 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 librados: starting msgr at 2026-02-24T19:17:07.005 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 librados: starting objecter 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 Processor -- start 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 -- start start 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 librados: setting wanted keys 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 librados: calling monclient init 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient: init 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient(hunting): picked mon.noname-a con 0x7fe67811fa30 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient(hunting): picked mon.noname-b con 0x7fe678142940 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient(hunting): picked mon.noname-c con 0x7fe6781644a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:07.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67812e9b0 con 0x7fe67811fa30 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67812fb90 con 0x7fe678142940 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe678130d70 con 0x7fe6781644a0 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.991+0000 7fe67cce8640 10 monclient(hunting): authenticate will time out at 3600.648954s 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.992+0000 7fe676575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe67811fa30 0x7fe678184930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39750/0 (socket says 10.20.193.194:39750) 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.992+0000 7fe676575640 1 -- 10.20.193.194:0/3582837187 learned_addr learned my addr 10.20.193.194:0/3582837187 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.992+0000 7fe65effd640 10 client.?.objecter ms_handle_connect 0x7fe67811fa30 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.992+0000 7fe65effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.992+0000 7fe65effd640 10 client.?.objecter ms_handle_connect 0x7fe678142940 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.992+0000 7fe65effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.992+0000 7fe65effd640 10 client.?.objecter ms_handle_connect 0x7fe6781644a0 2026-02-24T19:17:07.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.992+0000 7fe65effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792242459 0 0) 0x7fe67812e9b0 con 0x7fe67811fa30 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): my global_id is 4125 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe644003610 con 0x7fe67811fa30 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706051570 0 0) 0x7fe678130d70 con 0x7fe6781644a0 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): my global_id is 4121 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe67812e9b0 con 0x7fe6781644a0 2026-02-24T19:17:07.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950200411 0 0) 0x7fe67812fb90 con 0x7fe678142940 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 10 monclient(hunting): my global_id is 4120 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.993+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe678130d70 con 0x7fe678142940 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2469817810 0 0) 0x7fe67812e9b0 con 0x7fe6781644a0 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe67812fb90 con 0x7fe6781644a0 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe668003560 con 0x7fe6781644a0 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 10 monclient(hunting): dump: 2026-02-24T19:17:07.009 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 765674530 0 0) 0x7fe644003610 con 0x7fe67811fa30 2026-02-24T19:17:07.010 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe67812e9b0 con 0x7fe67811fa30 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe66c003170 con 0x7fe67811fa30 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.995+0000 7fe65effd640 10 monclient(hunting): dump: 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.011 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.996+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2152793162 0 0) 0x7fe678130d70 con 0x7fe678142940 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.996+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe644003610 con 0x7fe678142940 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.996+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe6600030b0 con 0x7fe678142940 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.996+0000 7fe65effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.996+0000 7fe65effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.996+0000 7fe65effd640 10 monclient(hunting): dump: 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.012 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.013 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.013 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.013 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.013 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.014 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1660122144 0 0) 0x7fe67812fb90 con 0x7fe6781644a0 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 >> v1:10.20.193.114:6789/0 conn(0x7fe678142940 legacy=0x7fe678127180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 >> v1:10.20.193.45:6789/0 conn(0x7fe67811fa30 legacy=0x7fe678184930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 1 monclient: found mon.c 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe678131f50 con 0x7fe6781644a0 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 10 monclient: _finish_auth 0 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe65effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:07.015 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe67cce8640 5 monclient: authenticate success, global_id 4121 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe67cce8640 10 monclient: _renew_subs 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe67cce8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe67cce8640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe67812fd60 con 0x7fe6781644a0 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe67cce8640 10 client.4121.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe67cce8640 10 monclient: _renew_subs 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe67cce8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe67cce8640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe6781302d0 con 0x7fe6781644a0 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.997+0000 7fe67cce8640 1 librados: init done 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.998+0000 7fe67cce8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.998+0000 7fe67cce8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.998+0000 7fe67cce8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.016 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:06.998+0000 7fe67cce8640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe678187b20 con 0x7fe6781644a0 2026-02-24T19:17:07.067 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.065+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe668002cf0 con 0x7fe6781644a0 2026-02-24T19:17:07.067 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.065+0000 7fe65effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:07.067 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.065+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe668004db0 con 0x7fe6781644a0 2026-02-24T19:17:07.067 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.065+0000 7fe65effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.067 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.065+0000 7fe65effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:07.067 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.065+0000 7fe674d72640 4 set_mon_vals no callback set 2026-02-24T19:17:07.067 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.065+0000 7fe65effd640 10 monclient: dump: 2026-02-24T19:17:07.067 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.067 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.068 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.068 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.068 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.068 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.068 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.068 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.068 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.068 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.069 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.067+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fe668005360 con 0x7fe6781644a0 2026-02-24T19:17:07.069 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.067+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 3539389729 0 0) 0x7fe668006a20 con 0x7fe6781644a0 2026-02-24T19:17:07.069 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.067+0000 7fe65effd640 10 client.4121.objecter ms_dispatch2 0x7fe678000b90 osd_map(2..2 src has 1..2) 2026-02-24T19:17:07.069 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.067+0000 7fe65effd640 3 client.4121.objecter handle_osd_map got epochs [2,2] > 0 2026-02-24T19:17:07.069 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.067+0000 7fe65effd640 3 client.4121.objecter handle_osd_map decoding full epoch 2 2026-02-24T19:17:07.069 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.067+0000 7fe65effd640 20 client.4121.objecter dump_active .. 0 homeless 2026-02-24T19:17:07.069 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.067+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fe668019f00 con 0x7fe6781644a0 2026-02-24T19:17:07.069 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.067+0000 7fe65effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.069 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.067+0000 7fe65effd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:07.102 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.100+0000 7fe67cce8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "53650ce1-deec-4943-ba8b-cdf389f4e5e7", "id": 0}] 2026-02-24T19:17:07.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.100+0000 7fe67cce8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "53650ce1-deec-4943-ba8b-cdf389f4e5e7", "id": 0}] 2026-02-24T19:17:07.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.100+0000 7fe67cce8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.100+0000 7fe67cce8640 1 -- 10.20.193.194:0/3582837187 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd new", "uuid": "53650ce1-deec-4943-ba8b-cdf389f4e5e7", "id": 0} v 0) -- 0x7fe678130610 con 0x7fe6781644a0 2026-02-24T19:17:07.204 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.202+0000 7fe65effd640 1 -- 10.20.193.194:0/3582837187 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53650ce1-deec-4943-ba8b-cdf389f4e5e7", "id": 0}]=0 v3) ==== 112+0+2 (unknown 2737301345 0 732707515) 0x7fe6680057f0 con 0x7fe6781644a0 2026-02-24T19:17:07.204 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.202+0000 7fe65effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "53650ce1-deec-4943-ba8b-cdf389f4e5e7", "id": 0}] 2026-02-24T19:17:07.204 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.202+0000 7fe65effd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:07.204 INFO:teuthology.orchestra.run.trial194.stdout:0 2026-02-24T19:17:07.205 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 10 librados: watch_flush enter 2026-02-24T19:17:07.205 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 10 librados: watch_flush exit 2026-02-24T19:17:07.205 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 20 client.4121.objecter shutdown clearing up homeless session... 2026-02-24T19:17:07.205 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 10 client.4121.objecter successfully canceled tick 2026-02-24T19:17:07.205 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 10 monclient: shutdown 2026-02-24T19:17:07.205 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:07.205 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 1 -- 10.20.193.194:0/3582837187 >> v1:10.20.193.179:6789/0 conn(0x7fe6781644a0 legacy=0x7fe678163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.205 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 1 -- 10.20.193.194:0/3582837187 shutdown_connections 2026-02-24T19:17:07.205 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 1 -- 10.20.193.194:0/3582837187 >> 10.20.193.194:0/3582837187 conn(0x7fe678058810 msgr2=0x7fe678185120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:07.206 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 1 -- 10.20.193.194:0/3582837187 shutdown_connections 2026-02-24T19:17:07.206 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 1 -- 10.20.193.194:0/3582837187 wait complete. 2026-02-24T19:17:07.206 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.203+0000 7fe67cce8640 1 librados: shutdown 2026-02-24T19:17:07.213 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new e3d2506e-9e10-4206-96d1-3dd8aa4d91cb 1 2026-02-24T19:17:07.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.275+0000 7f6e44144640 10 monclient: get_monmap_and_config 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.275+0000 7f6e44144640 10 monclient: build_initial_monmap 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.275+0000 7f6e44144640 10 monclient: monmap: 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:07.277093+0000 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:07.277093+0000 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 1 Processor -- start 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 1 -- start start 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 10 monclient: init 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 10 monclient(hunting): picked mon.noname-a con 0x7f6e3c05da60 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 10 monclient(hunting): picked mon.noname-b con 0x7f6e3c05df20 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 10 monclient(hunting): picked mon.noname-c con 0x7f6e3c161240 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c182ea0 con 0x7f6e3c05da60 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c1840a0 con 0x7f6e3c05df20 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c1852a0 con 0x7f6e3c161240 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:07.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e44144640 10 monclient(hunting): authenticate will time out at 3600.933478s 2026-02-24T19:17:07.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e41eb9640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6e3c05da60 0x7f6e3c05c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39756/0 (socket says 10.20.193.194:39756) 2026-02-24T19:17:07.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.276+0000 7f6e41eb9640 1 -- 10.20.193.194:0/2598952323 learned_addr learned my addr 10.20.193.194:0/2598952323 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054966663 0 0) 0x7f6e3c1840a0 con 0x7f6e3c05df20 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): my global_id is 4123 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e24003610 con 0x7f6e3c05df20 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 580627549 0 0) 0x7f6e3c1852a0 con 0x7f6e3c161240 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): my global_id is 4124 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e3c1840a0 con 0x7f6e3c161240 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177786383 0 0) 0x7f6e3c182ea0 con 0x7f6e3c05da60 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 10 monclient(hunting): my global_id is 4128 2026-02-24T19:17:07.281 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.278+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e3c1852a0 con 0x7f6e3c05da60 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2497842682 0 0) 0x7f6e24003610 con 0x7f6e3c05df20 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 >> v1:10.20.193.179:6789/0 conn(0x7f6e3c161240 legacy=0x7f6e3c181620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 >> v1:10.20.193.45:6789/0 conn(0x7f6e3c05da60 legacy=0x7f6e3c05c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 10 monclient: _finish_hunting 0 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 1 monclient: found mon.noname-b 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c186540 con 0x7f6e3c05df20 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 10 monclient: _finish_auth 0 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 10 monclient: _check_auth_tickets 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e30002df0 con 0x7f6e3c05df20 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e40eb7640 10 monclient: dump: 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e44144640 5 monclient: authenticate success, global_id 4123 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.279+0000 7f6e44144640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:07.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.280+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e30003000 con 0x7f6e3c05df20 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.280+0000 7f6e40eb7640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.280+0000 7f6e40eb7640 1 -- 10.20.193.194:0/2598952323 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e30003440 con 0x7f6e3c05df20 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.280+0000 7f6e44144640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.280+0000 7f6e40eb7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.280+0000 7f6e44144640 4 set_mon_vals no callback set 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.280+0000 7f6e40eb7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.280+0000 7f6e40eb7640 10 monclient: dump: 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient: shutdown 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 -- 10.20.193.194:0/2598952323 >> v1:10.20.193.114:6789/0 conn(0x7f6e3c05df20 legacy=0x7f6e3c05ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 -- 10.20.193.194:0/2598952323 shutdown_connections 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 -- 10.20.193.194:0/2598952323 >> 10.20.193.194:0/2598952323 conn(0x7f6e3c0588d0 msgr2=0x7f6e3c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:07.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 -- 10.20.193.194:0/2598952323 shutdown_connections 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 -- 10.20.193.194:0/2598952323 wait complete. 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient: build_initial_monmap 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient: monmap: 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 librados: starting msgr at 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 librados: starting objecter 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 Processor -- start 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 -- start start 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 librados: setting wanted keys 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 librados: calling monclient init 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient: init 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient(hunting): picked mon.noname-c con 0x7f6e3c05da60 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient(hunting): picked mon.noname-b con 0x7f6e3c05df20 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:07.284 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient(hunting): picked mon.noname-a con 0x7f6e3c161240 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c14beb0 con 0x7f6e3c161240 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c14d090 con 0x7f6e3c05df20 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c14e270 con 0x7f6e3c05da60 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.281+0000 7f6e44144640 10 monclient(hunting): authenticate will time out at 3600.938833s 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.282+0000 7f6e426ba640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6e3c161240 0x7f6e3c14a790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39762/0 (socket says 10.20.193.194:39762) 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.282+0000 7f6e426ba640 1 -- 10.20.193.194:0/168119032 learned_addr learned my addr 10.20.193.194:0/168119032 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.282+0000 7f6e2a7fc640 10 client.?.objecter ms_handle_connect 0x7f6e3c05da60 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.282+0000 7f6e2a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.282+0000 7f6e2a7fc640 10 client.?.objecter ms_handle_connect 0x7f6e3c05df20 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.282+0000 7f6e2a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.282+0000 7f6e2a7fc640 10 client.?.objecter ms_handle_connect 0x7f6e3c161240 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.282+0000 7f6e2a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649068091 0 0) 0x7f6e3c14e270 con 0x7f6e3c05da60 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): my global_id is 4127 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e0c003610 con 0x7f6e3c05da60 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095814577 0 0) 0x7f6e3c14d090 con 0x7f6e3c05df20 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): my global_id is 4126 2026-02-24T19:17:07.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e3c14e270 con 0x7f6e3c05df20 2026-02-24T19:17:07.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2006276436 0 0) 0x7f6e3c14beb0 con 0x7f6e3c161240 2026-02-24T19:17:07.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 10 monclient(hunting): my global_id is 4131 2026-02-24T19:17:07.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.283+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e3c14d090 con 0x7f6e3c161240 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2223015351 0 0) 0x7f6e0c003610 con 0x7f6e3c05da60 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e3c14beb0 con 0x7f6e3c05da60 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e2c002fc0 con 0x7f6e3c05da60 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.287 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1457443555 0 0) 0x7f6e3c14e270 con 0x7f6e3c05df20 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e0c003610 con 0x7f6e3c05df20 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e30003350 con 0x7f6e3c05df20 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.285+0000 7f6e2a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.286+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2535210717 0 0) 0x7f6e3c14d090 con 0x7f6e3c161240 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.286+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e3c14e270 con 0x7f6e3c161240 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.286+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e38003540 con 0x7f6e3c161240 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.286+0000 7f6e2a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.286+0000 7f6e2a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.286+0000 7f6e2a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.288 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3587791571 0 0) 0x7f6e3c14beb0 con 0x7f6e3c05da60 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 >> v1:10.20.193.114:6789/0 conn(0x7f6e3c05df20 legacy=0x7f6e3c149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 >> v1:10.20.193.45:6789/0 conn(0x7f6e3c161240 legacy=0x7f6e3c14a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 1 monclient: found mon.c 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c14f450 con 0x7f6e3c05da60 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 5 monclient: authenticate success, global_id 4127 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 10 monclient: _renew_subs 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c14d260 con 0x7f6e3c05da60 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 10 client.4127.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 10 monclient: _renew_subs 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e3c14d850 con 0x7f6e3c05da60 2026-02-24T19:17:07.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 1 librados: init done 2026-02-24T19:17:07.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.287+0000 7f6e44144640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c1835c0 con 0x7f6e3c05da60 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.317+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e2c0048d0 con 0x7f6e3c05da60 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.317+0000 7f6e2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.317+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e2c004ca0 con 0x7f6e3c05da60 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.317+0000 7f6e2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.317+0000 7f6e2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.317+0000 7f6e2a7fc640 10 monclient: dump: 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.320 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.317+0000 7f6e2bfff640 4 set_mon_vals no callback set 2026-02-24T19:17:07.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.320+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f6e2c005250 con 0x7f6e3c05da60 2026-02-24T19:17:07.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.320+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 3291131271 0 0) 0x7f6e2c006930 con 0x7f6e3c05da60 2026-02-24T19:17:07.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.320+0000 7f6e2a7fc640 10 client.4127.objecter ms_dispatch2 0x7f6e3c000b90 osd_map(3..3 src has 1..3) 2026-02-24T19:17:07.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.320+0000 7f6e2a7fc640 3 client.4127.objecter handle_osd_map got epochs [3,3] > 0 2026-02-24T19:17:07.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.320+0000 7f6e2a7fc640 3 client.4127.objecter handle_osd_map decoding full epoch 3 2026-02-24T19:17:07.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.320+0000 7f6e2a7fc640 20 client.4127.objecter dump_active .. 0 homeless 2026-02-24T19:17:07.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.320+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f6e2c019ee0 con 0x7f6e3c05da60 2026-02-24T19:17:07.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.320+0000 7f6e2a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.320+0000 7f6e2a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:07.356 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.354+0000 7f6e44144640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e3d2506e-9e10-4206-96d1-3dd8aa4d91cb", "id": 1}] 2026-02-24T19:17:07.356 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.354+0000 7f6e44144640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e3d2506e-9e10-4206-96d1-3dd8aa4d91cb", "id": 1}] 2026-02-24T19:17:07.356 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.354+0000 7f6e44144640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.356 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.354+0000 7f6e44144640 1 -- 10.20.193.194:0/168119032 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e3d2506e-9e10-4206-96d1-3dd8aa4d91cb", "id": 1} v 0) -- 0x7f6e3c14db40 con 0x7f6e3c05da60 2026-02-24T19:17:07.404 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.402+0000 7f6e2a7fc640 1 -- 10.20.193.194:0/168119032 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3d2506e-9e10-4206-96d1-3dd8aa4d91cb", "id": 1}]=0 v4) ==== 112+0+2 (unknown 689093050 0 940483276) 0x7f6e2c0059a0 con 0x7f6e3c05da60 2026-02-24T19:17:07.404 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.402+0000 7f6e2a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e3d2506e-9e10-4206-96d1-3dd8aa4d91cb", "id": 1}] 2026-02-24T19:17:07.404 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.402+0000 7f6e2a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:07.404 INFO:teuthology.orchestra.run.trial194.stdout:1 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 10 librados: watch_flush enter 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 10 librados: watch_flush exit 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 20 client.4127.objecter shutdown clearing up homeless session... 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 10 client.4127.objecter successfully canceled tick 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 10 monclient: shutdown 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 1 -- 10.20.193.194:0/168119032 >> v1:10.20.193.179:6789/0 conn(0x7f6e3c05da60 legacy=0x7f6e3c102670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 1 -- 10.20.193.194:0/168119032 shutdown_connections 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 1 -- 10.20.193.194:0/168119032 >> 10.20.193.194:0/168119032 conn(0x7f6e3c0588d0 msgr2=0x7f6e3c181620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 1 -- 10.20.193.194:0/168119032 shutdown_connections 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 1 -- 10.20.193.194:0/168119032 wait complete. 2026-02-24T19:17:07.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.403+0000 7f6e44144640 1 librados: shutdown 2026-02-24T19:17:07.412 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new 2fe7f095-bf74-4e4a-996c-c58438826e11 2 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient: get_monmap_and_config 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient: build_initial_monmap 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient: monmap: 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:07.474686+0000 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:07.474686+0000 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:07.475 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 1 Processor -- start 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 1 -- start start 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient: init 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient(hunting): picked mon.noname-a con 0x7fba3c11c500 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient(hunting): picked mon.noname-c con 0x7fba3c11e420 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient(hunting): picked mon.noname-b con 0x7fba3c11ffc0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c120d10 con 0x7fba3c11c500 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c120f00 con 0x7fba3c11ffc0 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c1210f0 con 0x7fba3c11e420 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.473+0000 7fba424bf640 10 monclient(hunting): authenticate will time out at 3601.130860s 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.474+0000 7fba40a35640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fba3c11ffc0 0x7fba3c120420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:49488/0 (socket says 10.20.193.194:49488) 2026-02-24T19:17:07.476 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.474+0000 7fba40a35640 1 -- 10.20.193.194:0/788425273 learned_addr learned my addr 10.20.193.194:0/788425273 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:07.477 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3740364250 0 0) 0x7fba3c120f00 con 0x7fba3c11ffc0 2026-02-24T19:17:07.477 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.477 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.477 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.477 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): my global_id is 4129 2026-02-24T19:17:07.477 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba20003610 con 0x7fba3c11ffc0 2026-02-24T19:17:07.477 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1767253365 0 0) 0x7fba3c1210f0 con 0x7fba3c11e420 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): my global_id is 4130 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3c120f00 con 0x7fba3c11e420 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160737349 0 0) 0x7fba3c120d10 con 0x7fba3c11c500 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 10 monclient(hunting): my global_id is 4134 2026-02-24T19:17:07.478 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.475+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3c1210f0 con 0x7fba3c11c500 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3024914272 0 0) 0x7fba20003610 con 0x7fba3c11ffc0 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 >> v1:10.20.193.179:6789/0 conn(0x7fba3c11e420 legacy=0x7fba3c11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 >> v1:10.20.193.45:6789/0 conn(0x7fba3c11c500 legacy=0x7fba3c11c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 1 monclient: found mon.noname-b 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c121380 con 0x7fba3c11ffc0 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 10 monclient: _finish_auth 0 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fba30003170 con 0x7fba3c11ffc0 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba3affd640 10 monclient: dump: 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.479 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba424bf640 5 monclient: authenticate success, global_id 4129 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.477+0000 7fba424bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba300033b0 con 0x7fba3c11ffc0 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba3affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba3affd640 1 -- 10.20.193.194:0/788425273 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fba300037f0 con 0x7fba3c11ffc0 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 4 set_mon_vals no callback set 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba3affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba3affd640 10 monclient: dump: 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.480 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient: shutdown 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 -- 10.20.193.194:0/788425273 >> v1:10.20.193.114:6789/0 conn(0x7fba3c11ffc0 legacy=0x7fba3c120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 -- 10.20.193.194:0/788425273 shutdown_connections 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 -- 10.20.193.194:0/788425273 >> 10.20.193.194:0/788425273 conn(0x7fba3c0588d0 msgr2=0x7fba3c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 -- 10.20.193.194:0/788425273 shutdown_connections 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 -- 10.20.193.194:0/788425273 wait complete. 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient: build_initial_monmap 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient: monmap: 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 librados: starting msgr at 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 librados: starting objecter 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 Processor -- start 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 -- start start 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 librados: setting wanted keys 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 librados: calling monclient init 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient: init 2026-02-24T19:17:07.481 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient(hunting): picked mon.noname-a con 0x7fba3c11c500 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient(hunting): picked mon.noname-b con 0x7fba3c11e420 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient(hunting): picked mon.noname-c con 0x7fba3c11ffc0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c179890 con 0x7fba3c11c500 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c17aa70 con 0x7fba3c11e420 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c17bc50 con 0x7fba3c11ffc0 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.478+0000 7fba424bf640 10 monclient(hunting): authenticate will time out at 3601.135829s 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.479+0000 7fba3bfff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fba3c11c500 0x7fba3c130050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39776/0 (socket says 10.20.193.194:39776) 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.479+0000 7fba3bfff640 1 -- 10.20.193.194:0/1404122361 learned_addr learned my addr 10.20.193.194:0/1404122361 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.479+0000 7fba38ff9640 10 client.?.objecter ms_handle_connect 0x7fba3c11c500 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.479+0000 7fba38ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.479+0000 7fba38ff9640 10 client.?.objecter ms_handle_connect 0x7fba3c11ffc0 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.479+0000 7fba38ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.479+0000 7fba38ff9640 10 client.?.objecter ms_handle_connect 0x7fba3c11e420 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.479+0000 7fba38ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626724102 0 0) 0x7fba3c17bc50 con 0x7fba3c11ffc0 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): my global_id is 4133 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba0c003610 con 0x7fba3c11ffc0 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2700236089 0 0) 0x7fba3c17aa70 con 0x7fba3c11e420 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.482 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.483 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.483 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): my global_id is 4132 2026-02-24T19:17:07.483 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3c17bc50 con 0x7fba3c11e420 2026-02-24T19:17:07.483 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409936761 0 0) 0x7fba3c179890 con 0x7fba3c11c500 2026-02-24T19:17:07.483 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.483 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.483 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.483 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 10 monclient(hunting): my global_id is 4137 2026-02-24T19:17:07.483 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.480+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3c17aa70 con 0x7fba3c11c500 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2586721126 0 0) 0x7fba0c003610 con 0x7fba3c11ffc0 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba3c179890 con 0x7fba3c11ffc0 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fba30003560 con 0x7fba3c11ffc0 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.484 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1180624671 0 0) 0x7fba3c17bc50 con 0x7fba3c11e420 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba0c003610 con 0x7fba3c11e420 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fba2c0030b0 con 0x7fba3c11e420 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1536807534 0 0) 0x7fba3c17aa70 con 0x7fba3c11c500 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba3c17bc50 con 0x7fba3c11c500 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fba28003170 con 0x7fba3c11c500 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.482+0000 7fba38ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.485 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3684493724 0 0) 0x7fba3c179890 con 0x7fba3c11ffc0 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 >> v1:10.20.193.114:6789/0 conn(0x7fba3c11e420 legacy=0x7fba3c176a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 >> v1:10.20.193.45:6789/0 conn(0x7fba3c11c500 legacy=0x7fba3c130050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 1 monclient: found mon.c 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c17ce30 con 0x7fba3c11ffc0 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba38ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 5 monclient: authenticate success, global_id 4133 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 10 monclient: _renew_subs 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c17be20 con 0x7fba3c11ffc0 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 10 client.4133.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 10 monclient: _renew_subs 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fba3c17c410 con 0x7fba3c11ffc0 2026-02-24T19:17:07.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 1 librados: init done 2026-02-24T19:17:07.487 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.487 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.487 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.487 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.484+0000 7fba424bf640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c17c8c0 con 0x7fba3c11ffc0 2026-02-24T19:17:07.487 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.485+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba300033b0 con 0x7fba3c11ffc0 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.485+0000 7fba38ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.485+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fba30004db0 con 0x7fba3c11ffc0 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.485+0000 7fba38ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.485+0000 7fba38ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.485+0000 7fba38ff9640 10 monclient: dump: 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.488 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.485+0000 7fba3a7fc640 4 set_mon_vals no callback set 2026-02-24T19:17:07.489 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.486+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fba30005360 con 0x7fba3c11ffc0 2026-02-24T19:17:07.489 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.486+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 4236889440 0 0) 0x7fba30006ac0 con 0x7fba3c11ffc0 2026-02-24T19:17:07.489 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.486+0000 7fba38ff9640 10 client.4133.objecter ms_dispatch2 0x7fba3c000b90 osd_map(4..4 src has 1..4) 2026-02-24T19:17:07.489 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.486+0000 7fba38ff9640 3 client.4133.objecter handle_osd_map got epochs [4,4] > 0 2026-02-24T19:17:07.489 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.486+0000 7fba38ff9640 3 client.4133.objecter handle_osd_map decoding full epoch 4 2026-02-24T19:17:07.489 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.486+0000 7fba38ff9640 20 client.4133.objecter dump_active .. 0 homeless 2026-02-24T19:17:07.517 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.515+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fba300067b0 con 0x7fba3c11ffc0 2026-02-24T19:17:07.517 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.515+0000 7fba38ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.517 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.515+0000 7fba38ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:07.550 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.548+0000 7fba424bf640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "2fe7f095-bf74-4e4a-996c-c58438826e11", "id": 2}] 2026-02-24T19:17:07.550 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.548+0000 7fba424bf640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "2fe7f095-bf74-4e4a-996c-c58438826e11", "id": 2}] 2026-02-24T19:17:07.550 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.548+0000 7fba424bf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.550 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.548+0000 7fba424bf640 1 -- 10.20.193.194:0/1404122361 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd new", "uuid": "2fe7f095-bf74-4e4a-996c-c58438826e11", "id": 2} v 0) -- 0x7fba3c17cbd0 con 0x7fba3c11ffc0 2026-02-24T19:17:07.710 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.708+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 1231163226 0 0) 0x7fba30005680 con 0x7fba3c11ffc0 2026-02-24T19:17:07.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba38ff9640 1 -- 10.20.193.194:0/1404122361 <== mon.2 v1:10.20.193.179:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2fe7f095-bf74-4e4a-996c-c58438826e11", "id": 2}]=0 v5) ==== 112+0+2 (unknown 4269405099 0 216599125) 0x7fba3c17cbd0 con 0x7fba3c11ffc0 2026-02-24T19:17:07.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba38ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "2fe7f095-bf74-4e4a-996c-c58438826e11", "id": 2}] 2026-02-24T19:17:07.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba38ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:07.763 INFO:teuthology.orchestra.run.trial194.stdout:2 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba424bf640 10 librados: watch_flush enter 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba424bf640 10 librados: watch_flush exit 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba424bf640 20 client.4133.objecter shutdown clearing up homeless session... 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba424bf640 10 client.4133.objecter successfully canceled tick 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba424bf640 10 monclient: shutdown 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba424bf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba424bf640 1 -- 10.20.193.194:0/1404122361 >> v1:10.20.193.179:6789/0 conn(0x7fba3c11ffc0 legacy=0x7fba3c178170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba424bf640 1 -- 10.20.193.194:0/1404122361 shutdown_connections 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.761+0000 7fba424bf640 1 -- 10.20.193.194:0/1404122361 >> 10.20.193.194:0/1404122361 conn(0x7fba3c0588d0 msgr2=0x7fba3c059490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.762+0000 7fba424bf640 1 -- 10.20.193.194:0/1404122361 shutdown_connections 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.762+0000 7fba424bf640 1 -- 10.20.193.194:0/1404122361 wait complete. 2026-02-24T19:17:07.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.762+0000 7fba424bf640 1 librados: shutdown 2026-02-24T19:17:07.771 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new 270148b3-6c77-4c1f-9d73-05d1c75990c4 3 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient: get_monmap_and_config 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient: build_initial_monmap 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient: monmap: 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:07.833756+0000 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:07.833756+0000 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:07.834 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 1 Processor -- start 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 1 -- start start 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient: init 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient(hunting): picked mon.noname-b con 0x7fe86411c500 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient(hunting): picked mon.noname-a con 0x7fe86411e420 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient(hunting): picked mon.noname-c con 0x7fe86411ffc0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe864120d10 con 0x7fe86411e420 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe864120f00 con 0x7fe86411c500 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8641210f0 con 0x7fe86411ffc0 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.832+0000 7fe869933640 10 monclient(hunting): authenticate will time out at 3601.489980s 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.833+0000 7fe862ffd640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fe86411c500 0x7fe86411c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:49504/0 (socket says 10.20.193.194:49504) 2026-02-24T19:17:07.835 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.833+0000 7fe862ffd640 1 -- 10.20.193.194:0/2391051038 learned_addr learned my addr 10.20.193.194:0/2391051038 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:07.836 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.834+0000 7fe861ffb640 1 -- 10.20.193.194:0/2391051038 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578970693 0 0) 0x7fe8641210f0 con 0x7fe86411ffc0 2026-02-24T19:17:07.836 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.834+0000 7fe861ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.837 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.834+0000 7fe861ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.837 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.834+0000 7fe861ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.837 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.834+0000 7fe861ffb640 10 monclient(hunting): my global_id is 4151 2026-02-24T19:17:07.837 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.834+0000 7fe861ffb640 1 -- 10.20.193.194:0/2391051038 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe850003610 con 0x7fe86411ffc0 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 1 -- 10.20.193.194:0/2391051038 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3615588631 0 0) 0x7fe850003610 con 0x7fe86411ffc0 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 1 -- 10.20.193.194:0/2391051038 >> v1:10.20.193.114:6789/0 conn(0x7fe86411c500 legacy=0x7fe86411c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 1 -- 10.20.193.194:0/2391051038 >> v1:10.20.193.45:6789/0 conn(0x7fe86411e420 legacy=0x7fe86411e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 1 monclient: found mon.noname-c 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 1 -- 10.20.193.194:0/2391051038 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe864121380 con 0x7fe86411ffc0 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe869933640 5 monclient: authenticate success, global_id 4151 2026-02-24T19:17:07.838 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe869933640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 1 -- 10.20.193.194:0/2391051038 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe854003170 con 0x7fe86411ffc0 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe861ffb640 10 monclient: dump: 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.836+0000 7fe869933640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe861ffb640 1 -- 10.20.193.194:0/2391051038 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe854003470 con 0x7fe86411ffc0 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe861ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe861ffb640 1 -- 10.20.193.194:0/2391051038 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8540038b0 con 0x7fe86411ffc0 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 4 set_mon_vals no callback set 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe861ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe861ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe861ffb640 10 monclient: dump: 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.839 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 10 monclient: shutdown 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 1 -- 10.20.193.194:0/2391051038 >> v1:10.20.193.179:6789/0 conn(0x7fe86411ffc0 legacy=0x7fe864120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 1 -- 10.20.193.194:0/2391051038 shutdown_connections 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 1 -- 10.20.193.194:0/2391051038 >> 10.20.193.194:0/2391051038 conn(0x7fe8640588d0 msgr2=0x7fe864058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 1 -- 10.20.193.194:0/2391051038 shutdown_connections 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 1 -- 10.20.193.194:0/2391051038 wait complete. 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 10 monclient: build_initial_monmap 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.837+0000 7fe869933640 10 monclient: monmap: 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:07.840 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 1 librados: starting msgr at 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 1 librados: starting objecter 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 1 Processor -- start 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 1 -- start start 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 1 librados: setting wanted keys 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 1 librados: calling monclient init 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 10 monclient: init 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 10 monclient(hunting): picked mon.noname-b con 0x7fe86411c500 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 10 monclient(hunting): picked mon.noname-c con 0x7fe86411e420 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 10 monclient(hunting): picked mon.noname-a con 0x7fe86411ffc0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe864179640 con 0x7fe86411ffc0 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86417a820 con 0x7fe86411c500 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86417ba00 con 0x7fe86411e420 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe869933640 10 monclient(hunting): authenticate will time out at 3601.495445s 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe862ffd640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fe86411c500 0x7fe86412fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:49520/0 (socket says 10.20.193.194:49520) 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe862ffd640 1 -- 10.20.193.194:0/851918400 learned_addr learned my addr 10.20.193.194:0/851918400 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe83bfff640 10 client.?.objecter ms_handle_connect 0x7fe86411c500 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe83bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.838+0000 7fe83bfff640 10 client.?.objecter ms_handle_connect 0x7fe86411ffc0 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.839+0000 7fe83bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.839+0000 7fe83bfff640 10 client.?.objecter ms_handle_connect 0x7fe86411e420 2026-02-24T19:17:07.841 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.839+0000 7fe83bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:07.843 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.841+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653743694 0 0) 0x7fe864179640 con 0x7fe86411ffc0 2026-02-24T19:17:07.843 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.841+0000 7fe83bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.843 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.841+0000 7fe83bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.843 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.841+0000 7fe83bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.843 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.841+0000 7fe83bfff640 10 monclient(hunting): my global_id is 4143 2026-02-24T19:17:07.843 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.841+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe834003610 con 0x7fe86411ffc0 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.875+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2096478887 0 0) 0x7fe834003610 con 0x7fe86411ffc0 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.875+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe864179640 con 0x7fe86411ffc0 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.875+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe854003130 con 0x7fe86411ffc0 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.875+0000 7fe83bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.875+0000 7fe83bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.875+0000 7fe83bfff640 10 monclient(hunting): dump: 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.875+0000 7fe83bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:07.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477139424 0 0) 0x7fe86417a820 con 0x7fe86411c500 2026-02-24T19:17:07.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 10 monclient(hunting): my global_id is 4144 2026-02-24T19:17:07.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe834003610 con 0x7fe86411c500 2026-02-24T19:17:07.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160264653 0 0) 0x7fe86417ba00 con 0x7fe86411e420 2026-02-24T19:17:07.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:07.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:07.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:07.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 10 monclient(hunting): my global_id is 4154 2026-02-24T19:17:07.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.877+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe86417a820 con 0x7fe86411e420 2026-02-24T19:17:07.881 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 867865416 0 0) 0x7fe864179640 con 0x7fe86411ffc0 2026-02-24T19:17:07.881 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 >> v1:10.20.193.179:6789/0 conn(0x7fe86411e420 legacy=0x7fe864176800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 >> v1:10.20.193.114:6789/0 conn(0x7fe86411c500 legacy=0x7fe86412fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 1 monclient: found mon.a 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86417cbe0 con 0x7fe86411ffc0 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe83bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 5 monclient: authenticate success, global_id 4143 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 10 monclient: _renew_subs 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 1 -- 10.20.193.194:0/851918400 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe864179810 con 0x7fe86411ffc0 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 10 client.4143.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 10 monclient: _renew_subs 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 1 -- 10.20.193.194:0/851918400 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe864179e50 con 0x7fe86411ffc0 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 1 librados: init done 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:07.882 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.880+0000 7fe869933640 1 -- 10.20.193.194:0/851918400 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86418b5c0 con 0x7fe86411ffc0 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.930+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8540033c0 con 0x7fe86411ffc0 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.930+0000 7fe83bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.930+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe854003fb0 con 0x7fe86411ffc0 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.930+0000 7fe83bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.930+0000 7fe83bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.930+0000 7fe83bfff640 10 monclient: dump: 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.930+0000 7fe8617fa640 4 set_mon_vals no callback set 2026-02-24T19:17:07.932 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.930+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 1231163226 0 0) 0x7fe854010830 con 0x7fe86411ffc0 2026-02-24T19:17:07.938 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.936+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 361992750 0 0) 0x7fe854014040 con 0x7fe86411ffc0 2026-02-24T19:17:07.938 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.936+0000 7fe83bfff640 10 client.4143.objecter ms_dispatch2 0x7fe864000b90 osd_map(5..5 src has 1..5) 2026-02-24T19:17:07.938 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.936+0000 7fe83bfff640 3 client.4143.objecter handle_osd_map got epochs [5,5] > 0 2026-02-24T19:17:07.938 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.936+0000 7fe83bfff640 3 client.4143.objecter handle_osd_map decoding full epoch 5 2026-02-24T19:17:07.938 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.936+0000 7fe83bfff640 20 client.4143.objecter dump_active .. 0 homeless 2026-02-24T19:17:07.938 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.936+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fe854016820 con 0x7fe86411ffc0 2026-02-24T19:17:07.938 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.936+0000 7fe83bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:07.938 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.936+0000 7fe83bfff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:07.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.968+0000 7fe869933640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "270148b3-6c77-4c1f-9d73-05d1c75990c4", "id": 3}] 2026-02-24T19:17:07.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.968+0000 7fe869933640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "270148b3-6c77-4c1f-9d73-05d1c75990c4", "id": 3}] 2026-02-24T19:17:07.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.968+0000 7fe869933640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:07.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:07.968+0000 7fe869933640 1 -- 10.20.193.194:0/851918400 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd new", "uuid": "270148b3-6c77-4c1f-9d73-05d1c75990c4", "id": 3} v 0) -- 0x7fe86417a5d0 con 0x7fe86411ffc0 2026-02-24T19:17:08.021 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe83bfff640 1 -- 10.20.193.194:0/851918400 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "270148b3-6c77-4c1f-9d73-05d1c75990c4", "id": 3}]=0 v6) ==== 112+0+2 (unknown 649766284 0 525046306) 0x7fe854016120 con 0x7fe86411ffc0 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe83bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "270148b3-6c77-4c1f-9d73-05d1c75990c4", "id": 3}] 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe83bfff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stdout:3 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 10 librados: watch_flush enter 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 10 librados: watch_flush exit 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 20 client.4143.objecter shutdown clearing up homeless session... 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 10 client.4143.objecter successfully canceled tick 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 10 monclient: shutdown 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 1 -- 10.20.193.194:0/851918400 >> v1:10.20.193.45:6789/0 conn(0x7fe86411ffc0 legacy=0x7fe864177f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 1 -- 10.20.193.194:0/851918400 shutdown_connections 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 1 -- 10.20.193.194:0/851918400 >> 10.20.193.194:0/851918400 conn(0x7fe8640588d0 msgr2=0x7fe86405cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 1 -- 10.20.193.194:0/851918400 shutdown_connections 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 1 -- 10.20.193.194:0/851918400 wait complete. 2026-02-24T19:17:08.022 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.020+0000 7fe869933640 1 librados: shutdown 2026-02-24T19:17:08.031 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new 43b91f27-e730-4a81-a86b-b2fefdddd3e9 4 2026-02-24T19:17:08.093 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.091+0000 7faddddc3640 10 monclient: get_monmap_and_config 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.091+0000 7faddddc3640 10 monclient: build_initial_monmap 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.091+0000 7faddddc3640 10 monclient: monmap: 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:08.093102+0000 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:08.093102+0000 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 1 Processor -- start 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 1 -- start start 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 10 monclient: init 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 10 monclient(hunting): picked mon.noname-c con 0x7fadd805d9b0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 10 monclient(hunting): picked mon.noname-b con 0x7fadd805dd80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 10 monclient(hunting): picked mon.noname-a con 0x7fadd81649b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd805e200 con 0x7fadd81649b0 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd81874c0 con 0x7fadd805dd80 2026-02-24T19:17:08.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd81886a0 con 0x7fadd805d9b0 2026-02-24T19:17:08.095 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:08.095 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7faddddc3640 10 monclient(hunting): authenticate will time out at 3601.749311s 2026-02-24T19:17:08.095 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7fadd7fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fadd81649b0 0x7fadd8184d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39794/0 (socket says 10.20.193.194:39794) 2026-02-24T19:17:08.095 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.092+0000 7fadd7fff640 1 -- 10.20.193.194:0/1347041007 learned_addr learned my addr 10.20.193.194:0/1347041007 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:08.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.093+0000 7fadd67fc640 1 -- 10.20.193.194:0/1347041007 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226051133 0 0) 0x7fadd805e200 con 0x7fadd81649b0 2026-02-24T19:17:08.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.093+0000 7fadd67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.093+0000 7fadd67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.093+0000 7fadd67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.093+0000 7fadd67fc640 10 monclient(hunting): my global_id is 4146 2026-02-24T19:17:08.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.093+0000 7fadd67fc640 1 -- 10.20.193.194:0/1347041007 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadbc003610 con 0x7fadd81649b0 2026-02-24T19:17:08.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 1 -- 10.20.193.194:0/1347041007 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3997726263 0 0) 0x7fadbc003610 con 0x7fadd81649b0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 1 -- 10.20.193.194:0/1347041007 >> v1:10.20.193.179:6789/0 conn(0x7fadd805d9b0 legacy=0x7fadd811b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 1 -- 10.20.193.194:0/1347041007 >> v1:10.20.193.114:6789/0 conn(0x7fadd805dd80 legacy=0x7fadd811b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 1 -- 10.20.193.194:0/1347041007 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd8189920 con 0x7fadd81649b0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 1 -- 10.20.193.194:0/1347041007 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fadcc003170 con 0x7fadd81649b0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7faddddc3640 5 monclient: authenticate success, global_id 4146 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7faddddc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7fadd67fc640 10 monclient: dump: 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.095+0000 7faddddc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7fadd67fc640 1 -- 10.20.193.194:0/1347041007 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fadcc0033f0 con 0x7fadd81649b0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7fadd67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7fadd67fc640 1 -- 10.20.193.194:0/1347041007 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fadcc003830 con 0x7fadd81649b0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7fadd67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7fadd67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7fadd67fc640 10 monclient: dump: 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.098 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7faddddc3640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7faddddc3640 4 set_mon_vals no callback set 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7faddddc3640 10 monclient: shutdown 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7faddddc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:08.099 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7faddddc3640 1 -- 10.20.193.194:0/1347041007 >> v1:10.20.193.45:6789/0 conn(0x7fadd81649b0 legacy=0x7fadd8184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7faddddc3640 1 -- 10.20.193.194:0/1347041007 shutdown_connections 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7faddddc3640 1 -- 10.20.193.194:0/1347041007 >> 10.20.193.194:0/1347041007 conn(0x7fadd80588d0 msgr2=0x7fadd8058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7faddddc3640 1 -- 10.20.193.194:0/1347041007 shutdown_connections 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.096+0000 7faddddc3640 1 -- 10.20.193.194:0/1347041007 wait complete. 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient: build_initial_monmap 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient: monmap: 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 1 librados: starting msgr at 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 1 librados: starting objecter 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 1 Processor -- start 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 1 -- start start 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 1 librados: setting wanted keys 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 1 librados: calling monclient init 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient: init 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient(hunting): picked mon.noname-c con 0x7fadd805d9b0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient(hunting): picked mon.noname-a con 0x7fadd805dd80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient(hunting): picked mon.noname-b con 0x7fadd81649b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8101f80 con 0x7fadd805dd80 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8108e60 con 0x7fadd81649b0 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd810a040 con 0x7fadd805d9b0 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7faddddc3640 10 monclient(hunting): authenticate will time out at 3601.754483s 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7fadd6ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fadd805dd80 0x7fadd8161980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39796/0 (socket says 10.20.193.194:39796) 2026-02-24T19:17:08.100 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7fadd6ffd640 1 -- 10.20.193.194:0/3372676931 learned_addr learned my addr 10.20.193.194:0/3372676931 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:08.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7fadb3fff640 10 client.?.objecter ms_handle_connect 0x7fadd805dd80 2026-02-24T19:17:08.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.097+0000 7fadb3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:08.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.098+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4019227795 0 0) 0x7fadd8101f80 con 0x7fadd805dd80 2026-02-24T19:17:08.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.098+0000 7fadb3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.098+0000 7fadb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.098+0000 7fadb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.098+0000 7fadb3fff640 10 monclient(hunting): my global_id is 4149 2026-02-24T19:17:08.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.098+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada8003610 con 0x7fadd805dd80 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.101+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2605178407 0 0) 0x7fada8003610 con 0x7fadd805dd80 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.101+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fadd8101f80 con 0x7fadd805dd80 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.101+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fadc8002fd0 con 0x7fadd805dd80 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.101+0000 7fadb3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.101+0000 7fadb3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.101+0000 7fadb3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.101+0000 7fadb3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.102+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1361298729 0 0) 0x7fadd8101f80 con 0x7fadd805dd80 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 >> v1:10.20.193.179:6789/0 conn(0x7fadd805d9b0 legacy=0x7fadd8101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 >> v1:10.20.193.114:6789/0 conn(0x7fadd81649b0 legacy=0x7fadd81630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 1 monclient: found mon.a 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd810b220 con 0x7fadd805dd80 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7fadb3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 5 monclient: authenticate success, global_id 4149 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 10 monclient: _renew_subs 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 1 -- 10.20.193.194:0/3372676931 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fadd810a210 con 0x7fadd805dd80 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 10 client.4149.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 10 monclient: _renew_subs 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 1 -- 10.20.193.194:0/3372676931 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fadd810a850 con 0x7fadd805dd80 2026-02-24T19:17:08.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 1 librados: init done 2026-02-24T19:17:08.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.103+0000 7faddddc3640 1 -- 10.20.193.194:0/3372676931 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd8188da0 con 0x7fadd805dd80 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.154+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fadc80049f0 con 0x7fadd805dd80 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.154+0000 7fadb3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.154+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fadc8004ba0 con 0x7fadd805dd80 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.154+0000 7fadb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.154+0000 7fadb3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.154+0000 7fadd5ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.154+0000 7fadb3fff640 10 monclient: dump: 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.155 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.156 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.156 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.156 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.156 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.156 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.156 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.154+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 1231163226 0 0) 0x7fadc8011420 con 0x7fadd805dd80 2026-02-24T19:17:08.157 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.155+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 3336534073 0 0) 0x7fadc8012fb0 con 0x7fadd805dd80 2026-02-24T19:17:08.157 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.155+0000 7fadb3fff640 10 client.4149.objecter ms_dispatch2 0x7fadd8000b90 osd_map(6..6 src has 1..6) 2026-02-24T19:17:08.157 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.155+0000 7fadb3fff640 3 client.4149.objecter handle_osd_map got epochs [6,6] > 0 2026-02-24T19:17:08.157 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.155+0000 7fadb3fff640 3 client.4149.objecter handle_osd_map decoding full epoch 6 2026-02-24T19:17:08.157 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.155+0000 7fadb3fff640 20 client.4149.objecter dump_active .. 0 homeless 2026-02-24T19:17:08.157 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.155+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fadc80176c0 con 0x7fadd805dd80 2026-02-24T19:17:08.157 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.155+0000 7fadb3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.157 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.155+0000 7fadb3fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:08.190 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.187+0000 7faddddc3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "43b91f27-e730-4a81-a86b-b2fefdddd3e9", "id": 4}] 2026-02-24T19:17:08.190 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.187+0000 7faddddc3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "43b91f27-e730-4a81-a86b-b2fefdddd3e9", "id": 4}] 2026-02-24T19:17:08.190 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.187+0000 7faddddc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.190 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.187+0000 7faddddc3640 1 -- 10.20.193.194:0/3372676931 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd new", "uuid": "43b91f27-e730-4a81-a86b-b2fefdddd3e9", "id": 4} v 0) -- 0x7fadd810abe0 con 0x7fadd805dd80 2026-02-24T19:17:08.207 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7fadb3fff640 1 -- 10.20.193.194:0/3372676931 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43b91f27-e730-4a81-a86b-b2fefdddd3e9", "id": 4}]=0 v7) ==== 112+0+2 (unknown 2607180703 0 1697012583) 0x7fadc8016fc0 con 0x7fadd805dd80 2026-02-24T19:17:08.207 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7fadb3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "43b91f27-e730-4a81-a86b-b2fefdddd3e9", "id": 4}] 2026-02-24T19:17:08.207 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7fadb3fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:08.207 INFO:teuthology.orchestra.run.trial194.stdout:4 2026-02-24T19:17:08.207 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 10 librados: watch_flush enter 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 10 librados: watch_flush exit 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 20 client.4149.objecter shutdown clearing up homeless session... 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 10 client.4149.objecter successfully canceled tick 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 10 monclient: shutdown 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 1 -- 10.20.193.194:0/3372676931 >> v1:10.20.193.45:6789/0 conn(0x7fadd805dd80 legacy=0x7fadd8161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 1 -- 10.20.193.194:0/3372676931 shutdown_connections 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 1 -- 10.20.193.194:0/3372676931 >> 10.20.193.194:0/3372676931 conn(0x7fadd80588d0 msgr2=0x7fadd80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 1 -- 10.20.193.194:0/3372676931 shutdown_connections 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 1 -- 10.20.193.194:0/3372676931 wait complete. 2026-02-24T19:17:08.208 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.205+0000 7faddddc3640 1 librados: shutdown 2026-02-24T19:17:08.214 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new 01c901c8-775a-4e42-b73a-5db3d938dbb2 5 2026-02-24T19:17:08.275 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.273+0000 7f57bf613640 10 monclient: get_monmap_and_config 2026-02-24T19:17:08.275 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.273+0000 7f57bf613640 10 monclient: build_initial_monmap 2026-02-24T19:17:08.275 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.273+0000 7f57bf613640 10 monclient: monmap: 2026-02-24T19:17:08.275 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:08.275 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.275 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:08.274841+0000 2026-02-24T19:17:08.275 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:08.274841+0000 2026-02-24T19:17:08.275 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.273+0000 7f57bf613640 1 Processor -- start 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.273+0000 7f57bf613640 1 -- start start 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.273+0000 7f57bf613640 10 monclient: init 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.273+0000 7f57bf613640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.273+0000 7f57bf613640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.273+0000 7f57bf613640 10 monclient(hunting): picked mon.noname-a con 0x7f57b811e790 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.274+0000 7f57bf613640 10 monclient(hunting): picked mon.noname-c con 0x7f57b81406c0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.274+0000 7f57bf613640 10 monclient(hunting): picked mon.noname-b con 0x7f57b8162250 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.274+0000 7f57bf613640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b8183fe0 con 0x7f57b811e790 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.274+0000 7f57bf613640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b81851e0 con 0x7f57b8162250 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.274+0000 7f57bf613640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b81863e0 con 0x7f57b81406c0 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.274+0000 7f57bf613640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.274+0000 7f57bf613640 10 monclient(hunting): authenticate will time out at 3601.931053s 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.274+0000 7f57bd388640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f57b811e790 0x7f57b811eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39806/0 (socket says 10.20.193.194:39806) 2026-02-24T19:17:08.276 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.274+0000 7f57bd388640 1 -- 10.20.193.194:0/2824761191 learned_addr learned my addr 10.20.193.194:0/2824761191 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029484961 0 0) 0x7f57b8183fe0 con 0x7f57b811e790 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): my global_id is 4152 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57a0003610 con 0x7f57b811e790 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237771314 0 0) 0x7f57b81863e0 con 0x7f57b81406c0 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): my global_id is 4157 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b8183fe0 con 0x7f57b81406c0 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4023750608 0 0) 0x7f57b81851e0 con 0x7f57b8162250 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 10 monclient(hunting): my global_id is 4147 2026-02-24T19:17:08.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.275+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b81863e0 con 0x7f57b8162250 2026-02-24T19:17:08.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1699098853 0 0) 0x7f57b81863e0 con 0x7f57b8162250 2026-02-24T19:17:08.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 >> v1:10.20.193.179:6789/0 conn(0x7f57b81406c0 legacy=0x7f57b8160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 >> v1:10.20.193.45:6789/0 conn(0x7f57b811e790 legacy=0x7f57b811eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:08.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 1 monclient: found mon.noname-b 2026-02-24T19:17:08.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:08.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b8187680 con 0x7f57b8162250 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f57b4003150 con 0x7f57b8162250 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57bf613640 5 monclient: authenticate success, global_id 4147 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57bf613640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57a7fff640 10 monclient: dump: 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.277+0000 7f57bf613640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57b4003360 con 0x7f57b8162250 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57a7fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57a7fff640 1 -- 10.20.193.194:0/2824761191 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f57b4003760 con 0x7f57b8162250 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57bf613640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57bf613640 4 set_mon_vals no callback set 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.280 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57a7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57a7fff640 10 monclient: dump: 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57bf613640 10 monclient: shutdown 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57bf613640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57bf613640 1 -- 10.20.193.194:0/2824761191 >> v1:10.20.193.114:6789/0 conn(0x7f57b8162250 legacy=0x7f57b81826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57bf613640 1 -- 10.20.193.194:0/2824761191 shutdown_connections 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57bf613640 1 -- 10.20.193.194:0/2824761191 >> 10.20.193.194:0/2824761191 conn(0x7f57b80588d0 msgr2=0x7f57b8058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57bf613640 1 -- 10.20.193.194:0/2824761191 shutdown_connections 2026-02-24T19:17:08.281 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.278+0000 7f57bf613640 1 -- 10.20.193.194:0/2824761191 wait complete. 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient: build_initial_monmap 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient: monmap: 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 1 librados: starting msgr at 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 1 librados: starting objecter 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 1 Processor -- start 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 1 -- start start 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 1 librados: setting wanted keys 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 1 librados: calling monclient init 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient: init 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient(hunting): picked mon.noname-c con 0x7f57b811e790 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient(hunting): picked mon.noname-b con 0x7f57b81406c0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient(hunting): picked mon.noname-a con 0x7f57b8162250 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b812e3f0 con 0x7f57b8162250 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b812f5f0 con 0x7f57b81406c0 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b81307f0 con 0x7f57b811e790 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bf613640 10 monclient(hunting): authenticate will time out at 3601.936345s 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bdb89640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f57b8162250 0x7f57b812cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39812/0 (socket says 10.20.193.194:39812) 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57bdb89640 1 -- 10.20.193.194:0/726644367 learned_addr learned my addr 10.20.193.194:0/726644367 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57a5ffb640 10 client.?.objecter ms_handle_connect 0x7f57b81406c0 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57a5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57a5ffb640 10 client.?.objecter ms_handle_connect 0x7f57b8162250 2026-02-24T19:17:08.282 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.279+0000 7f57a5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 client.?.objecter ms_handle_connect 0x7f57b811e790 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153031385 0 0) 0x7f57b812f5f0 con 0x7f57b81406c0 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): my global_id is 4150 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5788003610 con 0x7f57b81406c0 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062949344 0 0) 0x7f57b81307f0 con 0x7f57b811e790 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): my global_id is 4160 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b812f5f0 con 0x7f57b811e790 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364521878 0 0) 0x7f57b812e3f0 con 0x7f57b8162250 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.280+0000 7f57a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.281+0000 7f57a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.281+0000 7f57a5ffb640 10 monclient(hunting): my global_id is 4155 2026-02-24T19:17:08.283 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.281+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b81307f0 con 0x7f57b8162250 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.282+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1007592057 0 0) 0x7f5788003610 con 0x7f57b81406c0 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.282+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57b812e3f0 con 0x7f57b81406c0 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.282+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f57ac0031c0 con 0x7f57b81406c0 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.282+0000 7f57a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.282+0000 7f57a5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.282+0000 7f57a5ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.282+0000 7f57a5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 225910973 0 0) 0x7f57b81307f0 con 0x7f57b8162250 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5788003610 con 0x7f57b8162250 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f57b4003060 con 0x7f57b8162250 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.285 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3399376063 0 0) 0x7f57b812f5f0 con 0x7f57b811e790 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57b81307f0 con 0x7f57b811e790 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f57a80030b0 con 0x7f57b811e790 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.283+0000 7f57a5ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4101623904 0 0) 0x7f57b812e3f0 con 0x7f57b81406c0 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 >> v1:10.20.193.179:6789/0 conn(0x7f57b811e790 legacy=0x7f57b81826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 >> v1:10.20.193.45:6789/0 conn(0x7f57b8162250 legacy=0x7f57b812cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 1 monclient: found mon.b 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b8131a90 con 0x7f57b81406c0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57bf613640 5 monclient: authenticate success, global_id 4150 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57bf613640 10 monclient: _renew_subs 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57bf613640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57bf613640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f57b812e620 con 0x7f57b81406c0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57bf613640 10 client.4150.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57bf613640 10 monclient: _renew_subs 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57bf613640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57bf613640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f57b812ec10 con 0x7f57b81406c0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.284+0000 7f57bf613640 1 librados: init done 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.285+0000 7f57bf613640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.285+0000 7f57bf613640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.285+0000 7f57bf613640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.285+0000 7f57bf613640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b8185710 con 0x7f57b81406c0 2026-02-24T19:17:08.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.288+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f57ac003610 con 0x7f57b81406c0 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.288+0000 7f57a5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.288+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f57ac003a20 con 0x7f57b81406c0 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.288+0000 7f57a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.288+0000 7f57a5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.288+0000 7f57a5ffb640 10 monclient: dump: 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.288+0000 7f57a77fe640 4 set_mon_vals no callback set 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.289+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 1231163226 0 0) 0x7f57ac003c00 con 0x7f57b81406c0 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.289+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 1900427929 0 0) 0x7f57ac011bf0 con 0x7f57b81406c0 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.289+0000 7f57a5ffb640 10 client.4150.objecter ms_dispatch2 0x7f57b8000b90 osd_map(7..7 src has 1..7) 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.289+0000 7f57a5ffb640 3 client.4150.objecter handle_osd_map got epochs [7,7] > 0 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.289+0000 7f57a5ffb640 3 client.4150.objecter handle_osd_map decoding full epoch 7 2026-02-24T19:17:08.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.289+0000 7f57a5ffb640 20 client.4150.objecter dump_active .. 0 homeless 2026-02-24T19:17:08.358 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.357+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f57ac016260 con 0x7f57b81406c0 2026-02-24T19:17:08.358 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.357+0000 7f57a5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.358 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.357+0000 7f57a5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:08.391 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.389+0000 7f57bf613640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "01c901c8-775a-4e42-b73a-5db3d938dbb2", "id": 5}] 2026-02-24T19:17:08.392 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.389+0000 7f57bf613640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "01c901c8-775a-4e42-b73a-5db3d938dbb2", "id": 5}] 2026-02-24T19:17:08.392 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.389+0000 7f57bf613640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:08.392 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.389+0000 7f57bf613640 1 -- 10.20.193.194:0/726644367 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd new", "uuid": "01c901c8-775a-4e42-b73a-5db3d938dbb2", "id": 5} v 0) -- 0x7f57b812ef50 con 0x7f57b81406c0 2026-02-24T19:17:08.522 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57a5ffb640 1 -- 10.20.193.194:0/726644367 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01c901c8-775a-4e42-b73a-5db3d938dbb2", "id": 5}]=0 v8) ==== 112+0+2 (unknown 2042856153 0 1988412176) 0x7f57ac015b60 con 0x7f57b81406c0 2026-02-24T19:17:08.522 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57a5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "01c901c8-775a-4e42-b73a-5db3d938dbb2", "id": 5}] 2026-02-24T19:17:08.522 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57a5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stdout:5 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 10 librados: watch_flush enter 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 10 librados: watch_flush exit 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 20 client.4150.objecter shutdown clearing up homeless session... 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 10 client.4150.objecter successfully canceled tick 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 10 monclient: shutdown 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 1 -- 10.20.193.194:0/726644367 >> v1:10.20.193.114:6789/0 conn(0x7f57b81406c0 legacy=0x7f57b8160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 1 -- 10.20.193.194:0/726644367 shutdown_connections 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 1 -- 10.20.193.194:0/726644367 >> 10.20.193.194:0/726644367 conn(0x7f57b80588d0 msgr2=0x7f57b8184230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 1 -- 10.20.193.194:0/726644367 shutdown_connections 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 1 -- 10.20.193.194:0/726644367 wait complete. 2026-02-24T19:17:08.523 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.521+0000 7f57bf613640 1 librados: shutdown 2026-02-24T19:17:08.532 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new b29d58d3-b5f9-428c-8246-910655dd5490 6 2026-02-24T19:17:08.596 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.593+0000 7fa96847b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:08.596 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.593+0000 7fa96847b640 10 monclient: build_initial_monmap 2026-02-24T19:17:08.596 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.593+0000 7fa96847b640 10 monclient: monmap: 2026-02-24T19:17:08.596 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:08.596 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.597 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:08.595236+0000 2026-02-24T19:17:08.597 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:08.595236+0000 2026-02-24T19:17:08.597 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:08.597 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.597 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:08.597 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:08.597 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:08.597 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.600 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 1 Processor -- start 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 1 -- start start 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 10 monclient: init 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 10 monclient(hunting): picked mon.noname-a con 0x7fa96005da60 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 10 monclient(hunting): picked mon.noname-b con 0x7fa96005df20 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 10 monclient(hunting): picked mon.noname-c con 0x7fa960161240 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa960182ea0 con 0x7fa96005da60 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9601840a0 con 0x7fa96005df20 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9601852a0 con 0x7fa960161240 2026-02-24T19:17:08.601 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa96847b640 10 monclient(hunting): authenticate will time out at 3602.251579s 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa9661f0640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fa96005da60 0x7fa96005c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39816/0 (socket says 10.20.193.194:39816) 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.594+0000 7fa9661f0640 1 -- 10.20.193.194:0/1969448806 learned_addr learned my addr 10.20.193.194:0/1969448806 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2364856775 0 0) 0x7fa9601840a0 con 0x7fa96005df20 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): my global_id is 4153 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa948003610 con 0x7fa96005df20 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3877802193 0 0) 0x7fa960182ea0 con 0x7fa96005da60 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.602 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): my global_id is 4158 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9601840a0 con 0x7fa96005da60 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341014038 0 0) 0x7fa9601852a0 con 0x7fa960161240 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 10 monclient(hunting): my global_id is 4163 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.596+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa960182ea0 con 0x7fa960161240 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3993151577 0 0) 0x7fa948003610 con 0x7fa96005df20 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 >> v1:10.20.193.179:6789/0 conn(0x7fa960161240 legacy=0x7fa960181620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.603 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 >> v1:10.20.193.45:6789/0 conn(0x7fa96005da60 legacy=0x7fa96005c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 10 monclient: _finish_hunting 0 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 1 monclient: found mon.noname-b 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa960186540 con 0x7fa96005df20 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 10 monclient: _finish_auth 0 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 10 monclient: _check_auth_tickets 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa954002df0 con 0x7fa96005df20 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:08.604 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa9651ee640 10 monclient: dump: 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa96847b640 5 monclient: authenticate success, global_id 4153 2026-02-24T19:17:08.605 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.597+0000 7fa96847b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:08.611 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.598+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa954003030 con 0x7fa96005df20 2026-02-24T19:17:08.611 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.598+0000 7fa9651ee640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.598+0000 7fa9651ee640 1 -- 10.20.193.194:0/1969448806 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa954003470 con 0x7fa96005df20 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.598+0000 7fa9651ee640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.598+0000 7fa9651ee640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.598+0000 7fa9651ee640 10 monclient: dump: 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.612 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.598+0000 7fa96847b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.598+0000 7fa96847b640 4 set_mon_vals no callback set 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient: shutdown 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 -- 10.20.193.194:0/1969448806 >> v1:10.20.193.114:6789/0 conn(0x7fa96005df20 legacy=0x7fa96005caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 -- 10.20.193.194:0/1969448806 shutdown_connections 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 -- 10.20.193.194:0/1969448806 >> 10.20.193.194:0/1969448806 conn(0x7fa9600588d0 msgr2=0x7fa960058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 -- 10.20.193.194:0/1969448806 shutdown_connections 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 -- 10.20.193.194:0/1969448806 wait complete. 2026-02-24T19:17:08.613 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient: build_initial_monmap 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient: monmap: 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:08.614 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 librados: starting msgr at 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 librados: starting objecter 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 Processor -- start 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 -- start start 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 librados: setting wanted keys 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 librados: calling monclient init 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient: init 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient(hunting): picked mon.noname-c con 0x7fa96005da60 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:08.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient(hunting): picked mon.noname-b con 0x7fa96005df20 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient(hunting): picked mon.noname-a con 0x7fa960161240 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96015e020 con 0x7fa960161240 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa96015f200 con 0x7fa96005df20 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9601603e0 con 0x7fa96005da60 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.599+0000 7fa96847b640 10 monclient(hunting): authenticate will time out at 3602.256747s 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.600+0000 7fa9669f1640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fa960161240 0x7fa96015c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39820/0 (socket says 10.20.193.194:39820) 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.600+0000 7fa9669f1640 1 -- 10.20.193.194:0/676492219 learned_addr learned my addr 10.20.193.194:0/676492219 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.600+0000 7fa946ffd640 10 client.?.objecter ms_handle_connect 0x7fa960161240 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.600+0000 7fa946ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.600+0000 7fa946ffd640 10 client.?.objecter ms_handle_connect 0x7fa96005df20 2026-02-24T19:17:08.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.600+0000 7fa946ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.600+0000 7fa946ffd640 10 client.?.objecter ms_handle_connect 0x7fa96005da60 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.600+0000 7fa946ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823099515 0 0) 0x7fa9601603e0 con 0x7fa96005da60 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): my global_id is 4166 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa930003610 con 0x7fa96005da60 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521890725 0 0) 0x7fa96015e020 con 0x7fa960161240 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): my global_id is 4161 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9601603e0 con 0x7fa960161240 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399804203 0 0) 0x7fa96015f200 con 0x7fa96005df20 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 10 monclient(hunting): my global_id is 4156 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.601+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa96015e020 con 0x7fa96005df20 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 979392525 0 0) 0x7fa930003610 con 0x7fa96005da60 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa96015f200 con 0x7fa96005da60 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa950003210 con 0x7fa96005da60 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:08.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:08.619 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 833804450 0 0) 0x7fa96015e020 con 0x7fa96005df20 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa930003610 con 0x7fa96005df20 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa954003380 con 0x7fa96005df20 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.620 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1253581568 0 0) 0x7fa9601603e0 con 0x7fa960161240 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa96015e020 con 0x7fa960161240 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa95c003470 con 0x7fa960161240 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.603+0000 7fa946ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.621 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1276435799 0 0) 0x7fa96015f200 con 0x7fa96005da60 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 >> v1:10.20.193.114:6789/0 conn(0x7fa96005df20 legacy=0x7fa96015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 >> v1:10.20.193.45:6789/0 conn(0x7fa960161240 legacy=0x7fa96015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:08.622 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 1 monclient: found mon.c 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9601605b0 con 0x7fa96005da60 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa946ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 5 monclient: authenticate success, global_id 4166 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 10 monclient: _renew_subs 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa960160840 con 0x7fa96005da60 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 10 client.4166.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 10 monclient: _renew_subs 2026-02-24T19:17:08.623 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa960160e30 con 0x7fa96005da60 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 1 librados: init done 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.605+0000 7fa96847b640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa960184770 con 0x7fa96005da60 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.609+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9500048d0 con 0x7fa96005da60 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.609+0000 7fa946ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.609+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa950004c20 con 0x7fa96005da60 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.609+0000 7fa946ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.609+0000 7fa9649ed640 4 set_mon_vals no callback set 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.609+0000 7fa946ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:08.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.609+0000 7fa946ffd640 10 monclient: dump: 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.625 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.626 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.610+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 1231163226 0 0) 0x7fa950011300 con 0x7fa96005da60 2026-02-24T19:17:08.626 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.611+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 4074508054 0 0) 0x7fa950020dc0 con 0x7fa96005da60 2026-02-24T19:17:08.626 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.611+0000 7fa946ffd640 10 client.4166.objecter ms_dispatch2 0x7fa960000b90 osd_map(8..8 src has 1..8) 2026-02-24T19:17:08.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.611+0000 7fa946ffd640 3 client.4166.objecter handle_osd_map got epochs [8,8] > 0 2026-02-24T19:17:08.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.611+0000 7fa946ffd640 3 client.4166.objecter handle_osd_map decoding full epoch 8 2026-02-24T19:17:08.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.611+0000 7fa946ffd640 20 client.4166.objecter dump_active .. 0 homeless 2026-02-24T19:17:08.644 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.642+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fa950017430 con 0x7fa96005da60 2026-02-24T19:17:08.644 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.642+0000 7fa946ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.644 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.642+0000 7fa946ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:08.676 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.674+0000 7fa96847b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b29d58d3-b5f9-428c-8246-910655dd5490", "id": 6}] 2026-02-24T19:17:08.677 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.674+0000 7fa96847b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b29d58d3-b5f9-428c-8246-910655dd5490", "id": 6}] 2026-02-24T19:17:08.677 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.674+0000 7fa96847b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:08.677 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.674+0000 7fa96847b640 1 -- 10.20.193.194:0/676492219 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b29d58d3-b5f9-428c-8246-910655dd5490", "id": 6} v 0) -- 0x7fa960164f80 con 0x7fa96005da60 2026-02-24T19:17:08.719 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa946ffd640 1 -- 10.20.193.194:0/676492219 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b29d58d3-b5f9-428c-8246-910655dd5490", "id": 6}]=0 v9) ==== 112+0+2 (unknown 3188228193 0 1113811849) 0x7fa950016d30 con 0x7fa96005da60 2026-02-24T19:17:08.719 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa946ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b29d58d3-b5f9-428c-8246-910655dd5490", "id": 6}] 2026-02-24T19:17:08.719 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa946ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:08.720 INFO:teuthology.orchestra.run.trial194.stdout:6 2026-02-24T19:17:08.721 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 10 librados: watch_flush enter 2026-02-24T19:17:08.721 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 10 librados: watch_flush exit 2026-02-24T19:17:08.721 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 20 client.4166.objecter shutdown clearing up homeless session... 2026-02-24T19:17:08.721 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 10 client.4166.objecter successfully canceled tick 2026-02-24T19:17:08.721 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 10 monclient: shutdown 2026-02-24T19:17:08.721 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:08.722 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 1 -- 10.20.193.194:0/676492219 >> v1:10.20.193.179:6789/0 conn(0x7fa96005da60 legacy=0x7fa96016b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.722 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 1 -- 10.20.193.194:0/676492219 shutdown_connections 2026-02-24T19:17:08.722 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 1 -- 10.20.193.194:0/676492219 >> 10.20.193.194:0/676492219 conn(0x7fa9600588d0 msgr2=0x7fa960058ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:08.722 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 1 -- 10.20.193.194:0/676492219 shutdown_connections 2026-02-24T19:17:08.722 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 1 -- 10.20.193.194:0/676492219 wait complete. 2026-02-24T19:17:08.722 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.717+0000 7fa96847b640 1 librados: shutdown 2026-02-24T19:17:08.728 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new f182ac9b-e6ee-461e-af0c-0ef4ef51c737 7 2026-02-24T19:17:08.794 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:08.794 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient: build_initial_monmap 2026-02-24T19:17:08.794 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient: monmap: 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:08.793547+0000 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:08.793547+0000 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:08.795 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.797 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 1 Processor -- start 2026-02-24T19:17:08.797 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 1 -- start start 2026-02-24T19:17:08.797 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient: init 2026-02-24T19:17:08.797 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:08.797 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:08.797 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient(hunting): picked mon.noname-b con 0x7f87b011e810 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:08.797 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient(hunting): picked mon.noname-a con 0x7f87b0140740 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:08.797 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient(hunting): picked mon.noname-c con 0x7f87b01622d0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:08.798 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b0184060 con 0x7f87b0140740 2026-02-24T19:17:08.798 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b0185260 con 0x7f87b011e810 2026-02-24T19:17:08.798 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b0186460 con 0x7f87b01622d0 2026-02-24T19:17:08.798 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:08.798 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.792+0000 7f87b4c8b640 10 monclient(hunting): authenticate will time out at 3602.449902s 2026-02-24T19:17:08.798 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.793+0000 7f87aed76640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f87b01622d0 0x7f87b0182760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.194:44844/0 (socket says 10.20.193.194:44844) 2026-02-24T19:17:08.798 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.793+0000 7f87aed76640 1 -- 10.20.193.194:0/4287803557 learned_addr learned my addr 10.20.193.194:0/4287803557 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:08.817 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.814+0000 7f87ad573640 1 -- 10.20.193.194:0/4287803557 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186057367 0 0) 0x7f87b0184060 con 0x7f87b0140740 2026-02-24T19:17:08.817 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.814+0000 7f87ad573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.817 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.814+0000 7f87ad573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.817 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.814+0000 7f87ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.817 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.814+0000 7f87ad573640 10 monclient(hunting): my global_id is 4164 2026-02-24T19:17:08.817 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.814+0000 7f87ad573640 1 -- 10.20.193.194:0/4287803557 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f879c003610 con 0x7f87b0140740 2026-02-24T19:17:08.885 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 1 -- 10.20.193.194:0/4287803557 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1798174678 0 0) 0x7f879c003610 con 0x7f87b0140740 2026-02-24T19:17:08.885 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 1 -- 10.20.193.194:0/4287803557 >> v1:10.20.193.179:6789/0 conn(0x7f87b01622d0 legacy=0x7f87b0182760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.885 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 1 -- 10.20.193.194:0/4287803557 >> v1:10.20.193.114:6789/0 conn(0x7f87b011e810 legacy=0x7f87b011ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.885 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:08.885 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 1 monclient: found mon.noname-a 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 1 -- 10.20.193.194:0/4287803557 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b0187700 con 0x7f87b0140740 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 10 monclient: _finish_auth 0 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 1 -- 10.20.193.194:0/4287803557 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8798002df0 con 0x7f87b0140740 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87ad573640 10 monclient: dump: 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.886 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87b4c8b640 5 monclient: authenticate success, global_id 4164 2026-02-24T19:17:08.887 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.883+0000 7f87b4c8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:08.890 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87ad573640 1 -- 10.20.193.194:0/4287803557 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8798003070 con 0x7f87b0140740 2026-02-24T19:17:08.890 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87ad573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87ad573640 1 -- 10.20.193.194:0/4287803557 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8798003470 con 0x7f87b0140740 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87ad573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87ad573640 10 monclient: dump: 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.891 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87b4c8b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87b4c8b640 4 set_mon_vals no callback set 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87b4c8b640 10 monclient: shutdown 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87b4c8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87b4c8b640 1 -- 10.20.193.194:0/4287803557 >> v1:10.20.193.45:6789/0 conn(0x7f87b0140740 legacy=0x7f87b0160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87b4c8b640 1 -- 10.20.193.194:0/4287803557 shutdown_connections 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87b4c8b640 1 -- 10.20.193.194:0/4287803557 >> 10.20.193.194:0/4287803557 conn(0x7f87b0055dc0 msgr2=0x7f87b00561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87b4c8b640 1 -- 10.20.193.194:0/4287803557 shutdown_connections 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.885+0000 7f87b4c8b640 1 -- 10.20.193.194:0/4287803557 wait complete. 2026-02-24T19:17:08.892 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient: build_initial_monmap 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient: monmap: 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.893 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 1 librados: starting msgr at 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 1 librados: starting objecter 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 1 Processor -- start 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 1 -- start start 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 1 librados: setting wanted keys 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 1 librados: calling monclient init 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient: init 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient(hunting): picked mon.noname-c con 0x7f87b011e810 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient(hunting): picked mon.noname-b con 0x7f87b0140740 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:08.894 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient(hunting): picked mon.noname-a con 0x7f87b01622d0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:08.895 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b0123610 con 0x7f87b01622d0 2026-02-24T19:17:08.895 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b012b470 con 0x7f87b0140740 2026-02-24T19:17:08.895 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b012c690 con 0x7f87b011e810 2026-02-24T19:17:08.895 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:08.895 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.886+0000 7f87b4c8b640 10 monclient(hunting): authenticate will time out at 3602.543602s 2026-02-24T19:17:08.896 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.892+0000 7f87aed76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f87b01622d0 0x7f87b0161b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:39840/0 (socket says 10.20.193.194:39840) 2026-02-24T19:17:08.896 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.892+0000 7f87aed76640 1 -- 10.20.193.194:0/1899097047 learned_addr learned my addr 10.20.193.194:0/1899097047 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:08.896 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.892+0000 7f8796ffd640 10 client.?.objecter ms_handle_connect 0x7f87b01622d0 2026-02-24T19:17:08.896 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.892+0000 7f8796ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:08.911 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.908+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594220771 0 0) 0x7f87b0123610 con 0x7f87b01622d0 2026-02-24T19:17:08.911 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.909+0000 7f8796ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:08.911 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.909+0000 7f8796ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:08.912 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.909+0000 7f8796ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:08.912 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.909+0000 7f8796ffd640 10 monclient(hunting): my global_id is 4167 2026-02-24T19:17:08.912 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.909+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f877c003610 con 0x7f87b01622d0 2026-02-24T19:17:08.914 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.911+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4165083275 0 0) 0x7f877c003610 con 0x7f87b01622d0 2026-02-24T19:17:08.914 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.911+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87b0123610 con 0x7f87b01622d0 2026-02-24T19:17:08.914 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.911+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f87a0003310 con 0x7f87b01622d0 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.911+0000 7f8796ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.911+0000 7f8796ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.911+0000 7f8796ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:08.915 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:08.916 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:08.916 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.911+0000 7f8796ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:08.917 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 786422211 0 0) 0x7f87b0123610 con 0x7f87b01622d0 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 >> v1:10.20.193.179:6789/0 conn(0x7f87b011e810 legacy=0x7f87b0182760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 >> v1:10.20.193.114:6789/0 conn(0x7f87b0140740 legacy=0x7f87b0122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 1 monclient: found mon.a 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b012d930 con 0x7f87b01622d0 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f8796ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 5 monclient: authenticate success, global_id 4167 2026-02-24T19:17:08.918 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 10 monclient: _renew_subs 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f87b012c8c0 con 0x7f87b01622d0 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 10 client.4167.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 10 monclient: _renew_subs 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f87b012cf00 con 0x7f87b01622d0 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 1 librados: init done 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:08.919 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:08.914+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b0185900 con 0x7f87b01622d0 2026-02-24T19:17:08.982 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-24T19:17:08.980+0000 7fee7f242640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-24T19:17:09.013 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-24T19:17:09.010+0000 7fee7f242640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-24T19:17:09.044 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.042+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87a0004c50 con 0x7f87b01622d0 2026-02-24T19:17:09.044 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.042+0000 7f8796ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:09.044 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.042+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f87a0004e80 con 0x7f87b01622d0 2026-02-24T19:17:09.044 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.042+0000 7f8796ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.042+0000 7f8796ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.042+0000 7f8796ffd640 10 monclient: dump: 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.045 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.046 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.042+0000 7f87acd72640 4 set_mon_vals no callback set 2026-02-24T19:17:09.046 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.043+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 2403076157 0 0) 0x7f87a0005060 con 0x7f87b01622d0 2026-02-24T19:17:09.046 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.044+0000 7f87ae575640 10 monclient: get_auth_request con 0x7f877c077a50 auth_method 0 2026-02-24T19:17:09.047 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.044+0000 7f8796ffd640 10 client.4167.objecter ms_handle_connect 0x7f877c077a50 2026-02-24T19:17:09.048 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.046+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1525+0+0 (unknown 1991894946 0 0) 0x7f87a00599b0 con 0x7f87b01622d0 2026-02-24T19:17:09.049 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.046+0000 7f8796ffd640 10 client.4167.objecter ms_dispatch2 0x7f87b0000b90 osd_map(9..9 src has 1..9) 2026-02-24T19:17:09.049 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.046+0000 7f8796ffd640 3 client.4167.objecter handle_osd_map got epochs [9,9] > 0 2026-02-24T19:17:09.049 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.046+0000 7f8796ffd640 3 client.4167.objecter handle_osd_map decoding full epoch 9 2026-02-24T19:17:09.049 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.046+0000 7f8796ffd640 20 client.4167.objecter dump_active .. 0 homeless 2026-02-24T19:17:09.049 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.046+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f87a005e120 con 0x7f87b01622d0 2026-02-24T19:17:09.049 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.046+0000 7f8796ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:09.049 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.046+0000 7f8796ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:09.160 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.158+0000 7f87b4c8b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f182ac9b-e6ee-461e-af0c-0ef4ef51c737", "id": 7}] 2026-02-24T19:17:09.160 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.158+0000 7f87b4c8b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f182ac9b-e6ee-461e-af0c-0ef4ef51c737", "id": 7}] 2026-02-24T19:17:09.160 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.158+0000 7f87b4c8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:09.160 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.158+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd new", "uuid": "f182ac9b-e6ee-461e-af0c-0ef4ef51c737", "id": 7} v 0) -- 0x7f87b012a460 con 0x7f87b01622d0 2026-02-24T19:17:09.198 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.196+0000 7f8796ffd640 1 -- 10.20.193.194:0/1899097047 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f182ac9b-e6ee-461e-af0c-0ef4ef51c737", "id": 7}]=0 v10) ==== 112+0+2 (unknown 3456549607 0 1371665406) 0x7f87a005da20 con 0x7f87b01622d0 2026-02-24T19:17:09.198 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.196+0000 7f8796ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f182ac9b-e6ee-461e-af0c-0ef4ef51c737", "id": 7}] 2026-02-24T19:17:09.198 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.196+0000 7f8796ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:09.199 INFO:teuthology.orchestra.run.trial194.stdout:7 2026-02-24T19:17:09.200 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 10 librados: watch_flush enter 2026-02-24T19:17:09.200 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 10 librados: watch_flush exit 2026-02-24T19:17:09.200 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 20 client.4167.objecter shutdown clearing up homeless session... 2026-02-24T19:17:09.200 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 10 client.4167.objecter successfully canceled tick 2026-02-24T19:17:09.201 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 >> v1:10.20.193.45:6800/1599977652 conn(0x7f877c077a50 legacy=0x7f877c097f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.201 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 10 monclient: shutdown 2026-02-24T19:17:09.201 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:09.201 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 >> v1:10.20.193.45:6789/0 conn(0x7f87b01622d0 legacy=0x7f87b0161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.201 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 shutdown_connections 2026-02-24T19:17:09.201 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 >> 10.20.193.194:0/1899097047 conn(0x7f87b0055dc0 msgr2=0x7f87b0056190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:09.201 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 shutdown_connections 2026-02-24T19:17:09.201 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 1 -- 10.20.193.194:0/1899097047 wait complete. 2026-02-24T19:17:09.201 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.197+0000 7f87b4c8b640 1 librados: shutdown 2026-02-24T19:17:09.210 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new b812d673-950b-4168-9a5e-d3719d569a7d 8 2026-02-24T19:17:09.273 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient: get_monmap_and_config 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient: build_initial_monmap 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient: monmap: 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:09.272657+0000 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:09.272657+0000 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:09.274 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:09.275 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 1 Processor -- start 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 1 -- start start 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient: init 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient(hunting): picked mon.noname-c con 0x7f489011d730 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient(hunting): picked mon.noname-a con 0x7f48901406b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient(hunting): picked mon.noname-b con 0x7f4890162240 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4890183fd0 con 0x7f48901406b0 2026-02-24T19:17:09.277 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48901851d0 con 0x7f4890162240 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48901863d0 con 0x7f489011d730 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.271+0000 7f48952e1640 10 monclient(hunting): authenticate will time out at 3602.928953s 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.272+0000 7f488e7fc640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f48901406b0 0x7f4890160a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:34290/0 (socket says 10.20.193.194:34290) 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.272+0000 7f488e7fc640 1 -- 10.20.193.194:0/530268960 learned_addr learned my addr 10.20.193.194:0/530268960 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139023678 0 0) 0x7f48901851d0 con 0x7f4890162240 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 10 monclient(hunting): my global_id is 4159 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f487c003610 con 0x7f4890162240 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055763796 0 0) 0x7f4890183fd0 con 0x7f48901406b0 2026-02-24T19:17:09.278 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 10 monclient(hunting): my global_id is 4170 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.273+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48901851d0 con 0x7f48901406b0 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.274+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2746150136 0 0) 0x7f48901863d0 con 0x7f489011d730 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.274+0000 7f488dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.274+0000 7f488dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.274+0000 7f488dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.274+0000 7f488dffb640 10 monclient(hunting): my global_id is 4169 2026-02-24T19:17:09.279 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.274+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4890183fd0 con 0x7f489011d730 2026-02-24T19:17:09.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 28156356 0 0) 0x7f48901851d0 con 0x7f48901406b0 2026-02-24T19:17:09.286 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 >> v1:10.20.193.179:6789/0 conn(0x7f489011d730 legacy=0x7f489011db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 >> v1:10.20.193.114:6789/0 conn(0x7f4890162240 legacy=0x7f48901826d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 1 monclient: found mon.noname-a 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4890187670 con 0x7f48901406b0 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4878002df0 con 0x7f48901406b0 2026-02-24T19:17:09.287 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f488dffb640 10 monclient: dump: 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.288 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f48952e1640 5 monclient: authenticate success, global_id 4170 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.275+0000 7f48952e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4878003030 con 0x7f48901406b0 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f488dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f488dffb640 1 -- 10.20.193.194:0/530268960 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4878003470 con 0x7f48901406b0 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f488dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f488dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f488dffb640 10 monclient: dump: 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.289 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 4 set_mon_vals no callback set 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient: shutdown 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 -- 10.20.193.194:0/530268960 >> v1:10.20.193.45:6789/0 conn(0x7f48901406b0 legacy=0x7f4890160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.290 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 -- 10.20.193.194:0/530268960 shutdown_connections 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 -- 10.20.193.194:0/530268960 >> 10.20.193.194:0/530268960 conn(0x7f4890058d50 msgr2=0x7f4890059150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 -- 10.20.193.194:0/530268960 shutdown_connections 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 -- 10.20.193.194:0/530268960 wait complete. 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient: build_initial_monmap 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient: monmap: 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:09.291 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 librados: starting msgr at 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 librados: starting objecter 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 Processor -- start 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 -- start start 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 librados: setting wanted keys 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 librados: calling monclient init 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient: init 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:09.292 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient(hunting): picked mon.noname-c con 0x7f489011d730 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient(hunting): picked mon.noname-b con 0x7f48901406b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient(hunting): picked mon.noname-a con 0x7f4890162240 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4890102500 con 0x7f4890162240 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f489010a360 con 0x7f48901406b0 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f489010b580 con 0x7f489011d730 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.276+0000 7f48952e1640 10 monclient(hunting): authenticate will time out at 3602.933920s 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.277+0000 7f488e7fc640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f48901406b0 0x7f4890101b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:39412/0 (socket says 10.20.193.194:39412) 2026-02-24T19:17:09.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.277+0000 7f488e7fc640 1 -- 10.20.193.194:0/1701560121 learned_addr learned my addr 10.20.193.194:0/1701560121 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.277+0000 7f486f7fe640 10 client.?.objecter ms_handle_connect 0x7f48901406b0 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.277+0000 7f486f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.277+0000 7f486f7fe640 10 client.?.objecter ms_handle_connect 0x7f489011d730 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.277+0000 7f486f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.277+0000 7f486f7fe640 10 client.?.objecter ms_handle_connect 0x7f4890162240 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.277+0000 7f486f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481233086 0 0) 0x7f4890102500 con 0x7f4890162240 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): my global_id is 4173 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f485c003610 con 0x7f4890162240 2026-02-24T19:17:09.294 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213796254 0 0) 0x7f489010a360 con 0x7f48901406b0 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): my global_id is 4162 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4890102500 con 0x7f48901406b0 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408794292 0 0) 0x7f489010b580 con 0x7f489011d730 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 10 monclient(hunting): my global_id is 4172 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.278+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f489010a360 con 0x7f489011d730 2026-02-24T19:17:09.295 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3149889755 0 0) 0x7f485c003610 con 0x7f4890162240 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f489010b580 con 0x7f4890162240 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4880003430 con 0x7f4890162240 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.296 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 643647682 0 0) 0x7f489010a360 con 0x7f489011d730 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f485c003610 con 0x7f489011d730 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4884003060 con 0x7f489011d730 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.297 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3927351173 0 0) 0x7f4890102500 con 0x7f48901406b0 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f489010a360 con 0x7f48901406b0 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4878003380 con 0x7f48901406b0 2026-02-24T19:17:09.298 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.281+0000 7f486f7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.299 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1608029694 0 0) 0x7f485c003610 con 0x7f489011d730 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 >> v1:10.20.193.114:6789/0 conn(0x7f48901406b0 legacy=0x7f4890101b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 >> v1:10.20.193.45:6789/0 conn(0x7f4890162240 legacy=0x7f4890161aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 1 monclient: found mon.c 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489010c820 con 0x7f489011d730 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f486f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f48952e1640 5 monclient: authenticate success, global_id 4172 2026-02-24T19:17:09.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f48952e1640 10 monclient: _renew_subs 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f48952e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f489010b7b0 con 0x7f489011d730 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f48952e1640 10 client.4172.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f48952e1640 10 monclient: _renew_subs 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f48952e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f489010bdf0 con 0x7f489011d730 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.282+0000 7f48952e1640 1 librados: init done 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.283+0000 7f48952e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.283+0000 7f48952e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.283+0000 7f48952e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:09.301 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.283+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48901858a0 con 0x7f489011d730 2026-02-24T19:17:09.374 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.372+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4884003700 con 0x7f489011d730 2026-02-24T19:17:09.374 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.372+0000 7f486f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:09.374 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.372+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4884003a50 con 0x7f489011d730 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.372+0000 7f486f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.372+0000 7f486f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.372+0000 7f488d7fa640 4 set_mon_vals no callback set 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.372+0000 7f486f7fe640 10 monclient: dump: 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.375 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.376 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.376 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.376 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.376 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.372+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 2403076157 0 0) 0x7f488401c820 con 0x7f489011d730 2026-02-24T19:17:09.376 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.373+0000 7f488e7fc640 10 monclient: get_auth_request con 0x7f485c077c90 auth_method 0 2026-02-24T19:17:09.377 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.373+0000 7f486f7fe640 10 client.4172.objecter ms_handle_connect 0x7f485c077c90 2026-02-24T19:17:09.377 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.374+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (unknown 3385930123 0 0) 0x7f48840581b0 con 0x7f489011d730 2026-02-24T19:17:09.377 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.374+0000 7f486f7fe640 10 client.4172.objecter ms_dispatch2 0x7f4890000b90 osd_map(10..10 src has 1..10) 2026-02-24T19:17:09.378 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.374+0000 7f486f7fe640 3 client.4172.objecter handle_osd_map got epochs [10,10] > 0 2026-02-24T19:17:09.378 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.374+0000 7f486f7fe640 3 client.4172.objecter handle_osd_map decoding full epoch 10 2026-02-24T19:17:09.378 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.374+0000 7f486f7fe640 20 client.4172.objecter dump_active .. 0 homeless 2026-02-24T19:17:09.378 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.375+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f488405c920 con 0x7f489011d730 2026-02-24T19:17:09.378 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.375+0000 7f486f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:09.378 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.375+0000 7f486f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:09.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.483+0000 7f48952e1640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b812d673-950b-4168-9a5e-d3719d569a7d", "id": 8}] 2026-02-24T19:17:09.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.483+0000 7f48952e1640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b812d673-950b-4168-9a5e-d3719d569a7d", "id": 8}] 2026-02-24T19:17:09.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.483+0000 7f48952e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:09.486 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.483+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b812d673-950b-4168-9a5e-d3719d569a7d", "id": 8} v 0) -- 0x7f489010c0e0 con 0x7f489011d730 2026-02-24T19:17:09.535 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.533+0000 7f486f7fe640 1 -- 10.20.193.194:0/1701560121 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b812d673-950b-4168-9a5e-d3719d569a7d", "id": 8}]=0 v11) ==== 112+0+2 (unknown 4056566729 0 3065575683) 0x7f488405c220 con 0x7f489011d730 2026-02-24T19:17:09.535 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.533+0000 7f486f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b812d673-950b-4168-9a5e-d3719d569a7d", "id": 8}] 2026-02-24T19:17:09.535 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.533+0000 7f486f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:09.536 INFO:teuthology.orchestra.run.trial194.stdout:8 2026-02-24T19:17:09.537 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 10 librados: watch_flush enter 2026-02-24T19:17:09.537 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 10 librados: watch_flush exit 2026-02-24T19:17:09.537 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 20 client.4172.objecter shutdown clearing up homeless session... 2026-02-24T19:17:09.537 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 10 client.4172.objecter successfully canceled tick 2026-02-24T19:17:09.537 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 >> v1:10.20.193.45:6800/1599977652 conn(0x7f485c077c90 legacy=0x7f485c098140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.538 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 10 monclient: shutdown 2026-02-24T19:17:09.538 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:09.538 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 >> v1:10.20.193.179:6789/0 conn(0x7f489011d730 legacy=0x7f48901826d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.538 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 shutdown_connections 2026-02-24T19:17:09.538 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 >> 10.20.193.194:0/1701560121 conn(0x7f4890058d50 msgr2=0x7f48901863d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:09.538 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 shutdown_connections 2026-02-24T19:17:09.538 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 1 -- 10.20.193.194:0/1701560121 wait complete. 2026-02-24T19:17:09.538 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.534+0000 7f48952e1640 1 librados: shutdown 2026-02-24T19:17:09.546 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new 442018bc-d405-49b3-8934-0ab83b4613eb 9 2026-02-24T19:17:09.612 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.609+0000 7f9cd809f640 10 monclient: get_monmap_and_config 2026-02-24T19:17:09.612 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.609+0000 7f9cd809f640 10 monclient: build_initial_monmap 2026-02-24T19:17:09.612 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.609+0000 7f9cd809f640 10 monclient: monmap: 2026-02-24T19:17:09.612 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:09.612 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.612 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:09.610942+0000 2026-02-24T19:17:09.612 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:09.610942+0000 2026-02-24T19:17:09.612 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:09.613 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.613 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:09.613 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:09.613 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:09.613 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.609+0000 7f9cd809f640 1 Processor -- start 2026-02-24T19:17:09.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.609+0000 7f9cd809f640 1 -- start start 2026-02-24T19:17:09.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.609+0000 7f9cd809f640 10 monclient: init 2026-02-24T19:17:09.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:09.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:09.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 10 monclient(hunting): picked mon.noname-c con 0x7f9cd0121d90 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:09.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd0142a00 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:09.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 10 monclient(hunting): picked mon.noname-a con 0x7f9cd0164710 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:09.615 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd01864c0 con 0x7f9cd0164710 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd01876c0 con 0x7f9cd0142a00 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd01888c0 con 0x7f9cd0121d90 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd809f640 10 monclient(hunting): authenticate will time out at 3603.267179s 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd5613640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f9cd0142a00 0x7f9cd0162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:39414/0 (socket says 10.20.193.194:39414) 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd5e14640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f9cd0121d90 0x7f9cd0122160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.194:57990/0 (socket says 10.20.193.194:57990) 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.610+0000 7f9cd5613640 1 -- 10.20.193.194:0/3666668157 learned_addr learned my addr 10.20.193.194:0/3666668157 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234920864 0 0) 0x7f9cd01888c0 con 0x7f9cd0121d90 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.616 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 10 monclient(hunting): my global_id is 4175 2026-02-24T19:17:09.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb8003610 con 0x7f9cd0121d90 2026-02-24T19:17:09.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2046590373 0 0) 0x7f9cd01876c0 con 0x7f9cd0142a00 2026-02-24T19:17:09.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 10 monclient(hunting): my global_id is 4165 2026-02-24T19:17:09.617 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.611+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd01888c0 con 0x7f9cd0142a00 2026-02-24T19:17:09.624 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3208586976 0 0) 0x7f9cd01888c0 con 0x7f9cd0142a00 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 >> v1:10.20.193.179:6789/0 conn(0x7f9cd0121d90 legacy=0x7f9cd0122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 >> v1:10.20.193.45:6789/0 conn(0x7f9cd0164710 legacy=0x7f9cd0184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 10 monclient: _finish_hunting 0 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 1 monclient: found mon.noname-b 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd0189b60 con 0x7f9cd0142a00 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 10 monclient: _finish_auth 0 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 10 monclient: _check_auth_tickets 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd809f640 5 monclient: authenticate success, global_id 4165 2026-02-24T19:17:09.625 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9cc4002df0 con 0x7f9cd0142a00 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd4e12640 10 monclient: dump: 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.626 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.613+0000 7f9cd809f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9cc4003070 con 0x7f9cd0142a00 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd4e12640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd809f640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd809f640 4 set_mon_vals no callback set 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd4e12640 1 -- 10.20.193.194:0/3666668157 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9cc4003470 con 0x7f9cd0142a00 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd4e12640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd4e12640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd4e12640 10 monclient: dump: 2026-02-24T19:17:09.627 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd809f640 10 monclient: shutdown 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd809f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd809f640 1 -- 10.20.193.194:0/3666668157 >> v1:10.20.193.114:6789/0 conn(0x7f9cd0142a00 legacy=0x7f9cd0162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.628 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd809f640 1 -- 10.20.193.194:0/3666668157 shutdown_connections 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd809f640 1 -- 10.20.193.194:0/3666668157 >> 10.20.193.194:0/3666668157 conn(0x7f9cd0057490 msgr2=0x7f9cd0057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd809f640 1 -- 10.20.193.194:0/3666668157 shutdown_connections 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.614+0000 7f9cd809f640 1 -- 10.20.193.194:0/3666668157 wait complete. 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient: build_initial_monmap 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient: monmap: 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:09.629 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 1 librados: starting msgr at 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 1 librados: starting objecter 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 1 Processor -- start 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 1 -- start start 2026-02-24T19:17:09.630 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 1 librados: setting wanted keys 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 1 librados: calling monclient init 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient: init 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient(hunting): picked mon.noname-a con 0x7f9cd0121d90 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient(hunting): picked mon.noname-c con 0x7f9cd0142a00 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd0164710 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd011c8e0 con 0x7f9cd0121d90 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd011cab0 con 0x7f9cd0164710 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd011cc80 con 0x7f9cd0142a00 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd809f640 10 monclient(hunting): authenticate will time out at 3603.272408s 2026-02-24T19:17:09.631 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd5e14640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9cd0121d90 0x7f9cd0184bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:34302/0 (socket says 10.20.193.194:34302) 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cd5e14640 1 -- 10.20.193.194:0/3427814383 learned_addr learned my addr 10.20.193.194:0/3427814383 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cbe7fc640 10 client.?.objecter ms_handle_connect 0x7f9cd0121d90 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cbe7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cbe7fc640 10 client.?.objecter ms_handle_connect 0x7f9cd0164710 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.615+0000 7f9cbe7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 client.?.objecter ms_handle_connect 0x7f9cd0142a00 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789240743 0 0) 0x7f9cd011c8e0 con 0x7f9cd0121d90 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.632 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 monclient(hunting): my global_id is 4179 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ca0003610 con 0x7f9cd0121d90 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975288100 0 0) 0x7f9cd011cab0 con 0x7f9cd0164710 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 10 monclient(hunting): my global_id is 4168 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.616+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd011c8e0 con 0x7f9cd0164710 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.617+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664945615 0 0) 0x7f9cd011cc80 con 0x7f9cd0142a00 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.617+0000 7f9cbe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.617+0000 7f9cbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.617+0000 7f9cbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.617+0000 7f9cbe7fc640 10 monclient(hunting): my global_id is 4178 2026-02-24T19:17:09.633 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.617+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd011cab0 con 0x7f9cd0142a00 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1760023722 0 0) 0x7f9cd011c8e0 con 0x7f9cd0164710 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cd011cc80 con 0x7f9cd0164710 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1159646327 0 0) 0x7f9ca0003610 con 0x7f9cd0121d90 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cd011c8e0 con 0x7f9cd0121d90 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9cc00030b0 con 0x7f9cd0121d90 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.634 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9ccc0034f0 con 0x7f9cd0164710 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.635 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2857437142 0 0) 0x7f9cd011cab0 con 0x7f9cd0142a00 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ca0003610 con 0x7f9cd0142a00 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9cc4002d00 con 0x7f9cd0142a00 2026-02-24T19:17:09.636 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.619+0000 7f9cbe7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.637 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1196430070 0 0) 0x7f9cd011cc80 con 0x7f9cd0164710 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 >> v1:10.20.193.179:6789/0 conn(0x7f9cd0142a00 legacy=0x7f9cd01487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 >> v1:10.20.193.45:6789/0 conn(0x7f9cd0121d90 legacy=0x7f9cd0184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 1 monclient: found mon.b 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd011ce50 con 0x7f9cd0164710 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cd809f640 5 monclient: authenticate success, global_id 4168 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cd809f640 10 monclient: _renew_subs 2026-02-24T19:17:09.638 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cd809f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd014ff80 con 0x7f9cd0164710 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cd809f640 10 client.4168.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cd809f640 10 monclient: _renew_subs 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cd809f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9cd01505c0 con 0x7f9cd0164710 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.620+0000 7f9cd809f640 1 librados: init done 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.621+0000 7f9cd809f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.621+0000 7f9cd809f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.621+0000 7f9cd809f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:09.639 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.621+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd0188e40 con 0x7f9cd0164710 2026-02-24T19:17:09.712 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.710+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ccc0039b0 con 0x7f9cd0164710 2026-02-24T19:17:09.712 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.710+0000 7f9cbe7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:09.712 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.710+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9ccc003d40 con 0x7f9cd0164710 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.710+0000 7f9cbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.710+0000 7f9cbe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.710+0000 7f9cbe7fc640 10 monclient: dump: 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.713 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.714 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.710+0000 7f9cbffff640 4 set_mon_vals no callback set 2026-02-24T19:17:09.714 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.710+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 2403076157 0 0) 0x7f9ccc003f20 con 0x7f9cd0164710 2026-02-24T19:17:09.714 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.711+0000 7f9cd5e14640 10 monclient: get_auth_request con 0x7f9ca0077d40 auth_method 0 2026-02-24T19:17:09.714 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.711+0000 7f9cbe7fc640 10 client.4168.objecter ms_handle_connect 0x7f9ca0077d40 2026-02-24T19:17:09.716 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.713+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(11..11 src has 1..11) ==== 1755+0+0 (unknown 2512635118 0 0) 0x7f9ccc0584e0 con 0x7f9cd0164710 2026-02-24T19:17:09.716 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.713+0000 7f9cbe7fc640 10 client.4168.objecter ms_dispatch2 0x7f9cd0000b90 osd_map(11..11 src has 1..11) 2026-02-24T19:17:09.716 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.713+0000 7f9cbe7fc640 3 client.4168.objecter handle_osd_map got epochs [11,11] > 0 2026-02-24T19:17:09.716 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.713+0000 7f9cbe7fc640 3 client.4168.objecter handle_osd_map decoding full epoch 11 2026-02-24T19:17:09.716 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.713+0000 7f9cbe7fc640 20 client.4168.objecter dump_active .. 0 homeless 2026-02-24T19:17:09.717 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.716+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9ccc003d40 con 0x7f9cd0164710 2026-02-24T19:17:09.717 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.716+0000 7f9cbe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:09.717 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.716+0000 7f9cbe7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:09.827 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.825+0000 7f9cd809f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "442018bc-d405-49b3-8934-0ab83b4613eb", "id": 9}] 2026-02-24T19:17:09.827 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.825+0000 7f9cd809f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "442018bc-d405-49b3-8934-0ab83b4613eb", "id": 9}] 2026-02-24T19:17:09.827 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.825+0000 7f9cd809f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:09.827 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.825+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd new", "uuid": "442018bc-d405-49b3-8934-0ab83b4613eb", "id": 9} v 0) -- 0x7f9cd00553a0 con 0x7f9cd0164710 2026-02-24T19:17:09.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.875+0000 7f9cbe7fc640 1 -- 10.20.193.194:0/3427814383 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "442018bc-d405-49b3-8934-0ab83b4613eb", "id": 9}]=0 v12) ==== 112+0+2 (unknown 2177855804 0 2769969524) 0x7f9cd00553a0 con 0x7f9cd0164710 2026-02-24T19:17:09.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.875+0000 7f9cbe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "442018bc-d405-49b3-8934-0ab83b4613eb", "id": 9}] 2026-02-24T19:17:09.877 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.875+0000 7f9cbe7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:09.878 INFO:teuthology.orchestra.run.trial194.stdout:9 2026-02-24T19:17:09.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 10 librados: watch_flush enter 2026-02-24T19:17:09.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 10 librados: watch_flush exit 2026-02-24T19:17:09.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 20 client.4168.objecter shutdown clearing up homeless session... 2026-02-24T19:17:09.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 10 client.4168.objecter successfully canceled tick 2026-02-24T19:17:09.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 >> v1:10.20.193.45:6800/1599977652 conn(0x7f9ca0077d40 legacy=0x7f9ca00981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 10 monclient: shutdown 2026-02-24T19:17:09.879 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:09.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 >> v1:10.20.193.114:6789/0 conn(0x7f9cd0164710 legacy=0x7f9cd011c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 shutdown_connections 2026-02-24T19:17:09.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 >> 10.20.193.194:0/3427814383 conn(0x7f9cd0057490 msgr2=0x7f9cd0185370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:09.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 shutdown_connections 2026-02-24T19:17:09.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 1 -- 10.20.193.194:0/3427814383 wait complete. 2026-02-24T19:17:09.880 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.876+0000 7f9cd809f640 1 librados: shutdown 2026-02-24T19:17:09.888 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new e5bf8aa9-8c19-494b-bd7a-c5da71af847b 10 2026-02-24T19:17:09.954 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:09.954 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:09.954 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient: monmap: 2026-02-24T19:17:09.954 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:09.954 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.954 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:09.951753+0000 2026-02-24T19:17:09.954 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:09.951753+0000 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 1 Processor -- start 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 1 -- start start 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient: init 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient(hunting): picked mon.noname-b con 0x7f78b805d9b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:09.955 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient(hunting): picked mon.noname-c con 0x7f78b805dd80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:09.956 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient(hunting): picked mon.noname-a con 0x7f78b81649b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:09.956 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b805e200 con 0x7f78b81649b0 2026-02-24T19:17:09.956 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b81874c0 con 0x7f78b805d9b0 2026-02-24T19:17:09.956 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b81886a0 con 0x7f78b805dd80 2026-02-24T19:17:09.956 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:09.956 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.950+0000 7f78be2e8640 10 monclient(hunting): authenticate will time out at 3603.607991s 2026-02-24T19:17:09.956 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.951+0000 7f78bc85e640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f78b81649b0 0x7f78b8184d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:34318/0 (socket says 10.20.193.194:34318) 2026-02-24T19:17:09.956 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.951+0000 7f78bc85e640 1 -- 10.20.193.194:0/1696608752 learned_addr learned my addr 10.20.193.194:0/1696608752 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:09.964 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272098308 0 0) 0x7f78b81886a0 con 0x7f78b805dd80 2026-02-24T19:17:09.964 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): my global_id is 4181 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f789c003610 con 0x7f78b805dd80 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307295834 0 0) 0x7f78b805e200 con 0x7f78b81649b0 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): my global_id is 4182 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b81886a0 con 0x7f78b81649b0 2026-02-24T19:17:09.965 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582692272 0 0) 0x7f78b81874c0 con 0x7f78b805d9b0 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 10 monclient(hunting): my global_id is 4171 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.952+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b805e200 con 0x7f78b805d9b0 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2844391191 0 0) 0x7f789c003610 con 0x7f78b805dd80 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 >> v1:10.20.193.114:6789/0 conn(0x7f78b805d9b0 legacy=0x7f78b811b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 >> v1:10.20.193.45:6789/0 conn(0x7f78b81649b0 legacy=0x7f78b8184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 1 monclient: found mon.noname-c 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:09.966 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b8189920 con 0x7f78b805dd80 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f78a8002df0 con 0x7f78b805dd80 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78be2e8640 5 monclient: authenticate success, global_id 4181 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78be2e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78b6ffd640 10 monclient: dump: 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.967 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.954+0000 7f78be2e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78a8003030 con 0x7f78b805dd80 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78b6ffd640 1 -- 10.20.193.194:0/1696608752 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f78a8003470 con 0x7f78b805dd80 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.968 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78b6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78b6ffd640 10 monclient: dump: 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:09.969 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 4 set_mon_vals no callback set 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient: shutdown 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 -- 10.20.193.194:0/1696608752 >> v1:10.20.193.179:6789/0 conn(0x7f78b805dd80 legacy=0x7f78b811b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 -- 10.20.193.194:0/1696608752 shutdown_connections 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 -- 10.20.193.194:0/1696608752 >> 10.20.193.194:0/1696608752 conn(0x7f78b80588d0 msgr2=0x7f78b8058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 -- 10.20.193.194:0/1696608752 shutdown_connections 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 -- 10.20.193.194:0/1696608752 wait complete. 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient: monmap: 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:09.970 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 librados: starting msgr at 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 librados: starting objecter 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 Processor -- start 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 -- start start 2026-02-24T19:17:09.971 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 librados: setting wanted keys 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 librados: calling monclient init 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient: init 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient(hunting): picked mon.noname-a con 0x7f78b805d9b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient(hunting): picked mon.noname-c con 0x7f78b805dd80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 10 monclient(hunting): picked mon.noname-b con 0x7f78b81649b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.955+0000 7f78be2e8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b8102360 con 0x7f78b805d9b0 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78be2e8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b8109240 con 0x7f78b81649b0 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78be2e8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b810a420 con 0x7f78b805dd80 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78be2e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78be2e8640 10 monclient(hunting): authenticate will time out at 3603.613044s 2026-02-24T19:17:09.972 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78b7fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f78b805d9b0 0x7f78b8101850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:34330/0 (socket says 10.20.193.194:34330) 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78b7fff640 1 -- 10.20.193.194:0/2443449851 learned_addr learned my addr 10.20.193.194:0/2443449851 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78b4ff9640 10 client.?.objecter ms_handle_connect 0x7f78b805d9b0 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78b4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78b4ff9640 10 client.?.objecter ms_handle_connect 0x7f78b81649b0 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78b4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78b4ff9640 10 client.?.objecter ms_handle_connect 0x7f78b805dd80 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.956+0000 7f78b4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652962890 0 0) 0x7f78b8102360 con 0x7f78b805d9b0 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.973 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): my global_id is 4185 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7888003610 con 0x7f78b805d9b0 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419977880 0 0) 0x7f78b8109240 con 0x7f78b81649b0 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): my global_id is 4174 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b8102360 con 0x7f78b81649b0 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454980949 0 0) 0x7f78b810a420 con 0x7f78b805dd80 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 10 monclient(hunting): my global_id is 4184 2026-02-24T19:17:09.974 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.957+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b8109240 con 0x7f78b805dd80 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3956350700 0 0) 0x7f7888003610 con 0x7f78b805d9b0 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78b810a420 con 0x7f78b805d9b0 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f78a4003170 con 0x7f78b805d9b0 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.975 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3839158769 0 0) 0x7f78b8102360 con 0x7f78b81649b0 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7888003610 con 0x7f78b81649b0 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f78ac003400 con 0x7f78b81649b0 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.959+0000 7f78b4ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.976 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.960+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3220915109 0 0) 0x7f78b8109240 con 0x7f78b805dd80 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.960+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78b8102360 con 0x7f78b805dd80 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.960+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f78a8003380 con 0x7f78b805dd80 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.960+0000 7f78b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.960+0000 7f78b4ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:09.977 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.960+0000 7f78b4ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1765797871 0 0) 0x7f78b810a420 con 0x7f78b805d9b0 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 >> v1:10.20.193.179:6789/0 conn(0x7f78b805dd80 legacy=0x7f78b8161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 >> v1:10.20.193.114:6789/0 conn(0x7f78b81649b0 legacy=0x7f78b81630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:09.978 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 1 monclient: found mon.a 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b810b600 con 0x7f78b805d9b0 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78b4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 5 monclient: authenticate success, global_id 4185 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 10 monclient: _renew_subs 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f78b8109410 con 0x7f78b805d9b0 2026-02-24T19:17:09.979 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 10 client.4185.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:09.980 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 10 monclient: _renew_subs 2026-02-24T19:17:09.980 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:09.980 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f78b8109a00 con 0x7f78b805d9b0 2026-02-24T19:17:09.980 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 1 librados: init done 2026-02-24T19:17:09.980 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:09.980 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:09.980 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:09.980 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.961+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b81869b0 con 0x7f78b805d9b0 2026-02-24T19:17:09.981 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.969+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78a40034e0 con 0x7f78b805d9b0 2026-02-24T19:17:09.981 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.969+0000 7f78b4ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:09.981 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.969+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f78a4003b50 con 0x7f78b805d9b0 2026-02-24T19:17:09.981 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.969+0000 7f78b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.969+0000 7f78b4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.969+0000 7f78b4ff9640 10 monclient: dump: 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:09.982 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:09.983 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.969+0000 7f78b67fc640 4 set_mon_vals no callback set 2026-02-24T19:17:09.983 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.970+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 2403076157 0 0) 0x7f78a4003d30 con 0x7f78b805d9b0 2026-02-24T19:17:09.983 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.970+0000 7f78b77fe640 10 monclient: get_auth_request con 0x7f7888077d20 auth_method 0 2026-02-24T19:17:09.983 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:09.971+0000 7f78b4ff9640 10 client.4185.objecter ms_handle_connect 0x7f7888077d20 2026-02-24T19:17:10.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.095+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(12..12 src has 1..12) ==== 1870+0+0 (unknown 1470741303 0 0) 0x7f78a40594e0 con 0x7f78b805d9b0 2026-02-24T19:17:10.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.095+0000 7f78b4ff9640 10 client.4185.objecter ms_dispatch2 0x7f78b8000b90 osd_map(12..12 src has 1..12) 2026-02-24T19:17:10.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.095+0000 7f78b4ff9640 3 client.4185.objecter handle_osd_map got epochs [12,12] > 0 2026-02-24T19:17:10.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.095+0000 7f78b4ff9640 3 client.4185.objecter handle_osd_map decoding full epoch 12 2026-02-24T19:17:10.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.095+0000 7f78b4ff9640 20 client.4185.objecter dump_active .. 0 homeless 2026-02-24T19:17:10.099 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.097+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f78a405dc50 con 0x7f78b805d9b0 2026-02-24T19:17:10.099 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.097+0000 7f78b4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:10.099 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.097+0000 7f78b4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:10.211 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.209+0000 7f78be2e8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e5bf8aa9-8c19-494b-bd7a-c5da71af847b", "id": 10}] 2026-02-24T19:17:10.212 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.209+0000 7f78be2e8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e5bf8aa9-8c19-494b-bd7a-c5da71af847b", "id": 10}] 2026-02-24T19:17:10.212 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.209+0000 7f78be2e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:10.212 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.209+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e5bf8aa9-8c19-494b-bd7a-c5da71af847b", "id": 10} v 0) -- 0x7f78b8109d40 con 0x7f78b805d9b0 2026-02-24T19:17:10.227 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.225+0000 7f78b4ff9640 1 -- 10.20.193.194:0/2443449851 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5bf8aa9-8c19-494b-bd7a-c5da71af847b", "id": 10}]=0 v13) ==== 113+0+3 (unknown 202440876 0 520826459) 0x7f78a4003b50 con 0x7f78b805d9b0 2026-02-24T19:17:10.228 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.225+0000 7f78b4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e5bf8aa9-8c19-494b-bd7a-c5da71af847b", "id": 10}] 2026-02-24T19:17:10.228 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.225+0000 7f78b4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:10.228 INFO:teuthology.orchestra.run.trial194.stdout:10 2026-02-24T19:17:10.229 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 10 librados: watch_flush enter 2026-02-24T19:17:10.229 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 10 librados: watch_flush exit 2026-02-24T19:17:10.229 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 20 client.4185.objecter shutdown clearing up homeless session... 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 10 client.4185.objecter successfully canceled tick 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 >> v1:10.20.193.45:6800/1599977652 conn(0x7f7888077d20 legacy=0x7f78880981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 10 monclient: shutdown 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 >> v1:10.20.193.45:6789/0 conn(0x7f78b805d9b0 legacy=0x7f78b8101850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 shutdown_connections 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 >> 10.20.193.194:0/2443449851 conn(0x7f78b80588d0 msgr2=0x7f78b805c010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 shutdown_connections 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 1 -- 10.20.193.194:0/2443449851 wait complete. 2026-02-24T19:17:10.230 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.226+0000 7f78be2e8640 1 librados: shutdown 2026-02-24T19:17:10.236 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new 6cb63f95-82e0-483f-926b-94a88b3c54f2 11 2026-02-24T19:17:10.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.297+0000 7f47daf5c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:10.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.297+0000 7f47daf5c640 10 monclient: build_initial_monmap 2026-02-24T19:17:10.300 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.297+0000 7f47daf5c640 10 monclient: monmap: 2026-02-24T19:17:10.300 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:10.300 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.300 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:10.299095+0000 2026-02-24T19:17:10.300 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:10.299095+0000 2026-02-24T19:17:10.301 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:10.301 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.301 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:10.301 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:10.301 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:10.301 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.307 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 1 Processor -- start 2026-02-24T19:17:10.307 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 1 -- start start 2026-02-24T19:17:10.307 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 10 monclient: init 2026-02-24T19:17:10.307 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:10.307 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:10.307 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 10 monclient(hunting): picked mon.noname-b con 0x7f47d411c500 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:10.307 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 10 monclient(hunting): picked mon.noname-a con 0x7f47d411e420 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:10.307 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 10 monclient(hunting): picked mon.noname-c con 0x7f47d411ffc0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d4120d10 con 0x7f47d411e420 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d4120f00 con 0x7f47d411c500 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d41210f0 con 0x7f47d411ffc0 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47daf5c640 10 monclient(hunting): authenticate will time out at 3603.955318s 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47d8cd1640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f47d411c500 0x7f47d411c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:39452/0 (socket says 10.20.193.194:39452) 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.298+0000 7f47d8cd1640 1 -- 10.20.193.194:0/3694582758 learned_addr learned my addr 10.20.193.194:0/3694582758 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2323900568 0 0) 0x7f47d4120d10 con 0x7f47d411e420 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.308 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): my global_id is 4188 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47c0003610 con 0x7f47d411e420 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428673925 0 0) 0x7f47d4120f00 con 0x7f47d411c500 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): my global_id is 4177 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d4120d10 con 0x7f47d411c500 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2426424552 0 0) 0x7f47d41210f0 con 0x7f47d411ffc0 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.309 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 10 monclient(hunting): my global_id is 4187 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.300+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d4120f00 con 0x7f47d411ffc0 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 495964387 0 0) 0x7f47d4120d10 con 0x7f47d411c500 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 >> v1:10.20.193.179:6789/0 conn(0x7f47d411ffc0 legacy=0x7f47d4120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 >> v1:10.20.193.45:6789/0 conn(0x7f47d411e420 legacy=0x7f47d411e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 1 monclient: found mon.noname-b 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d4121380 con 0x7f47d411c500 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:10.310 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47daf5c640 5 monclient: authenticate success, global_id 4177 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47daf5c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f47c4002df0 con 0x7f47d411c500 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47cb7fe640 10 monclient: dump: 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.311 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.301+0000 7f47daf5c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47c40030b0 con 0x7f47d411c500 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47cb7fe640 1 -- 10.20.193.194:0/3694582758 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f47c40034b0 con 0x7f47d411c500 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47cb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47cb7fe640 10 monclient: dump: 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.312 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47daf5c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47daf5c640 4 set_mon_vals no callback set 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47daf5c640 10 monclient: shutdown 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47daf5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47daf5c640 1 -- 10.20.193.194:0/3694582758 >> v1:10.20.193.114:6789/0 conn(0x7f47d411c500 legacy=0x7f47d411c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.313 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47daf5c640 1 -- 10.20.193.194:0/3694582758 shutdown_connections 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47daf5c640 1 -- 10.20.193.194:0/3694582758 >> 10.20.193.194:0/3694582758 conn(0x7f47d40588d0 msgr2=0x7f47d4058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47daf5c640 1 -- 10.20.193.194:0/3694582758 shutdown_connections 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.302+0000 7f47daf5c640 1 -- 10.20.193.194:0/3694582758 wait complete. 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient: build_initial_monmap 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient: monmap: 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:10.314 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 1 librados: starting msgr at 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 1 librados: starting objecter 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 1 Processor -- start 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 1 -- start start 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 1 librados: setting wanted keys 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 1 librados: calling monclient init 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient: init 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:10.315 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient(hunting): picked mon.noname-b con 0x7f47d411c500 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient(hunting): picked mon.noname-a con 0x7f47d411e420 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient(hunting): picked mon.noname-c con 0x7f47d411ffc0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d4179650 con 0x7f47d411e420 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d417a830 con 0x7f47d411c500 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d417ba10 con 0x7f47d411ffc0 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47daf5c640 10 monclient(hunting): authenticate will time out at 3603.960499s 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47d94d2640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f47d411ffc0 0x7f47d4177f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.194:58036/0 (socket says 10.20.193.194:58036) 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.303+0000 7f47d94d2640 1 -- 10.20.193.194:0/1934291445 learned_addr learned my addr 10.20.193.194:0/1934291445 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.304+0000 7f47c97fa640 10 client.?.objecter ms_handle_connect 0x7f47d411c500 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.304+0000 7f47c97fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:10.316 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.304+0000 7f47c97fa640 10 client.?.objecter ms_handle_connect 0x7f47d411e420 2026-02-24T19:17:10.317 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.304+0000 7f47c97fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:10.317 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.304+0000 7f47c97fa640 10 client.?.objecter ms_handle_connect 0x7f47d411ffc0 2026-02-24T19:17:10.317 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.304+0000 7f47c97fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:10.321 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645515006 0 0) 0x7f47d417ba10 con 0x7f47d411ffc0 2026-02-24T19:17:10.321 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.321 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.321 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.321 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): my global_id is 4190 2026-02-24T19:17:10.321 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a4003610 con 0x7f47d411ffc0 2026-02-24T19:17:10.321 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300016169 0 0) 0x7f47d417a830 con 0x7f47d411c500 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): my global_id is 4180 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d417ba10 con 0x7f47d411c500 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484524012 0 0) 0x7f47d4179650 con 0x7f47d411e420 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 10 monclient(hunting): my global_id is 4191 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.305+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d417a830 con 0x7f47d411e420 2026-02-24T19:17:10.322 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2883313106 0 0) 0x7f47d417ba10 con 0x7f47d411c500 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47d4179650 con 0x7f47d411c500 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f47c4002df0 con 0x7f47d411c500 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): dump: 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.323 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 885901261 0 0) 0x7f47d417a830 con 0x7f47d411e420 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47d417ba10 con 0x7f47d411e420 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f47bc002fe0 con 0x7f47d411e420 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): dump: 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.324 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 714020907 0 0) 0x7f47a4003610 con 0x7f47d411ffc0 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47d417a830 con 0x7f47d411ffc0 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f47d0003340 con 0x7f47d411ffc0 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:10.325 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.307+0000 7f47c97fa640 10 monclient(hunting): dump: 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.326 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 544860860 0 0) 0x7f47d4179650 con 0x7f47d411c500 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 >> v1:10.20.193.179:6789/0 conn(0x7f47d411ffc0 legacy=0x7f47d4177f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 >> v1:10.20.193.45:6789/0 conn(0x7f47d411e420 legacy=0x7f47d4176810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 1 monclient: found mon.b 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d417cbf0 con 0x7f47d411c500 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:10.327 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47c97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 5 monclient: authenticate success, global_id 4180 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 10 monclient: _renew_subs 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47d4179820 con 0x7f47d411c500 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 10 client.4180.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 10 monclient: _renew_subs 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f47d4179dc0 con 0x7f47d411c500 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 1 librados: init done 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:10.328 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.309+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d418b560 con 0x7f47d411c500 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.316+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47c4002fb0 con 0x7f47d411c500 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.316+0000 7f47c97fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.316+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f47c4004e80 con 0x7f47d411c500 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.316+0000 7f47c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.316+0000 7f47c97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.316+0000 7f47caffd640 4 set_mon_vals no callback set 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.316+0000 7f47c97fa640 10 monclient: dump: 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.329 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.317+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 2403076157 0 0) 0x7f47c401dc50 con 0x7f47d411c500 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.317+0000 7f47cbfff640 10 monclient: get_auth_request con 0x7f47a4077d90 auth_method 0 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.317+0000 7f47c97fa640 10 client.4180.objecter ms_handle_connect 0x7f47a4077d90 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.318+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(13..13 src has 1..13) ==== 1985+0+0 (unknown 2256362654 0 0) 0x7f47c4059480 con 0x7f47d411c500 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.318+0000 7f47c97fa640 10 client.4180.objecter ms_dispatch2 0x7f47d4000b90 osd_map(13..13 src has 1..13) 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.318+0000 7f47c97fa640 3 client.4180.objecter handle_osd_map got epochs [13,13] > 0 2026-02-24T19:17:10.330 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.318+0000 7f47c97fa640 3 client.4180.objecter handle_osd_map decoding full epoch 13 2026-02-24T19:17:10.331 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.318+0000 7f47c97fa640 20 client.4180.objecter dump_active .. 0 homeless 2026-02-24T19:17:10.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.402+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f47c405dbf0 con 0x7f47d411c500 2026-02-24T19:17:10.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.402+0000 7f47c97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:10.405 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.402+0000 7f47c97fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:10.518 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.515+0000 7f47daf5c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "6cb63f95-82e0-483f-926b-94a88b3c54f2", "id": 11}] 2026-02-24T19:17:10.518 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.515+0000 7f47daf5c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "6cb63f95-82e0-483f-926b-94a88b3c54f2", "id": 11}] 2026-02-24T19:17:10.518 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.515+0000 7f47daf5c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:10.518 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.515+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd new", "uuid": "6cb63f95-82e0-483f-926b-94a88b3c54f2", "id": 11} v 0) -- 0x7f47d417a150 con 0x7f47d411c500 2026-02-24T19:17:10.618 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.616+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7f47c405cdb0 con 0x7f47d411c500 2026-02-24T19:17:10.665 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.662+0000 7f47c97fa640 1 -- 10.20.193.194:0/1934291445 <== mon.1 v1:10.20.193.114:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6cb63f95-82e0-483f-926b-94a88b3c54f2", "id": 11}]=0 v14) ==== 113+0+3 (unknown 234090199 0 212448812) 0x7f47c4047c30 con 0x7f47d411c500 2026-02-24T19:17:10.665 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.662+0000 7f47c97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "6cb63f95-82e0-483f-926b-94a88b3c54f2", "id": 11}] 2026-02-24T19:17:10.665 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.662+0000 7f47c97fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:10.665 INFO:teuthology.orchestra.run.trial194.stdout:11 2026-02-24T19:17:10.667 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.663+0000 7f47daf5c640 10 librados: watch_flush enter 2026-02-24T19:17:10.667 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.663+0000 7f47daf5c640 10 librados: watch_flush exit 2026-02-24T19:17:10.667 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.663+0000 7f47daf5c640 20 client.4180.objecter shutdown clearing up homeless session... 2026-02-24T19:17:10.667 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.663+0000 7f47daf5c640 10 client.4180.objecter successfully canceled tick 2026-02-24T19:17:10.667 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.663+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 >> v1:10.20.193.45:6800/1599977652 conn(0x7f47a4077d90 legacy=0x7f47a4098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.667 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.663+0000 7f47daf5c640 10 monclient: shutdown 2026-02-24T19:17:10.667 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.663+0000 7f47daf5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:10.667 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.663+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 >> v1:10.20.193.114:6789/0 conn(0x7f47d411c500 legacy=0x7f47d412fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.668 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.664+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 shutdown_connections 2026-02-24T19:17:10.668 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.664+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 >> 10.20.193.194:0/1934291445 conn(0x7f47d40588d0 msgr2=0x7f47d411f070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:10.668 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.664+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 shutdown_connections 2026-02-24T19:17:10.668 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.664+0000 7f47daf5c640 1 -- 10.20.193.194:0/1934291445 wait complete. 2026-02-24T19:17:10.668 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.664+0000 7f47daf5c640 1 librados: shutdown 2026-02-24T19:17:10.677 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new b15b2174-466b-4e9a-9c6d-ed8caabe7b28 12 2026-02-24T19:17:10.743 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.739+0000 7f346a65b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:10.743 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.739+0000 7f346a65b640 10 monclient: build_initial_monmap 2026-02-24T19:17:10.743 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.739+0000 7f346a65b640 10 monclient: monmap: 2026-02-24T19:17:10.743 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:10.743 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.743 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:10.740863+0000 2026-02-24T19:17:10.743 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:10.740863+0000 2026-02-24T19:17:10.743 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.739+0000 7f346a65b640 1 Processor -- start 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.739+0000 7f346a65b640 1 -- start start 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.739+0000 7f346a65b640 10 monclient: init 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.739+0000 7f346a65b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f346a65b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f346a65b640 10 monclient(hunting): picked mon.noname-b con 0x7f346405d9b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:10.744 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f346a65b640 10 monclient(hunting): picked mon.noname-c con 0x7f346405dd80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:10.745 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f346a65b640 10 monclient(hunting): picked mon.noname-a con 0x7f34641649b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:10.745 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f346a65b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f346405e200 con 0x7f34641649b0 2026-02-24T19:17:10.745 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f346a65b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34641874c0 con 0x7f346405d9b0 2026-02-24T19:17:10.745 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f346a65b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34641886a0 con 0x7f346405dd80 2026-02-24T19:17:10.745 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f346a65b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:10.745 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f346a65b640 10 monclient(hunting): authenticate will time out at 3604.397073s 2026-02-24T19:17:10.745 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f3468bd1640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f34641649b0 0x7f3464184d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:34350/0 (socket says 10.20.193.194:34350) 2026-02-24T19:17:10.745 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.740+0000 7f3468bd1640 1 -- 10.20.193.194:0/874414916 learned_addr learned my addr 10.20.193.194:0/874414916 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:10.752 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649871195 0 0) 0x7f34641886a0 con 0x7f346405dd80 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): my global_id is 4193 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3448003610 con 0x7f346405dd80 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612397598 0 0) 0x7f346405e200 con 0x7f34641649b0 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.753 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): my global_id is 4194 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34641886a0 con 0x7f34641649b0 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217226306 0 0) 0x7f34641874c0 con 0x7f346405d9b0 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 10 monclient(hunting): my global_id is 4183 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.741+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f346405e200 con 0x7f346405d9b0 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2750521216 0 0) 0x7f34641886a0 con 0x7f34641649b0 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 >> v1:10.20.193.179:6789/0 conn(0x7f346405dd80 legacy=0x7f346411b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 >> v1:10.20.193.114:6789/0 conn(0x7f346405d9b0 legacy=0x7f346411b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:10.754 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3464189920 con 0x7f34641649b0 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3458003170 con 0x7f34641649b0 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f346a65b640 5 monclient: authenticate success, global_id 4194 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f346a65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f3462ffd640 10 monclient: dump: 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.755 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.743+0000 7f346a65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:10.756 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3458003380 con 0x7f34641649b0 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f3462ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f3462ffd640 1 -- 10.20.193.194:0/874414916 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f34580037c0 con 0x7f34641649b0 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f3462ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f3462ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f3462ffd640 10 monclient: dump: 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.757 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 4 set_mon_vals no callback set 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 10 monclient: shutdown 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 1 -- 10.20.193.194:0/874414916 >> v1:10.20.193.45:6789/0 conn(0x7f34641649b0 legacy=0x7f3464184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 1 -- 10.20.193.194:0/874414916 shutdown_connections 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 1 -- 10.20.193.194:0/874414916 >> 10.20.193.194:0/874414916 conn(0x7f34640588d0 msgr2=0x7f3464058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 1 -- 10.20.193.194:0/874414916 shutdown_connections 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 1 -- 10.20.193.194:0/874414916 wait complete. 2026-02-24T19:17:10.758 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 10 monclient: build_initial_monmap 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 10 monclient: monmap: 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 1 librados: starting msgr at 2026-02-24T19:17:10.759 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 1 librados: starting objecter 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.744+0000 7f346a65b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 1 Processor -- start 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 1 -- start start 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 1 librados: setting wanted keys 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 1 librados: calling monclient init 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 10 monclient: init 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 10 monclient(hunting): picked mon.noname-a con 0x7f346405d9b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 10 monclient(hunting): picked mon.noname-c con 0x7f346405dd80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 10 monclient(hunting): picked mon.noname-b con 0x7f34641649b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f346416c6b0 con 0x7f346405d9b0 2026-02-24T19:17:10.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3464173500 con 0x7f34641649b0 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34641746e0 con 0x7f346405dd80 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f346a65b640 10 monclient(hunting): authenticate will time out at 3604.402281s 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f3463fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f346405d9b0 0x7f346416bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:34366/0 (socket says 10.20.193.194:34366) 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f3463fff640 1 -- 10.20.193.194:0/3871249414 learned_addr learned my addr 10.20.193.194:0/3871249414 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f3460ff9640 10 client.?.objecter ms_handle_connect 0x7f346405dd80 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.745+0000 7f3460ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 client.?.objecter ms_handle_connect 0x7f346405d9b0 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 client.?.objecter ms_handle_connect 0x7f34641649b0 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:10.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240945659 0 0) 0x7f346416c6b0 con 0x7f346405d9b0 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 monclient(hunting): my global_id is 4197 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3434003610 con 0x7f346405d9b0 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1376822655 0 0) 0x7f34641746e0 con 0x7f346405dd80 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 10 monclient(hunting): my global_id is 4196 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.746+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f346416c6b0 con 0x7f346405dd80 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.747+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271958017 0 0) 0x7f3464173500 con 0x7f34641649b0 2026-02-24T19:17:10.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.747+0000 7f3460ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.747+0000 7f3460ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.747+0000 7f3460ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.747+0000 7f3460ff9640 10 monclient(hunting): my global_id is 4186 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.747+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34641746e0 con 0x7f34641649b0 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 390203108 0 0) 0x7f3434003610 con 0x7f346405d9b0 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3464173500 con 0x7f346405d9b0 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3233405698 0 0) 0x7f346416c6b0 con 0x7f346405dd80 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3434003610 con 0x7f346405dd80 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3454003020 con 0x7f346405dd80 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:10.763 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3450003280 con 0x7f346405d9b0 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:10.764 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1243832893 0 0) 0x7f34641746e0 con 0x7f34641649b0 2026-02-24T19:17:10.765 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f346416c6b0 con 0x7f34641649b0 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f34580036d0 con 0x7f34641649b0 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.749+0000 7f3460ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.766 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.767 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3858216054 0 0) 0x7f3434003610 con 0x7f346405dd80 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 >> v1:10.20.193.114:6789/0 conn(0x7f34641649b0 legacy=0x7f34641630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 >> v1:10.20.193.45:6789/0 conn(0x7f346405d9b0 legacy=0x7f346416bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 1 monclient: found mon.c 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34641758c0 con 0x7f346405dd80 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f3460ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:10.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f346a65b640 5 monclient: authenticate success, global_id 4196 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f346a65b640 10 monclient: _renew_subs 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f346a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34641724f0 con 0x7f346405dd80 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f346a65b640 10 client.4196.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f346a65b640 10 monclient: _renew_subs 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f346a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3464172a60 con 0x7f346405dd80 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.750+0000 7f346a65b640 1 librados: init done 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.751+0000 7f346a65b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.751+0000 7f346a65b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.751+0000 7f346a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.751+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34641869b0 con 0x7f346405dd80 2026-02-24T19:17:10.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.758+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34540034e0 con 0x7f346405dd80 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.758+0000 7f3460ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.758+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f34540038b0 con 0x7f346405dd80 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.758+0000 7f3460ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.758+0000 7f3460ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.758+0000 7f3460ff9640 10 monclient: dump: 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:10.772 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.758+0000 7f34627fc640 4 set_mon_vals no callback set 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.759+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7f3454003a90 con 0x7f346405dd80 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.759+0000 7f3463fff640 10 monclient: get_auth_request con 0x7f3434077e10 auth_method 0 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.759+0000 7f3460ff9640 10 client.4196.objecter ms_handle_connect 0x7f3434077e10 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.761+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 2100+0+0 (unknown 2921022135 0 0) 0x7f3454058170 con 0x7f346405dd80 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.761+0000 7f3460ff9640 10 client.4196.objecter ms_dispatch2 0x7f3464000b90 osd_map(14..14 src has 1..14) 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.761+0000 7f3460ff9640 3 client.4196.objecter handle_osd_map got epochs [14,14] > 0 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.761+0000 7f3460ff9640 3 client.4196.objecter handle_osd_map decoding full epoch 14 2026-02-24T19:17:10.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.761+0000 7f3460ff9640 20 client.4196.objecter dump_active .. 0 homeless 2026-02-24T19:17:10.848 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.845+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f34540038b0 con 0x7f346405dd80 2026-02-24T19:17:10.848 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.845+0000 7f3460ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:10.848 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.845+0000 7f3460ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:10.959 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.957+0000 7f346a65b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b15b2174-466b-4e9a-9c6d-ed8caabe7b28", "id": 12}] 2026-02-24T19:17:10.960 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.957+0000 7f346a65b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b15b2174-466b-4e9a-9c6d-ed8caabe7b28", "id": 12}] 2026-02-24T19:17:10.960 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.957+0000 7f346a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:10.960 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:10.957+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b15b2174-466b-4e9a-9c6d-ed8caabe7b28", "id": 12} v 0) -- 0x7f3464172da0 con 0x7f346405dd80 2026-02-24T19:17:11.004 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.002+0000 7f3460ff9640 1 -- 10.20.193.194:0/3871249414 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b15b2174-466b-4e9a-9c6d-ed8caabe7b28", "id": 12}]=0 v15) ==== 113+0+3 (unknown 4127452314 0 944643765) 0x7f3464172da0 con 0x7f346405dd80 2026-02-24T19:17:11.005 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.002+0000 7f3460ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b15b2174-466b-4e9a-9c6d-ed8caabe7b28", "id": 12}] 2026-02-24T19:17:11.005 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.002+0000 7f3460ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:11.005 INFO:teuthology.orchestra.run.trial194.stdout:12 2026-02-24T19:17:11.006 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 10 librados: watch_flush enter 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 10 librados: watch_flush exit 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 20 client.4196.objecter shutdown clearing up homeless session... 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 10 client.4196.objecter successfully canceled tick 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 >> v1:10.20.193.45:6800/1599977652 conn(0x7f3434077e10 legacy=0x7f34340982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 10 monclient: shutdown 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 >> v1:10.20.193.179:6789/0 conn(0x7f346405dd80 legacy=0x7f3464161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 shutdown_connections 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 >> 10.20.193.194:0/3871249414 conn(0x7f34640588d0 msgr2=0x7f346411b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 shutdown_connections 2026-02-24T19:17:11.007 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 1 -- 10.20.193.194:0/3871249414 wait complete. 2026-02-24T19:17:11.008 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.003+0000 7f346a65b640 1 librados: shutdown 2026-02-24T19:17:11.014 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new d4e5150e-a985-488e-a911-45bf3431c165 13 2026-02-24T19:17:11.079 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.077+0000 7fe8166ae640 10 monclient: get_monmap_and_config 2026-02-24T19:17:11.080 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.077+0000 7fe8166ae640 10 monclient: build_initial_monmap 2026-02-24T19:17:11.080 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.077+0000 7fe8166ae640 10 monclient: monmap: 2026-02-24T19:17:11.080 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:11.080 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.080 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:11.078789+0000 2026-02-24T19:17:11.080 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:11.078789+0000 2026-02-24T19:17:11.080 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:11.080 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.080 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:11.081 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:11.081 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:11.081 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.087 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.077+0000 7fe8166ae640 1 Processor -- start 2026-02-24T19:17:11.087 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.077+0000 7fe8166ae640 1 -- start start 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.077+0000 7fe8166ae640 10 monclient: init 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 10 monclient(hunting): picked mon.noname-a con 0x7fe81011c500 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 10 monclient(hunting): picked mon.noname-b con 0x7fe81011e420 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 10 monclient(hunting): picked mon.noname-c con 0x7fe81011ffc0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe810120d10 con 0x7fe81011c500 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe810120f00 con 0x7fe81011e420 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8101210f0 con 0x7fe81011ffc0 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe8166ae640 10 monclient(hunting): authenticate will time out at 3604.735128s 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe80f7fe640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fe81011e420 0x7fe81011e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:39488/0 (socket says 10.20.193.194:39488) 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.078+0000 7fe80f7fe640 1 -- 10.20.193.194:0/4199785049 learned_addr learned my addr 10.20.193.194:0/4199785049 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2161587631 0 0) 0x7fe8101210f0 con 0x7fe81011ffc0 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): my global_id is 4199 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7f4003610 con 0x7fe81011ffc0 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4072971445 0 0) 0x7fe810120f00 con 0x7fe81011e420 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): my global_id is 4189 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8101210f0 con 0x7fe81011e420 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865609363 0 0) 0x7fe810120d10 con 0x7fe81011c500 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 10 monclient(hunting): my global_id is 4200 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.079+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe810120f00 con 0x7fe81011c500 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2974206953 0 0) 0x7fe8101210f0 con 0x7fe81011e420 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 >> v1:10.20.193.179:6789/0 conn(0x7fe81011ffc0 legacy=0x7fe810120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 >> v1:10.20.193.45:6789/0 conn(0x7fe81011c500 legacy=0x7fe81011c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 1 monclient: found mon.noname-b 2026-02-24T19:17:11.090 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810121380 con 0x7fe81011e420 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 10 monclient: _finish_auth 0 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe800002df0 con 0x7fe81011e420 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe80effd640 10 monclient: dump: 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.091 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe8166ae640 5 monclient: authenticate success, global_id 4189 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.081+0000 7fe8166ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe800003000 con 0x7fe81011e420 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe80effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe80effd640 1 -- 10.20.193.194:0/4199785049 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe800003440 con 0x7fe81011e420 2026-02-24T19:17:11.092 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe80effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe80effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe80effd640 10 monclient: dump: 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.093 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 4 set_mon_vals no callback set 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient: shutdown 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 -- 10.20.193.194:0/4199785049 >> v1:10.20.193.114:6789/0 conn(0x7fe81011e420 legacy=0x7fe81011e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 -- 10.20.193.194:0/4199785049 shutdown_connections 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 -- 10.20.193.194:0/4199785049 >> 10.20.193.194:0/4199785049 conn(0x7fe8100588d0 msgr2=0x7fe810058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 -- 10.20.193.194:0/4199785049 shutdown_connections 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 -- 10.20.193.194:0/4199785049 wait complete. 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient: build_initial_monmap 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient: monmap: 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:11.094 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 librados: starting msgr at 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 librados: starting objecter 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:11.095 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 Processor -- start 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 -- start start 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 librados: setting wanted keys 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 librados: calling monclient init 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient: init 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient(hunting): picked mon.noname-a con 0x7fe81011c500 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient(hunting): picked mon.noname-b con 0x7fe81011e420 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient(hunting): picked mon.noname-c con 0x7fe81011ffc0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe810179720 con 0x7fe81011c500 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81017a900 con 0x7fe81011e420 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81017bae0 con 0x7fe81011ffc0 2026-02-24T19:17:11.096 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.082+0000 7fe8166ae640 10 monclient(hunting): authenticate will time out at 3604.739991s 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.083+0000 7fe80f7fe640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fe81011e420 0x7fe8101768e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:39494/0 (socket says 10.20.193.194:39494) 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.083+0000 7fe80f7fe640 1 -- 10.20.193.194:0/39779666 learned_addr learned my addr 10.20.193.194:0/39779666 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.083+0000 7fe80cff9640 10 client.?.objecter ms_handle_connect 0x7fe81011ffc0 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.083+0000 7fe80cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.083+0000 7fe80cff9640 10 client.?.objecter ms_handle_connect 0x7fe81011e420 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.083+0000 7fe80cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.083+0000 7fe80cff9640 10 client.?.objecter ms_handle_connect 0x7fe81011c500 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.083+0000 7fe80cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3938125467 0 0) 0x7fe81017bae0 con 0x7fe81011ffc0 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.097 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): my global_id is 4202 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7e0003610 con 0x7fe81011ffc0 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578669755 0 0) 0x7fe81017a900 con 0x7fe81011e420 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): my global_id is 4192 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe81017bae0 con 0x7fe81011e420 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685395228 0 0) 0x7fe810179720 con 0x7fe81011c500 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.098 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 10 monclient(hunting): my global_id is 4203 2026-02-24T19:17:11.099 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.084+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe81017a900 con 0x7fe81011c500 2026-02-24T19:17:11.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3758873387 0 0) 0x7fe7e0003610 con 0x7fe81011ffc0 2026-02-24T19:17:11.101 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe810179720 con 0x7fe81011ffc0 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8040033a0 con 0x7fe81011ffc0 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 10 monclient(hunting): dump: 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.102 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 409915933 0 0) 0x7fe81017bae0 con 0x7fe81011e420 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7e0003610 con 0x7fe81011e420 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe800003350 con 0x7fe81011e420 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.086+0000 7fe80cff9640 10 monclient(hunting): dump: 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.103 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.087+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1140354270 0 0) 0x7fe81017a900 con 0x7fe81011c500 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.087+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe81017bae0 con 0x7fe81011c500 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.087+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe7fc003060 con 0x7fe81011c500 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.087+0000 7fe80cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.087+0000 7fe80cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:11.104 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.087+0000 7fe80cff9640 10 monclient(hunting): dump: 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 717202293 0 0) 0x7fe810179720 con 0x7fe81011ffc0 2026-02-24T19:17:11.105 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 >> v1:10.20.193.114:6789/0 conn(0x7fe81011e420 legacy=0x7fe8101768e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 >> v1:10.20.193.45:6789/0 conn(0x7fe81011c500 legacy=0x7fe81012fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 1 monclient: found mon.c 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81017ccc0 con 0x7fe81011ffc0 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe80cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 5 monclient: authenticate success, global_id 4202 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 10 monclient: _renew_subs 2026-02-24T19:17:11.106 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe81017aad0 con 0x7fe81011ffc0 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 10 client.4202.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 10 monclient: _renew_subs 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe81017b070 con 0x7fe81011ffc0 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 1 librados: init done 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.107 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.088+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe81017b570 con 0x7fe81011ffc0 2026-02-24T19:17:11.179 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.177+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe804003870 con 0x7fe81011ffc0 2026-02-24T19:17:11.179 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.177+0000 7fe80cff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:11.179 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.177+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe804003c00 con 0x7fe81011ffc0 2026-02-24T19:17:11.179 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.177+0000 7fe80cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:11.179 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.177+0000 7fe80cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:11.179 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.177+0000 7fe80cff9640 10 monclient: dump: 2026-02-24T19:17:11.179 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.179 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.179 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.180 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.180 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.180 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.180 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.180 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.180 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.180 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.180 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.177+0000 7fe80e7fc640 4 set_mon_vals no callback set 2026-02-24T19:17:11.181 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.177+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7fe804003de0 con 0x7fe81011ffc0 2026-02-24T19:17:11.181 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.178+0000 7fe80ffff640 10 monclient: get_auth_request con 0x7fe7e0077d90 auth_method 0 2026-02-24T19:17:11.181 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.178+0000 7fe80cff9640 10 client.4202.objecter ms_handle_connect 0x7fe7e0077d90 2026-02-24T19:17:11.181 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.178+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 2215+0+0 (unknown 4020719397 0 0) 0x7fe804058550 con 0x7fe81011ffc0 2026-02-24T19:17:11.182 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.178+0000 7fe80cff9640 10 client.4202.objecter ms_dispatch2 0x7fe810000b90 osd_map(15..15 src has 1..15) 2026-02-24T19:17:11.182 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.178+0000 7fe80cff9640 3 client.4202.objecter handle_osd_map got epochs [15,15] > 0 2026-02-24T19:17:11.182 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.178+0000 7fe80cff9640 3 client.4202.objecter handle_osd_map decoding full epoch 15 2026-02-24T19:17:11.182 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.178+0000 7fe80cff9640 20 client.4202.objecter dump_active .. 0 homeless 2026-02-24T19:17:11.182 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.180+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe804003c00 con 0x7fe81011ffc0 2026-02-24T19:17:11.183 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.180+0000 7fe80cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:11.183 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.180+0000 7fe80cff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:11.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.290+0000 7fe8166ae640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d4e5150e-a985-488e-a911-45bf3431c165", "id": 13}] 2026-02-24T19:17:11.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.290+0000 7fe8166ae640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d4e5150e-a985-488e-a911-45bf3431c165", "id": 13}] 2026-02-24T19:17:11.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.290+0000 7fe8166ae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.293 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.290+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd new", "uuid": "d4e5150e-a985-488e-a911-45bf3431c165", "id": 13} v 0) -- 0x7fe81017b790 con 0x7fe81011ffc0 2026-02-24T19:17:11.345 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.343+0000 7fe80cff9640 1 -- 10.20.193.194:0/39779666 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4e5150e-a985-488e-a911-45bf3431c165", "id": 13}]=0 v16) ==== 113+0+3 (unknown 275218652 0 736921282) 0x7fe80405ccc0 con 0x7fe81011ffc0 2026-02-24T19:17:11.345 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.343+0000 7fe80cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d4e5150e-a985-488e-a911-45bf3431c165", "id": 13}] 2026-02-24T19:17:11.345 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.343+0000 7fe80cff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:11.345 INFO:teuthology.orchestra.run.trial194.stdout:13 2026-02-24T19:17:11.347 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.343+0000 7fe8166ae640 10 librados: watch_flush enter 2026-02-24T19:17:11.347 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.343+0000 7fe8166ae640 10 librados: watch_flush exit 2026-02-24T19:17:11.347 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.343+0000 7fe8166ae640 20 client.4202.objecter shutdown clearing up homeless session... 2026-02-24T19:17:11.347 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.343+0000 7fe8166ae640 10 client.4202.objecter successfully canceled tick 2026-02-24T19:17:11.347 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.343+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 >> v1:10.20.193.45:6800/1599977652 conn(0x7fe7e0077d90 legacy=0x7fe7e0098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.347 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.343+0000 7fe8166ae640 10 monclient: shutdown 2026-02-24T19:17:11.347 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.344+0000 7fe8166ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:11.347 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.344+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 >> v1:10.20.193.179:6789/0 conn(0x7fe81011ffc0 legacy=0x7fe810178000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.348 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.344+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 shutdown_connections 2026-02-24T19:17:11.348 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.344+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 >> 10.20.193.194:0/39779666 conn(0x7fe8100588d0 msgr2=0x7fe810058ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:11.348 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.344+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 shutdown_connections 2026-02-24T19:17:11.348 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.344+0000 7fe8166ae640 1 -- 10.20.193.194:0/39779666 wait complete. 2026-02-24T19:17:11.348 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.344+0000 7fe8166ae640 1 librados: shutdown 2026-02-24T19:17:11.356 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new 0d938446-8802-44bc-be90-db79361a5200 14 2026-02-24T19:17:11.421 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.417+0000 7feb6cfd7640 10 monclient: get_monmap_and_config 2026-02-24T19:17:11.421 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.417+0000 7feb6cfd7640 10 monclient: build_initial_monmap 2026-02-24T19:17:11.421 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.417+0000 7feb6cfd7640 10 monclient: monmap: 2026-02-24T19:17:11.421 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:11.421 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:11.419113+0000 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:11.419113+0000 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 1 Processor -- start 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 1 -- start start 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 10 monclient: init 2026-02-24T19:17:11.422 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 10 monclient(hunting): picked mon.noname-a con 0x7feb6811fa30 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 10 monclient(hunting): picked mon.noname-b con 0x7feb68142940 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 10 monclient(hunting): picked mon.noname-c con 0x7feb681644a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb68186250 con 0x7feb6811fa30 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb68187450 con 0x7feb68142940 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb68188650 con 0x7feb681644a0 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb6cfd7640 10 monclient(hunting): authenticate will time out at 3605.075323s 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb66575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7feb6811fa30 0x7feb6811fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.194:34402/0 (socket says 10.20.193.194:34402) 2026-02-24T19:17:11.423 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.418+0000 7feb66575640 1 -- 10.20.193.194:0/1000958196 learned_addr learned my addr 10.20.193.194:0/1000958196 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:11.430 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.419+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848817141 0 0) 0x7feb68187450 con 0x7feb68142940 2026-02-24T19:17:11.430 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.419+0000 7feb65573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.430 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.419+0000 7feb65573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.430 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.419+0000 7feb65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.430 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.419+0000 7feb65573640 10 monclient(hunting): my global_id is 4195 2026-02-24T19:17:11.430 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.419+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb54003610 con 0x7feb68142940 2026-02-24T19:17:11.430 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1238517491 0 0) 0x7feb68188650 con 0x7feb681644a0 2026-02-24T19:17:11.430 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 10 monclient(hunting): my global_id is 4205 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb68187450 con 0x7feb681644a0 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520136418 0 0) 0x7feb68186250 con 0x7feb6811fa30 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 10 monclient(hunting): my global_id is 4206 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.420+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb68188650 con 0x7feb6811fa30 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2888024560 0 0) 0x7feb54003610 con 0x7feb68142940 2026-02-24T19:17:11.431 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 >> v1:10.20.193.179:6789/0 conn(0x7feb681644a0 legacy=0x7feb68184950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 >> v1:10.20.193.45:6789/0 conn(0x7feb6811fa30 legacy=0x7feb6811fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 1 monclient: found mon.noname-b 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb681898f0 con 0x7feb68142940 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 10 monclient: _finish_auth 0 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7feb50002df0 con 0x7feb68142940 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:11.432 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb65573640 10 monclient: dump: 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb6cfd7640 5 monclient: authenticate success, global_id 4195 2026-02-24T19:17:11.433 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.421+0000 7feb6cfd7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb50003030 con 0x7feb68142940 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb65573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb65573640 1 -- 10.20.193.194:0/1000958196 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7feb50003470 con 0x7feb68142940 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb65573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb65573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb65573640 10 monclient: dump: 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.434 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb6cfd7640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb6cfd7640 4 set_mon_vals no callback set 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb6cfd7640 10 monclient: shutdown 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb6cfd7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb6cfd7640 1 -- 10.20.193.194:0/1000958196 >> v1:10.20.193.114:6789/0 conn(0x7feb68142940 legacy=0x7feb68162d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb6cfd7640 1 -- 10.20.193.194:0/1000958196 shutdown_connections 2026-02-24T19:17:11.435 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb6cfd7640 1 -- 10.20.193.194:0/1000958196 >> 10.20.193.194:0/1000958196 conn(0x7feb68058810 msgr2=0x7feb68058c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb6cfd7640 1 -- 10.20.193.194:0/1000958196 shutdown_connections 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.422+0000 7feb6cfd7640 1 -- 10.20.193.194:0/1000958196 wait complete. 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient: build_initial_monmap 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient: monmap: 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:11.436 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 1 librados: starting msgr at 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 1 librados: starting objecter 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 1 Processor -- start 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 1 -- start start 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 1 librados: setting wanted keys 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 1 librados: calling monclient init 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient: init 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient(hunting): picked mon.noname-a con 0x7feb6811fa30 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:11.437 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient(hunting): picked mon.noname-c con 0x7feb68142940 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient(hunting): picked mon.noname-b con 0x7feb681644a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb68127b70 con 0x7feb6811fa30 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb6812f9c0 con 0x7feb681644a0 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb68130bc0 con 0x7feb68142940 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb6cfd7640 10 monclient(hunting): authenticate will time out at 3605.080350s 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb66d76640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7feb681644a0 0x7feb68163d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:39516/0 (socket says 10.20.193.194:39516) 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb66d76640 1 -- 10.20.193.194:0/3513897433 learned_addr learned my addr 10.20.193.194:0/3513897433 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb4effd640 10 client.?.objecter ms_handle_connect 0x7feb681644a0 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb4effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb4effd640 10 client.?.objecter ms_handle_connect 0x7feb6811fa30 2026-02-24T19:17:11.438 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.423+0000 7feb4effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 client.?.objecter ms_handle_connect 0x7feb68142940 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282943498 0 0) 0x7feb6812f9c0 con 0x7feb681644a0 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 monclient(hunting): my global_id is 4198 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb34003610 con 0x7feb681644a0 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972043205 0 0) 0x7feb68127b70 con 0x7feb6811fa30 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.439 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 10 monclient(hunting): my global_id is 4209 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.424+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb6812f9c0 con 0x7feb6811fa30 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.425+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064468307 0 0) 0x7feb68130bc0 con 0x7feb68142940 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.425+0000 7feb4effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.425+0000 7feb4effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.425+0000 7feb4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.425+0000 7feb4effd640 10 monclient(hunting): my global_id is 4208 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.425+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb68127b70 con 0x7feb68142940 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2194342342 0 0) 0x7feb6812f9c0 con 0x7feb6811fa30 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb68130bc0 con 0x7feb6811fa30 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7feb5c003060 con 0x7feb6811fa30 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:11.440 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): dump: 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:11.441 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3710846100 0 0) 0x7feb34003610 con 0x7feb681644a0 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb6812f9c0 con 0x7feb681644a0 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7feb58003490 con 0x7feb681644a0 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): dump: 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.442 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2545316598 0 0) 0x7feb68127b70 con 0x7feb68142940 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb34003610 con 0x7feb68142940 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7feb50003380 con 0x7feb68142940 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.427+0000 7feb4effd640 10 monclient(hunting): dump: 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.443 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.444 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.444 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.444 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.444 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.444 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.447 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2068404832 0 0) 0x7feb6812f9c0 con 0x7feb681644a0 2026-02-24T19:17:11.447 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 >> v1:10.20.193.179:6789/0 conn(0x7feb68142940 legacy=0x7feb68127160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.447 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 >> v1:10.20.193.45:6789/0 conn(0x7feb6811fa30 legacy=0x7feb68184950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.447 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:11.447 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 1 monclient: found mon.b 2026-02-24T19:17:11.447 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:11.447 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:11.447 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb68131e60 con 0x7feb681644a0 2026-02-24T19:17:11.447 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 10 monclient: _finish_auth 0 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb6cfd7640 5 monclient: authenticate success, global_id 4198 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb6cfd7640 10 monclient: _renew_subs 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb6cfd7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb6812e9f0 con 0x7feb681644a0 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb6cfd7640 10 client.4198.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb6cfd7640 10 monclient: _renew_subs 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb6cfd7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feb6812efe0 con 0x7feb681644a0 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.428+0000 7feb6cfd7640 1 librados: init done 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.429+0000 7feb6cfd7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.429+0000 7feb6cfd7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:11.448 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.429+0000 7feb6cfd7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.429+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb68186920 con 0x7feb681644a0 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.435+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb58003a80 con 0x7feb681644a0 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.435+0000 7feb4effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.435+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7feb58003e50 con 0x7feb681644a0 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.435+0000 7feb4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.435+0000 7feb4effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.435+0000 7feb4effd640 10 monclient: dump: 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.449 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.435+0000 7feb64d72640 4 set_mon_vals no callback set 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.436+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7feb58003e50 con 0x7feb681644a0 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.436+0000 7feb66575640 10 monclient: get_auth_request con 0x7feb34077e10 auth_method 0 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.437+0000 7feb4effd640 10 client.4198.objecter ms_handle_connect 0x7feb34077e10 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.437+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(16..16 src has 1..16) ==== 2330+0+0 (unknown 4258877177 0 0) 0x7feb580597b0 con 0x7feb681644a0 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.437+0000 7feb4effd640 10 client.4198.objecter ms_dispatch2 0x7feb68000b90 osd_map(16..16 src has 1..16) 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.437+0000 7feb4effd640 3 client.4198.objecter handle_osd_map got epochs [16,16] > 0 2026-02-24T19:17:11.450 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.437+0000 7feb4effd640 3 client.4198.objecter handle_osd_map decoding full epoch 16 2026-02-24T19:17:11.451 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.437+0000 7feb4effd640 20 client.4198.objecter dump_active .. 0 homeless 2026-02-24T19:17:11.524 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.522+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7feb5805df20 con 0x7feb681644a0 2026-02-24T19:17:11.524 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.522+0000 7feb4effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:11.524 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.522+0000 7feb4effd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:11.635 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.633+0000 7feb6cfd7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0d938446-8802-44bc-be90-db79361a5200", "id": 14}] 2026-02-24T19:17:11.636 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.633+0000 7feb6cfd7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0d938446-8802-44bc-be90-db79361a5200", "id": 14}] 2026-02-24T19:17:11.636 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.633+0000 7feb6cfd7640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:11.636 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.633+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd new", "uuid": "0d938446-8802-44bc-be90-db79361a5200", "id": 14} v 0) -- 0x7feb6812f2d0 con 0x7feb681644a0 2026-02-24T19:17:11.683 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.681+0000 7feb4effd640 1 -- 10.20.193.194:0/3513897433 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d938446-8802-44bc-be90-db79361a5200", "id": 14}]=0 v17) ==== 113+0+3 (unknown 3762062692 0 1367428999) 0x7feb5805d820 con 0x7feb681644a0 2026-02-24T19:17:11.683 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.681+0000 7feb4effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0d938446-8802-44bc-be90-db79361a5200", "id": 14}] 2026-02-24T19:17:11.683 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.681+0000 7feb4effd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:11.684 INFO:teuthology.orchestra.run.trial194.stdout:14 2026-02-24T19:17:11.685 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 10 librados: watch_flush enter 2026-02-24T19:17:11.685 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 10 librados: watch_flush exit 2026-02-24T19:17:11.685 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 20 client.4198.objecter shutdown clearing up homeless session... 2026-02-24T19:17:11.685 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 10 client.4198.objecter successfully canceled tick 2026-02-24T19:17:11.685 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 >> v1:10.20.193.45:6800/1599977652 conn(0x7feb34077e10 legacy=0x7feb340982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.685 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 10 monclient: shutdown 2026-02-24T19:17:11.686 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:11.686 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 >> v1:10.20.193.114:6789/0 conn(0x7feb681644a0 legacy=0x7feb68163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.686 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 shutdown_connections 2026-02-24T19:17:11.686 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 >> 10.20.193.194:0/3513897433 conn(0x7feb68058810 msgr2=0x7feb68185100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:11.686 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 shutdown_connections 2026-02-24T19:17:11.686 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 1 -- 10.20.193.194:0/3513897433 wait complete. 2026-02-24T19:17:11.686 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.682+0000 7feb6cfd7640 1 librados: shutdown 2026-02-24T19:17:11.694 DEBUG:teuthology.orchestra.run.trial194:> sudo ceph --cluster ceph osd new 168bd4e0-e43c-4581-819c-9ed544805d2f 15 2026-02-24T19:17:11.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient: get_monmap_and_config 2026-02-24T19:17:11.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient: build_initial_monmap 2026-02-24T19:17:11.760 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient: monmap: 2026-02-24T19:17:11.760 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:17:11.758389+0000 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:17:11.758389+0000 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 1 Processor -- start 2026-02-24T19:17:11.761 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 1 -- start start 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient: init 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient(hunting): picked mon.noname-c con 0x7f212c11e790 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient(hunting): picked mon.noname-a con 0x7f212c1406c0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient(hunting): picked mon.noname-b con 0x7f212c162250 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212c183fe0 con 0x7f212c1406c0 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212c1851e0 con 0x7f212c162250 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212c1863e0 con 0x7f212c11e790 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.757+0000 7f213212e640 10 monclient(hunting): authenticate will time out at 3605.414573s 2026-02-24T19:17:11.762 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.758+0000 7f212b7fe640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f212c11e790 0x7f212c11eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.194:58092/0 (socket says 10.20.193.194:58092) 2026-02-24T19:17:11.763 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.758+0000 7f212b7fe640 1 -- 10.20.193.194:0/1204860414 learned_addr learned my addr 10.20.193.194:0/1204860414 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:11.767 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213009472 0 0) 0x7f212c1863e0 con 0x7f212c11e790 2026-02-24T19:17:11.767 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.767 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 10 monclient(hunting): my global_id is 4211 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2110003610 con 0x7f212c11e790 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093874098 0 0) 0x7f212c1851e0 con 0x7f212c162250 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 10 monclient(hunting): my global_id is 4201 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.759+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f212c1863e0 con 0x7f212c162250 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 494224050 0 0) 0x7f2110003610 con 0x7f212c11e790 2026-02-24T19:17:11.768 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 >> v1:10.20.193.114:6789/0 conn(0x7f212c162250 legacy=0x7f212c1826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 >> v1:10.20.193.45:6789/0 conn(0x7f212c1406c0 legacy=0x7f212c160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 1 monclient: found mon.noname-c 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212c187680 con 0x7f212c11e790 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2118002df0 con 0x7f212c11e790 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:11.769 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f212a7fc640 10 monclient: dump: 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f213212e640 5 monclient: authenticate success, global_id 4211 2026-02-24T19:17:11.770 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.761+0000 7f213212e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2118003070 con 0x7f212c11e790 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f212a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f212a7fc640 1 -- 10.20.193.194:0/1204860414 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f21180034b0 con 0x7f212c11e790 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f212a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f212a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f212a7fc640 10 monclient: dump: 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.771 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 4 set_mon_vals no callback set 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient: shutdown 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 -- 10.20.193.194:0/1204860414 >> v1:10.20.193.179:6789/0 conn(0x7f212c11e790 legacy=0x7f212c11eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 -- 10.20.193.194:0/1204860414 shutdown_connections 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 -- 10.20.193.194:0/1204860414 >> 10.20.193.194:0/1204860414 conn(0x7f212c0588d0 msgr2=0x7f212c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 -- 10.20.193.194:0/1204860414 shutdown_connections 2026-02-24T19:17:11.772 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 -- 10.20.193.194:0/1204860414 wait complete. 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient: build_initial_monmap 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient: monmap: 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:epoch 0 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 0.000000 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:created 0.000000 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 1 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:11.773 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 librados: starting msgr at 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 librados: starting objecter 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 Processor -- start 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 -- start start 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 librados: setting wanted keys 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 librados: calling monclient init 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient: init 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient(hunting): picked mon.noname-c con 0x7f212c11e790 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient(hunting): picked mon.noname-a con 0x7f212c1406c0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:11.774 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient(hunting): picked mon.noname-b con 0x7f212c162250 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212c12e650 con 0x7f212c1406c0 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212c12f830 con 0x7f212c162250 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212c130a30 con 0x7f212c11e790 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.762+0000 7f213212e640 10 monclient(hunting): authenticate will time out at 3605.419975s 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.763+0000 7f212b7fe640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f212c11e790 0x7f212c1826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.194:58100/0 (socket says 10.20.193.194:58100) 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.763+0000 7f212b7fe640 1 -- 10.20.193.194:0/1689810206 learned_addr learned my addr 10.20.193.194:0/1689810206 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.763+0000 7f212bfff640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f212c162250 0x7f212c12cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.194:39528/0 (socket says 10.20.193.194:39528) 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.763+0000 7f2107fff640 10 client.?.objecter ms_handle_connect 0x7f212c11e790 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.763+0000 7f2107fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.763+0000 7f2107fff640 10 client.?.objecter ms_handle_connect 0x7f212c162250 2026-02-24T19:17:11.775 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.763+0000 7f2107fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343127945 0 0) 0x7f212c130a30 con 0x7f212c11e790 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 10 monclient(hunting): my global_id is 4214 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20fc003610 con 0x7f212c11e790 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573244922 0 0) 0x7f212c12f830 con 0x7f212c162250 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 10 monclient(hunting): my global_id is 4204 2026-02-24T19:17:11.776 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.764+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f212c130a30 con 0x7f212c162250 2026-02-24T19:17:11.780 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.766+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2682744279 0 0) 0x7f20fc003610 con 0x7f212c11e790 2026-02-24T19:17:11.780 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.766+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f212c12f830 con 0x7f212c11e790 2026-02-24T19:17:11.780 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.766+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2118002d00 con 0x7f212c11e790 2026-02-24T19:17:11.780 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.766+0000 7f2107fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:11.780 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.766+0000 7f2107fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.766+0000 7f2107fff640 10 monclient(hunting): dump: 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.781 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.766+0000 7f2107fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.767+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 982525936 0 0) 0x7f212c130a30 con 0x7f212c162250 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.767+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20fc003610 con 0x7f212c162250 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.767+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2120003430 con 0x7f212c162250 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.767+0000 7f2107fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.767+0000 7f2107fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.767+0000 7f2107fff640 10 monclient(hunting): dump: 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.782 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1049435659 0 0) 0x7f212c12f830 con 0x7f212c11e790 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 >> v1:10.20.193.114:6789/0 conn(0x7f212c162250 legacy=0x7f212c12cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 >> v1:10.20.193.45:6789/0 conn(0x7f212c1406c0 legacy=0x7f212c160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 1 monclient: found mon.c 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.783 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212c131cd0 con 0x7f212c11e790 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f2107fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 5 monclient: authenticate success, global_id 4214 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 10 monclient: _renew_subs 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f212c12fa60 con 0x7f212c11e790 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 10 client.4214.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 10 monclient: _renew_subs 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f212c130000 con 0x7f212c11e790 2026-02-24T19:17:11.784 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 1 librados: init done 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.768+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f212c185770 con 0x7f212c11e790 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.775+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2118002ff0 con 0x7f212c11e790 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.775+0000 7f2107fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.775+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2118004e80 con 0x7f212c11e790 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.775+0000 7f2107fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.775+0000 7f2107fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.775+0000 7f2129ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.775+0000 7f2107fff640 10 monclient: dump: 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:epoch 1 2026-02-24T19:17:11.785 INFO:teuthology.orchestra.run.trial194.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:election_strategy: 3 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.776+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7f211801dcb0 con 0x7f212c11e790 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.777+0000 7f212affd640 10 monclient: get_auth_request con 0x7f20fc077ba0 auth_method 0 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.777+0000 7f2107fff640 10 client.4214.objecter ms_handle_connect 0x7f20fc077ba0 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.777+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 2445+0+0 (unknown 3011211298 0 0) 0x7f2118059640 con 0x7f212c11e790 2026-02-24T19:17:11.786 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.777+0000 7f2107fff640 10 client.4214.objecter ms_dispatch2 0x7f212c000b90 osd_map(17..17 src has 1..17) 2026-02-24T19:17:11.787 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.777+0000 7f2107fff640 3 client.4214.objecter handle_osd_map got epochs [17,17] > 0 2026-02-24T19:17:11.787 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.777+0000 7f2107fff640 3 client.4214.objecter handle_osd_map decoding full epoch 17 2026-02-24T19:17:11.787 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.777+0000 7f2107fff640 20 client.4214.objecter dump_active .. 0 homeless 2026-02-24T19:17:11.869 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.867+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f211805ddb0 con 0x7f212c11e790 2026-02-24T19:17:11.869 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.867+0000 7f2107fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:11.869 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.867+0000 7f2107fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:11.982 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.979+0000 7f213212e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "168bd4e0-e43c-4581-819c-9ed544805d2f", "id": 15}] 2026-02-24T19:17:11.982 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.979+0000 7f213212e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "168bd4e0-e43c-4581-819c-9ed544805d2f", "id": 15}] 2026-02-24T19:17:11.982 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.979+0000 7f213212e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:11.982 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:11.979+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd new", "uuid": "168bd4e0-e43c-4581-819c-9ed544805d2f", "id": 15} v 0) -- 0x7f212c130340 con 0x7f212c11e790 2026-02-24T19:17:12.048 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.046+0000 7f2107fff640 1 -- 10.20.193.194:0/1689810206 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "168bd4e0-e43c-4581-819c-9ed544805d2f", "id": 15}]=0 v18) ==== 113+0+3 (unknown 4053612678 0 1109645296) 0x7f211805d6b0 con 0x7f212c11e790 2026-02-24T19:17:12.048 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.046+0000 7f2107fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "168bd4e0-e43c-4581-819c-9ed544805d2f", "id": 15}] 2026-02-24T19:17:12.048 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.046+0000 7f2107fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:12.048 INFO:teuthology.orchestra.run.trial194.stdout:15 2026-02-24T19:17:12.050 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.046+0000 7f213212e640 10 librados: watch_flush enter 2026-02-24T19:17:12.050 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.046+0000 7f213212e640 10 librados: watch_flush exit 2026-02-24T19:17:12.050 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.046+0000 7f213212e640 20 client.4214.objecter shutdown clearing up homeless session... 2026-02-24T19:17:12.050 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.046+0000 7f213212e640 10 client.4214.objecter successfully canceled tick 2026-02-24T19:17:12.050 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.047+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 >> v1:10.20.193.45:6800/1599977652 conn(0x7f20fc077ba0 legacy=0x7f20fc098050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:12.050 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.047+0000 7f213212e640 10 monclient: shutdown 2026-02-24T19:17:12.051 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.047+0000 7f213212e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:12.051 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.047+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 >> v1:10.20.193.179:6789/0 conn(0x7f212c11e790 legacy=0x7f212c1826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:12.051 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.047+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 shutdown_connections 2026-02-24T19:17:12.051 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.047+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 >> 10.20.193.194:0/1689810206 conn(0x7f212c0588d0 msgr2=0x7f212c05c300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:12.051 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.047+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 shutdown_connections 2026-02-24T19:17:12.051 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.047+0000 7f213212e640 1 -- 10.20.193.194:0/1689810206 wait complete. 2026-02-24T19:17:12.051 INFO:teuthology.orchestra.run.trial194.stderr:2026-02-24T19:17:12.047+0000 7f213212e640 1 librados: shutdown 2026-02-24T19:17:12.059 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.059 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-24T19:17:12.060 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-24T19:17:12.062 INFO:tasks.ceph.osd.0:Started 2026-02-24T19:17:12.062 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.062 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-24T19:17:12.063 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-24T19:17:12.065 INFO:tasks.ceph.osd.4:Started 2026-02-24T19:17:12.065 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.065 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-24T19:17:12.065 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-24T19:17:12.068 INFO:tasks.ceph.osd.8:Started 2026-02-24T19:17:12.068 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.068 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-24T19:17:12.068 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-24T19:17:12.071 INFO:tasks.ceph.osd.12:Started 2026-02-24T19:17:12.071 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.071 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-24T19:17:12.071 DEBUG:teuthology.orchestra.run.trial114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-24T19:17:12.073 INFO:tasks.ceph.osd.1:Started 2026-02-24T19:17:12.074 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.074 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-24T19:17:12.074 DEBUG:teuthology.orchestra.run.trial114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-24T19:17:12.076 INFO:tasks.ceph.osd.5:Started 2026-02-24T19:17:12.076 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.077 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-24T19:17:12.077 DEBUG:teuthology.orchestra.run.trial114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-24T19:17:12.079 INFO:tasks.ceph.osd.9:Started 2026-02-24T19:17:12.079 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.080 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-24T19:17:12.080 DEBUG:teuthology.orchestra.run.trial114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-24T19:17:12.082 INFO:tasks.ceph.osd.13:Started 2026-02-24T19:17:12.082 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.082 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-24T19:17:12.082 DEBUG:teuthology.orchestra.run.trial179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-24T19:17:12.085 INFO:tasks.ceph.osd.2:Started 2026-02-24T19:17:12.085 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.085 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-24T19:17:12.085 DEBUG:teuthology.orchestra.run.trial179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-24T19:17:12.087 INFO:tasks.ceph.osd.6:Started 2026-02-24T19:17:12.088 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.088 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-24T19:17:12.088 DEBUG:teuthology.orchestra.run.trial179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-24T19:17:12.090 INFO:tasks.ceph.osd.10:Started 2026-02-24T19:17:12.090 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.090 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-24T19:17:12.091 DEBUG:teuthology.orchestra.run.trial179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-24T19:17:12.093 INFO:tasks.ceph.osd.14:Started 2026-02-24T19:17:12.093 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.093 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-24T19:17:12.094 DEBUG:teuthology.orchestra.run.trial194:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-24T19:17:12.096 INFO:tasks.ceph.osd.3:Started 2026-02-24T19:17:12.096 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.096 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-24T19:17:12.096 DEBUG:teuthology.orchestra.run.trial194:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-24T19:17:12.099 INFO:tasks.ceph.osd.7:Started 2026-02-24T19:17:12.099 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.099 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-24T19:17:12.099 DEBUG:teuthology.orchestra.run.trial194:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-24T19:17:12.101 INFO:tasks.ceph.osd.11:Started 2026-02-24T19:17:12.101 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:12.102 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-24T19:17:12.102 DEBUG:teuthology.orchestra.run.trial194:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-24T19:17:12.104 INFO:tasks.ceph.osd.15:Started 2026-02-24T19:17:12.104 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:12.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.176+0000 7fc4773b3640 10 monclient: get_monmap_and_config 2026-02-24T19:17:12.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.176+0000 7fc4773b3640 10 monclient: build_initial_monmap 2026-02-24T19:17:12.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.176+0000 7fc4773b3640 10 monclient: monmap: 2026-02-24T19:17:12.178 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:12.179 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:12.179 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:12.176635+0000 2026-02-24T19:17:12.179 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:12.176635+0000 2026-02-24T19:17:12.179 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:12.179 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:12.179 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:12.179 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:12.179 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:12.179 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 1 Processor -- start 2026-02-24T19:17:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 1 -- start start 2026-02-24T19:17:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 10 monclient: init 2026-02-24T19:17:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 10 monclient(hunting): picked mon.noname-b con 0x7fc470055bf0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 10 monclient(hunting): picked mon.noname-c con 0x7fc470164040 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 10 monclient(hunting): picked mon.noname-a con 0x7fc470055fc0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:12.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4700b3a00 con 0x7fc470055fc0 2026-02-24T19:17:12.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4700b3c70 con 0x7fc470055bf0 2026-02-24T19:17:12.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4700b3f50 con 0x7fc470164040 2026-02-24T19:17:12.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:12.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.177+0000 7fc4773b3640 10 monclient(hunting): authenticate will time out at 3603.815665s 2026-02-24T19:17:12.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.178+0000 7fc475929640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc470055fc0 0x7fc4700b5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:50980/0 (socket says 10.20.193.45:50980) 2026-02-24T19:17:12.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.178+0000 7fc475929640 1 -- 10.20.193.45:0/3663269813 learned_addr learned my addr 10.20.193.45:0/3663269813 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863376716 0 0) 0x7fc4700b3c70 con 0x7fc470055bf0 2026-02-24T19:17:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): my global_id is 4207 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc458003610 con 0x7fc470055bf0 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314222453 0 0) 0x7fc4700b3a00 con 0x7fc470055fc0 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): my global_id is 4212 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4700b3c70 con 0x7fc470055fc0 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201214514 0 0) 0x7fc4700b3f50 con 0x7fc470164040 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 10 monclient(hunting): my global_id is 4217 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.179+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4700b3a00 con 0x7fc470164040 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1274164807 0 0) 0x7fc458003610 con 0x7fc470055bf0 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 >> v1:10.20.193.179:6789/0 conn(0x7fc470164040 legacy=0x7fc470056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 >> v1:10.20.193.45:6789/0 conn(0x7fc470055fc0 legacy=0x7fc4700b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 1 monclient: found mon.noname-b 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4700b4230 con 0x7fc470055bf0 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: _finish_auth 0 2026-02-24T19:17:12.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc460002df0 con 0x7fc470055bf0 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc4773b3640 5 monclient: authenticate success, global_id 4207 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc4773b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: dump: 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:12.189 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc4773b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc460002fc0 con 0x7fc470055bf0 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 1 -- 10.20.193.45:0/3663269813 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc460003400 con 0x7fc470055bf0 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc45ffff640 10 monclient: dump: 2026-02-24T19:17:12.190 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc4773b3640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.182+0000 7fc4773b3640 4 set_mon_vals no callback set 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 10 monclient: shutdown 2026-02-24T19:17:12.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 -- 10.20.193.45:0/3663269813 >> v1:10.20.193.114:6789/0 conn(0x7fc470055bf0 legacy=0x7fc4700b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 -- 10.20.193.45:0/3663269813 shutdown_connections 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 -- 10.20.193.45:0/3663269813 >> 10.20.193.45:0/3663269813 conn(0x7fc4700b7bb0 msgr2=0x7fc4700b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 -- 10.20.193.45:0/3663269813 shutdown_connections 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 -- 10.20.193.45:0/3663269813 wait complete. 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 10 monclient: build_initial_monmap 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 10 monclient: monmap: 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:12.192 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 librados: starting msgr at 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 librados: starting objecter 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 Processor -- start 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 -- start start 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 librados: setting wanted keys 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 1 librados: calling monclient init 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.183+0000 7fc4773b3640 10 monclient: init 2026-02-24T19:17:12.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 10 monclient(hunting): picked mon.noname-a con 0x7fc470055bf0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 10 monclient(hunting): picked mon.noname-b con 0x7fc470055fc0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 10 monclient(hunting): picked mon.noname-c con 0x7fc470164040 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47015ddb0 con 0x7fc470055bf0 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47015e090 con 0x7fc470055fc0 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47015e370 con 0x7fc470164040 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc4773b3640 10 monclient(hunting): authenticate will time out at 3603.822389s 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc475128640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc470055bf0 0x7fc4700ba0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:50990/0 (socket says 10.20.193.45:50990) 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc475128640 1 -- 10.20.193.45:0/2795086360 learned_addr learned my addr 10.20.193.45:0/2795086360 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc45dffb640 10 client.?.objecter ms_handle_connect 0x7fc470055fc0 2026-02-24T19:17:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc45dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc45dffb640 10 client.?.objecter ms_handle_connect 0x7fc470055bf0 2026-02-24T19:17:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.184+0000 7fc45dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.185+0000 7fc45dffb640 10 client.?.objecter ms_handle_connect 0x7fc470164040 2026-02-24T19:17:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.185+0000 7fc45dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.185+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837271796 0 0) 0x7fc47015e090 con 0x7fc470055fc0 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.185+0000 7fc45dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.185+0000 7fc45dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.185+0000 7fc45dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.185+0000 7fc45dffb640 10 monclient(hunting): my global_id is 4210 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.185+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc440003610 con 0x7fc470055fc0 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059664254 0 0) 0x7fc47015ddb0 con 0x7fc470055bf0 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 10 monclient(hunting): my global_id is 4215 2026-02-24T19:17:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc47015e090 con 0x7fc470055bf0 2026-02-24T19:17:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398455864 0 0) 0x7fc47015e370 con 0x7fc470164040 2026-02-24T19:17:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 10 monclient(hunting): my global_id is 4220 2026-02-24T19:17:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.186+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc47015ddb0 con 0x7fc470164040 2026-02-24T19:17:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1904182905 0 0) 0x7fc47015e090 con 0x7fc470055bf0 2026-02-24T19:17:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc47015e370 con 0x7fc470055bf0 2026-02-24T19:17:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc460003310 con 0x7fc470055bf0 2026-02-24T19:17:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 10 monclient(hunting): dump: 2026-02-24T19:17:12.201 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:12.201 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:12.201 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.201 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.201 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:12.201 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:12.202 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:12.202 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:12.202 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2596862220 0 0) 0x7fc440003610 con 0x7fc470055fc0 2026-02-24T19:17:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc47015e090 con 0x7fc470055fc0 2026-02-24T19:17:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc464002fb0 con 0x7fc470055fc0 2026-02-24T19:17:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.188+0000 7fc45dffb640 10 monclient(hunting): dump: 2026-02-24T19:17:12.203 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:12.203 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:12.203 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.203 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.203 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:12.203 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.189+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1832938393 0 0) 0x7fc47015ddb0 con 0x7fc470164040 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.189+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc440003610 con 0x7fc470164040 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.189+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc46c003430 con 0x7fc470164040 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.189+0000 7fc45dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.189+0000 7fc45dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.189+0000 7fc45dffb640 10 monclient(hunting): dump: 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1955424473 0 0) 0x7fc47015e370 con 0x7fc470055bf0 2026-02-24T19:17:12.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 >> v1:10.20.193.179:6789/0 conn(0x7fc470164040 legacy=0x7fc47013b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 >> v1:10.20.193.114:6789/0 conn(0x7fc470055fc0 legacy=0x7fc470160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 1 monclient: found mon.a 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47015e650 con 0x7fc470055bf0 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc45dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc4773b3640 5 monclient: authenticate success, global_id 4215 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc4773b3640 10 monclient: _renew_subs 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc4773b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc47013b7c0 con 0x7fc470055bf0 2026-02-24T19:17:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc4773b3640 10 client.4215.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc4773b3640 10 monclient: _renew_subs 2026-02-24T19:17:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc4773b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc470154f10 con 0x7fc470055bf0 2026-02-24T19:17:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.190+0000 7fc4773b3640 1 librados: init done 2026-02-24T19:17:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.191+0000 7fc4773b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.191+0000 7fc4773b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.191+0000 7fc4773b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.191+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc470055260 con 0x7fc470055bf0 2026-02-24T19:17:12.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.296+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc460002fc0 con 0x7fc470055bf0 2026-02-24T19:17:12.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.296+0000 7fc45dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:12.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.296+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc460003b00 con 0x7fc470055bf0 2026-02-24T19:17:12.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.296+0000 7fc45dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:12.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.296+0000 7fc45dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:12.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.296+0000 7fc45dffb640 10 monclient: dump: 2026-02-24T19:17:12.438 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:12.438 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:12.438 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.438 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:12.438 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:12.438 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:12.439 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:12.439 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:12.439 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:12.439 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:12.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.296+0000 7fc45f7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:12.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.297+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7fc460003ce0 con 0x7fc470055bf0 2026-02-24T19:17:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.298+0000 7fc474927640 10 monclient: get_auth_request con 0x7fc440077e40 auth_method 0 2026-02-24T19:17:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.298+0000 7fc45dffb640 10 client.4215.objecter ms_handle_connect 0x7fc440077e40 2026-02-24T19:17:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.328+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 1454299169 0 0) 0x7fc4600593a0 con 0x7fc470055bf0 2026-02-24T19:17:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.328+0000 7fc45dffb640 10 client.4215.objecter ms_dispatch2 0x7fc470000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:17:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.328+0000 7fc45dffb640 3 client.4215.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:17:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.328+0000 7fc45dffb640 3 client.4215.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:17:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.328+0000 7fc45dffb640 20 client.4215.objecter dump_active .. 0 homeless 2026-02-24T19:17:12.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.328+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc470055260 con 0x7fc470055bf0 2026-02-24T19:17:12.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.329+0000 7fc45dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:12.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.329+0000 7fc45dffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:12.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.434+0000 7fc4773b3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:12.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.434+0000 7fc4773b3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:12.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.434+0000 7fc4773b3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:12.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.434+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc470052ee0 con 0x7fc470055bf0 2026-02-24T19:17:12.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.453+0000 7fc45dffb640 1 -- 10.20.193.45:0/2795086360 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3053866050) 0x7fc46005db10 con 0x7fc470055bf0 2026-02-24T19:17:12.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.453+0000 7fc45dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:12.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.453+0000 7fc45dffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:12.456 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:17:12.456 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":18,"fsid":"738dd6f3-d81f-41eb-89dc-068883b21f11","created":"2026-02-24T19:17:05.025851+0000","modified":"2026-02-24T19:17:11.992117+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:17:11.992117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"53650ce1-deec-4943-ba8b-cdf389f4e5e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e3d2506e-9e10-4206-96d1-3dd8aa4d91cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2fe7f095-bf74-4e4a-996c-c58438826e11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"270148b3-6c77-4c1f-9d73-05d1c75990c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43b91f27-e730-4a81-a86b-b2fefdddd3e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"01c901c8-775a-4e42-b73a-5db3d938dbb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b29d58d3-b5f9-428c-8246-910655dd5490","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f182ac9b-e6ee-461e-af0c-0ef4ef51c737","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"b812d673-950b-4168-9a5e-d3719d569a7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"442018bc-d405-49b3-8934-0ab83b4613eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e5bf8aa9-8c19-494b-bd7a-c5da71af847b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"6cb63f95-82e0-483f-926b-94a88b3c54f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"b15b2174-466b-4e9a-9c6d-ed8caabe7b28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"d4e5150e-a985-488e-a911-45bf3431c165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0d938446-8802-44bc-be90-db79361a5200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"168bd4e0-e43c-4581-819c-9ed544805d2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 10 librados: watch_flush enter 2026-02-24T19:17:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 10 librados: watch_flush exit 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 20 client.4215.objecter shutdown clearing up homeless session... 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 10 client.4215.objecter successfully canceled tick 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 >> v1:10.20.193.45:6800/1599977652 conn(0x7fc440077e40 legacy=0x7fc4400982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 10 monclient: shutdown 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 >> v1:10.20.193.45:6789/0 conn(0x7fc470055bf0 legacy=0x7fc4700ba0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 shutdown_connections 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 >> 10.20.193.45:0/2795086360 conn(0x7fc4700b7bb0 msgr2=0x7fc470153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 shutdown_connections 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 1 -- 10.20.193.45:0/2795086360 wait complete. 2026-02-24T19:17:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:12.456+0000 7fc4773b3640 1 librados: shutdown 2026-02-24T19:17:12.467 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-24T19:17:12.467 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-24T19:17:14.078 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:14.143 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.140+0000 7fd764274640 10 monclient: get_monmap_and_config 2026-02-24T19:17:14.143 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.140+0000 7fd764274640 10 monclient: build_initial_monmap 2026-02-24T19:17:14.143 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.140+0000 7fd764274640 10 monclient: monmap: 2026-02-24T19:17:14.143 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:14.143 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:14.143 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:17:14.141131+0000 2026-02-24T19:17:14.143 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:17:14.141131+0000 2026-02-24T19:17:14.143 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:14.144 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:14.144 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:14.144 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:14.144 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:14.144 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:14.146 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.140+0000 7fd764274640 1 Processor -- start 2026-02-24T19:17:14.146 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.140+0000 7fd764274640 1 -- start start 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.140+0000 7fd764274640 10 monclient: init 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.140+0000 7fd764274640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd764274640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd764274640 10 monclient(hunting): picked mon.noname-b con 0x7fd75c058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd764274640 10 monclient(hunting): picked mon.noname-a con 0x7fd75c059170 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd764274640 10 monclient(hunting): picked mon.noname-c con 0x7fd75c159ee0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd764274640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75c05d6e0 con 0x7fd75c059170 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd764274640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75c164100 con 0x7fd75c058da0 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd764274640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75c0a8ff0 con 0x7fd75c159ee0 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd764274640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd764274640 10 monclient(hunting): authenticate will time out at 3605.780078s 2026-02-24T19:17:14.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd7617e8640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fd75c059170 0x7fd75c1597d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:50996/0 (socket says 10.20.193.45:50996) 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.141+0000 7fd7617e8640 1 -- 10.20.193.45:0/705821508 learned_addr learned my addr 10.20.193.45:0/705821508 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641242102 0 0) 0x7fd75c164100 con 0x7fd75c058da0 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): _negotiate 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): my global_id is 4213 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd744003610 con 0x7fd75c058da0 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206489469 0 0) 0x7fd75c05d6e0 con 0x7fd75c059170 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): _negotiate 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): my global_id is 4218 2026-02-24T19:17:14.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75c164100 con 0x7fd75c059170 2026-02-24T19:17:14.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822873404 0 0) 0x7fd75c0a8ff0 con 0x7fd75c159ee0 2026-02-24T19:17:14.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): _negotiate 2026-02-24T19:17:14.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:14.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:14.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 10 monclient(hunting): my global_id is 4223 2026-02-24T19:17:14.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.143+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75c05d6e0 con 0x7fd75c159ee0 2026-02-24T19:17:14.153 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3392010200 0 0) 0x7fd75c164100 con 0x7fd75c059170 2026-02-24T19:17:14.153 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 >> v1:10.20.193.179:6789/0 conn(0x7fd75c159ee0 legacy=0x7fd75c163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.153 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 >> v1:10.20.193.114:6789/0 conn(0x7fd75c058da0 legacy=0x7fd75c05cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.153 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 10 monclient: _finish_hunting 0 2026-02-24T19:17:14.153 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 1 monclient: found mon.noname-a 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c0a92d0 con 0x7fd75c059170 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 10 monclient: _finish_auth 0 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 10 monclient: _check_auth_tickets 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd750002df0 con 0x7fd75c059170 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd760fe7640 10 monclient: dump: 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:14.154 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd764274640 5 monclient: authenticate success, global_id 4218 2026-02-24T19:17:14.155 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.145+0000 7fd764274640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd750002fc0 con 0x7fd75c059170 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd760fe7640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd760fe7640 1 -- 10.20.193.45:0/705821508 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd750003400 con 0x7fd75c059170 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd760fe7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd760fe7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd760fe7640 10 monclient: dump: 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:14.156 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd764274640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd764274640 4 set_mon_vals no callback set 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd764274640 10 monclient: shutdown 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd764274640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd764274640 1 -- 10.20.193.45:0/705821508 >> v1:10.20.193.45:6789/0 conn(0x7fd75c059170 legacy=0x7fd75c1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd764274640 1 -- 10.20.193.45:0/705821508 shutdown_connections 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd764274640 1 -- 10.20.193.45:0/705821508 >> 10.20.193.45:0/705821508 conn(0x7fd75c0b65f0 msgr2=0x7fd75c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd764274640 1 -- 10.20.193.45:0/705821508 shutdown_connections 2026-02-24T19:17:14.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.146+0000 7fd764274640 1 -- 10.20.193.45:0/705821508 wait complete. 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient: build_initial_monmap 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient: monmap: 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:14.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 1 librados: starting msgr at 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 1 librados: starting objecter 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 1 Processor -- start 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 1 -- start start 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 1 librados: setting wanted keys 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 1 librados: calling monclient init 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient: init 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient(hunting): picked mon.noname-c con 0x7fd75c058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient(hunting): picked mon.noname-b con 0x7fd75c059170 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:14.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient(hunting): picked mon.noname-a con 0x7fd75c159ee0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75c130d90 con 0x7fd75c159ee0 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75c131070 con 0x7fd75c059170 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75c131350 con 0x7fd75c058da0 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.147+0000 7fd764274640 10 monclient(hunting): authenticate will time out at 3605.786857s 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.148+0000 7fd7627ea640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fd75c159ee0 0x7fd75c155170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:51000/0 (socket says 10.20.193.45:51000) 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.148+0000 7fd7627ea640 1 -- 10.20.193.45:0/2596133583 learned_addr learned my addr 10.20.193.45:0/2596133583 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.148+0000 7fd74a7fc640 10 client.?.objecter ms_handle_connect 0x7fd75c159ee0 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.148+0000 7fd74a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.148+0000 7fd74a7fc640 10 client.?.objecter ms_handle_connect 0x7fd75c058da0 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.148+0000 7fd74a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.148+0000 7fd74a7fc640 10 client.?.objecter ms_handle_connect 0x7fd75c059170 2026-02-24T19:17:14.160 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.148+0000 7fd74a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546073281 0 0) 0x7fd75c130d90 con 0x7fd75c159ee0 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): my global_id is 4221 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd72c003610 con 0x7fd75c159ee0 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392218306 0 0) 0x7fd75c131350 con 0x7fd75c058da0 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:14.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): my global_id is 4226 2026-02-24T19:17:14.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75c130d90 con 0x7fd75c058da0 2026-02-24T19:17:14.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007590175 0 0) 0x7fd75c131070 con 0x7fd75c059170 2026-02-24T19:17:14.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:14.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:14.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:14.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 10 monclient(hunting): my global_id is 4216 2026-02-24T19:17:14.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.149+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75c131350 con 0x7fd75c059170 2026-02-24T19:17:14.165 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.151+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2447752533 0 0) 0x7fd72c003610 con 0x7fd75c159ee0 2026-02-24T19:17:14.165 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.151+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd75c131070 con 0x7fd75c159ee0 2026-02-24T19:17:14.165 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.151+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd7580033c0 con 0x7fd75c159ee0 2026-02-24T19:17:14.165 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.151+0000 7fd74a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.151+0000 7fd74a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.151+0000 7fd74a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:14.166 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.151+0000 7fd74a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2330343587 0 0) 0x7fd75c131350 con 0x7fd75c059170 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd72c003610 con 0x7fd75c059170 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd750003310 con 0x7fd75c059170 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:14.167 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1864810863 0 0) 0x7fd75c130d90 con 0x7fd75c058da0 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd75c131350 con 0x7fd75c058da0 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd74c0030b0 con 0x7fd75c058da0 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.152+0000 7fd74a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:14.168 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2355024372 0 0) 0x7fd75c131070 con 0x7fd75c159ee0 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 >> v1:10.20.193.179:6789/0 conn(0x7fd75c058da0 legacy=0x7fd75c130530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 >> v1:10.20.193.114:6789/0 conn(0x7fd75c059170 legacy=0x7fd75c1615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 1 monclient: found mon.a 2026-02-24T19:17:14.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c131630 con 0x7fd75c159ee0 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd74a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd764274640 5 monclient: authenticate success, global_id 4221 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd764274640 10 monclient: _renew_subs 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd764274640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd75c161090 con 0x7fd75c159ee0 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd764274640 10 client.4221.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd764274640 10 monclient: _renew_subs 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd764274640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:14.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.153+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd75c161cc0 con 0x7fd75c159ee0 2026-02-24T19:17:14.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.154+0000 7fd764274640 1 librados: init done 2026-02-24T19:17:14.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.154+0000 7fd764274640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:14.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.154+0000 7fd764274640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:14.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.154+0000 7fd764274640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:14.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.154+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75c131870 con 0x7fd75c159ee0 2026-02-24T19:17:14.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.154+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd758003a80 con 0x7fd75c159ee0 2026-02-24T19:17:14.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.154+0000 7fd74a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:14.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.154+0000 7fd74bfff640 4 set_mon_vals no callback set 2026-02-24T19:17:14.172 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.163+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd758003e50 con 0x7fd75c159ee0 2026-02-24T19:17:14.172 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.163+0000 7fd74a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:14.172 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.163+0000 7fd74a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.163+0000 7fd74a7fc640 10 monclient: dump: 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:14.173 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.164+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7fd758004070 con 0x7fd75c159ee0 2026-02-24T19:17:14.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.164+0000 7fd761fe9640 10 monclient: get_auth_request con 0x7fd72c077d90 auth_method 0 2026-02-24T19:17:14.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.165+0000 7fd74a7fc640 10 client.4221.objecter ms_handle_connect 0x7fd72c077d90 2026-02-24T19:17:14.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.166+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 1454299169 0 0) 0x7fd7580597e0 con 0x7fd75c159ee0 2026-02-24T19:17:14.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.166+0000 7fd74a7fc640 10 client.4221.objecter ms_dispatch2 0x7fd75c000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:17:14.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.166+0000 7fd74a7fc640 3 client.4221.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:17:14.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.166+0000 7fd74a7fc640 3 client.4221.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:17:14.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.166+0000 7fd74a7fc640 20 client.4221.objecter dump_active .. 0 homeless 2026-02-24T19:17:14.293 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.290+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd75805df50 con 0x7fd75c159ee0 2026-02-24T19:17:14.294 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.290+0000 7fd74a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:14.294 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.290+0000 7fd74a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:14.404 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.401+0000 7fd764274640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:14.404 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.401+0000 7fd764274640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:14.404 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.401+0000 7fd764274640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:14.404 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.401+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd75c1677f0 con 0x7fd75c159ee0 2026-02-24T19:17:14.411 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.408+0000 7fd74a7fc640 1 -- 10.20.193.45:0/2596133583 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3053866050) 0x7fd75805d850 con 0x7fd75c159ee0 2026-02-24T19:17:14.411 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.408+0000 7fd74a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:14.411 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.408+0000 7fd74a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:14.412 INFO:teuthology.misc.health.trial045.stdout: 2026-02-24T19:17:14.412 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"738dd6f3-d81f-41eb-89dc-068883b21f11","created":"2026-02-24T19:17:05.025851+0000","modified":"2026-02-24T19:17:11.992117+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:17:11.992117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"53650ce1-deec-4943-ba8b-cdf389f4e5e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e3d2506e-9e10-4206-96d1-3dd8aa4d91cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2fe7f095-bf74-4e4a-996c-c58438826e11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"270148b3-6c77-4c1f-9d73-05d1c75990c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43b91f27-e730-4a81-a86b-b2fefdddd3e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"01c901c8-775a-4e42-b73a-5db3d938dbb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b29d58d3-b5f9-428c-8246-910655dd5490","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f182ac9b-e6ee-461e-af0c-0ef4ef51c737","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"b812d673-950b-4168-9a5e-d3719d569a7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"442018bc-d405-49b3-8934-0ab83b4613eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e5bf8aa9-8c19-494b-bd7a-c5da71af847b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"6cb63f95-82e0-483f-926b-94a88b3c54f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"b15b2174-466b-4e9a-9c6d-ed8caabe7b28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"d4e5150e-a985-488e-a911-45bf3431c165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0d938446-8802-44bc-be90-db79361a5200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"168bd4e0-e43c-4581-819c-9ed544805d2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:14.415 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 10 librados: watch_flush enter 2026-02-24T19:17:14.415 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 10 librados: watch_flush exit 2026-02-24T19:17:14.415 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 20 client.4221.objecter shutdown clearing up homeless session... 2026-02-24T19:17:14.415 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 10 client.4221.objecter successfully canceled tick 2026-02-24T19:17:14.415 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 >> v1:10.20.193.45:6800/1599977652 conn(0x7fd72c077d90 legacy=0x7fd72c098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.415 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 10 monclient: shutdown 2026-02-24T19:17:14.415 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:14.415 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 >> v1:10.20.193.45:6789/0 conn(0x7fd75c159ee0 legacy=0x7fd75c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.415 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 shutdown_connections 2026-02-24T19:17:14.416 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 >> 10.20.193.45:0/2596133583 conn(0x7fd75c0b65f0 msgr2=0x7fd75c0b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:14.416 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 shutdown_connections 2026-02-24T19:17:14.416 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 1 -- 10.20.193.45:0/2596133583 wait complete. 2026-02-24T19:17:14.416 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:14.411+0000 7fd764274640 1 librados: shutdown 2026-02-24T19:17:14.422 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:17:22.033 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:22.097 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.094+0000 7f9d7a799640 10 monclient: get_monmap_and_config 2026-02-24T19:17:22.098 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.094+0000 7f9d7a799640 10 monclient: build_initial_monmap 2026-02-24T19:17:22.098 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.094+0000 7f9d7a799640 10 monclient: monmap: 2026-02-24T19:17:22.098 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:22.098 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:22.098 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:17:22.096055+0000 2026-02-24T19:17:22.098 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:17:22.096055+0000 2026-02-24T19:17:22.098 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:22.098 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:22.098 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:22.099 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:22.099 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:22.099 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:22.101 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 1 Processor -- start 2026-02-24T19:17:22.101 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 1 -- start start 2026-02-24T19:17:22.101 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 10 monclient: init 2026-02-24T19:17:22.101 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 10 monclient(hunting): picked mon.noname-c con 0x7f9d7415df50 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 10 monclient(hunting): picked mon.noname-b con 0x7f9d7416b930 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 10 monclient(hunting): picked mon.noname-a con 0x7f9d74059240 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d741685c0 con 0x7f9d74059240 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7405cbe0 con 0x7f9d7416b930 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7405cec0 con 0x7f9d7415df50 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.095+0000 7f9d7a799640 10 monclient(hunting): authenticate will time out at 3613.734943s 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.096+0000 7f9d737fe640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f9d7416b930 0x7f9d74058b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35816/0 (socket says 10.20.193.45:35816) 2026-02-24T19:17:22.102 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.096+0000 7f9d737fe640 1 -- 10.20.193.45:0/834402788 learned_addr learned my addr 10.20.193.45:0/834402788 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217834831 0 0) 0x7f9d7405cbe0 con 0x7f9d7416b930 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): my global_id is 4219 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d58003610 con 0x7f9d7416b930 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4101718019 0 0) 0x7f9d741685c0 con 0x7f9d74059240 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): my global_id is 4224 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7405cbe0 con 0x7f9d74059240 2026-02-24T19:17:22.103 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291438831 0 0) 0x7f9d7405cec0 con 0x7f9d7415df50 2026-02-24T19:17:22.104 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.104 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.104 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.104 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 10 monclient(hunting): my global_id is 4229 2026-02-24T19:17:22.104 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.098+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d741685c0 con 0x7f9d7415df50 2026-02-24T19:17:22.108 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3556525061 0 0) 0x7f9d58003610 con 0x7f9d7416b930 2026-02-24T19:17:22.108 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 >> v1:10.20.193.179:6789/0 conn(0x7f9d7415df50 legacy=0x7f9d74056dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 >> v1:10.20.193.45:6789/0 conn(0x7f9d74059240 legacy=0x7f9d74167810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 1 monclient: found mon.noname-b 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7405d1a0 con 0x7f9d7416b930 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9d64002df0 con 0x7f9d7416b930 2026-02-24T19:17:22.109 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d72ffd640 10 monclient: dump: 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:22.110 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d7a799640 5 monclient: authenticate success, global_id 4219 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.100+0000 7f9d7a799640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d64002fc0 con 0x7f9d7416b930 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d72ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d72ffd640 1 -- 10.20.193.45:0/834402788 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9d64003400 con 0x7f9d7416b930 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d72ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d72ffd640 10 monclient: dump: 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.111 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 4 set_mon_vals no callback set 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 10 monclient: shutdown 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 1 -- 10.20.193.45:0/834402788 >> v1:10.20.193.114:6789/0 conn(0x7f9d7416b930 legacy=0x7f9d74058b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 1 -- 10.20.193.45:0/834402788 shutdown_connections 2026-02-24T19:17:22.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 1 -- 10.20.193.45:0/834402788 >> 10.20.193.45:0/834402788 conn(0x7f9d740b65f0 msgr2=0x7f9d740b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 1 -- 10.20.193.45:0/834402788 shutdown_connections 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 1 -- 10.20.193.45:0/834402788 wait complete. 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 10 monclient: build_initial_monmap 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 10 monclient: monmap: 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:22.113 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 1 librados: starting msgr at 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.101+0000 7f9d7a799640 1 librados: starting objecter 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 1 Processor -- start 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 1 -- start start 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 1 librados: setting wanted keys 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 1 librados: calling monclient init 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 10 monclient: init 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:22.114 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 10 monclient(hunting): picked mon.noname-b con 0x7f9d74059240 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 10 monclient(hunting): picked mon.noname-c con 0x7f9d7415df50 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 10 monclient(hunting): picked mon.noname-a con 0x7f9d7416b930 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7413fd50 con 0x7f9d7416b930 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7411a8e0 con 0x7f9d74059240 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7411abc0 con 0x7f9d7415df50 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d7a799640 10 monclient(hunting): authenticate will time out at 3613.741443s 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d78d0f640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9d7416b930 0x7f9d7412ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:52572/0 (socket says 10.20.193.45:52572) 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d78d0f640 1 -- 10.20.193.45:0/4055951280 learned_addr learned my addr 10.20.193.45:0/4055951280 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d70ff9640 10 client.?.objecter ms_handle_connect 0x7f9d7416b930 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.102+0000 7f9d70ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 10 client.?.objecter ms_handle_connect 0x7f9d74059240 2026-02-24T19:17:22.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 10 client.?.objecter ms_handle_connect 0x7f9d7415df50 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286579001 0 0) 0x7f9d7411a8e0 con 0x7f9d74059240 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 10 monclient(hunting): my global_id is 4222 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.103+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d44003610 con 0x7f9d74059240 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 363637380 0 0) 0x7f9d7413fd50 con 0x7f9d7416b930 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.117 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 10 monclient(hunting): my global_id is 4227 2026-02-24T19:17:22.117 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7411a8e0 con 0x7f9d7416b930 2026-02-24T19:17:22.117 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009332903 0 0) 0x7f9d7411abc0 con 0x7f9d7415df50 2026-02-24T19:17:22.117 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.117 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.117 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.117 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 10 monclient(hunting): my global_id is 4232 2026-02-24T19:17:22.117 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.104+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d7413fd50 con 0x7f9d7415df50 2026-02-24T19:17:22.121 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.106+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4251968660 0 0) 0x7f9d44003610 con 0x7f9d74059240 2026-02-24T19:17:22.121 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.106+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d7411abc0 con 0x7f9d74059240 2026-02-24T19:17:22.121 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.106+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9d60003060 con 0x7f9d74059240 2026-02-24T19:17:22.121 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.106+0000 7f9d70ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:22.121 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.106+0000 7f9d70ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:22.121 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.106+0000 7f9d70ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:22.121 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:22.121 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:22.121 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.106+0000 7f9d70ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1647075802 0 0) 0x7f9d7411a8e0 con 0x7f9d7416b930 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d44003610 con 0x7f9d7416b930 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9d68003420 con 0x7f9d7416b930 2026-02-24T19:17:22.122 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:22.123 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2702704491 0 0) 0x7f9d7413fd50 con 0x7f9d7415df50 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d7411a8e0 con 0x7f9d7415df50 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9d64003310 con 0x7f9d7415df50 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.107+0000 7f9d70ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:22.124 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 517158269 0 0) 0x7f9d7411abc0 con 0x7f9d74059240 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 >> v1:10.20.193.179:6789/0 conn(0x7f9d7415df50 legacy=0x7f9d7411bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 >> v1:10.20.193.45:6789/0 conn(0x7f9d7416b930 legacy=0x7f9d7412ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 1 monclient: found mon.b 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7411aea0 con 0x7f9d74059240 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:22.125 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d70ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d7a799640 5 monclient: authenticate success, global_id 4222 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d7a799640 10 monclient: _renew_subs 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d7a799640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7411b780 con 0x7f9d74059240 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d7a799640 10 client.4222.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d7a799640 10 monclient: _renew_subs 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d7a799640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d7411c870 con 0x7f9d74059240 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.108+0000 7f9d7a799640 1 librados: init done 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.109+0000 7f9d7a799640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.109+0000 7f9d7a799640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:22.126 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.109+0000 7f9d7a799640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.109+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7412e720 con 0x7f9d74059240 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.116+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d60003700 con 0x7f9d74059240 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.116+0000 7f9d70ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.116+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9d60003a50 con 0x7f9d74059240 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.116+0000 7f9d70ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.116+0000 7f9d70ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.116+0000 7f9d70ff9640 10 monclient: dump: 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.127 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:22.128 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:22.128 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:22.128 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:22.128 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:22.128 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.116+0000 7f9d727fc640 4 set_mon_vals no callback set 2026-02-24T19:17:22.128 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.117+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7f9d6001c880 con 0x7f9d74059240 2026-02-24T19:17:22.128 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.117+0000 7f9d737fe640 10 monclient: get_auth_request con 0x7f9d44077e50 auth_method 0 2026-02-24T19:17:22.128 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.117+0000 7f9d70ff9640 10 client.4222.objecter ms_handle_connect 0x7f9d44077e50 2026-02-24T19:17:22.129 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.119+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 1454299169 0 0) 0x7f9d60058250 con 0x7f9d74059240 2026-02-24T19:17:22.129 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.119+0000 7f9d70ff9640 10 client.4222.objecter ms_dispatch2 0x7f9d74000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:17:22.129 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.119+0000 7f9d70ff9640 3 client.4222.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:17:22.129 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.119+0000 7f9d70ff9640 3 client.4222.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:17:22.129 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.119+0000 7f9d70ff9640 20 client.4222.objecter dump_active .. 0 homeless 2026-02-24T19:17:22.208 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.205+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9d6005c9c0 con 0x7f9d74059240 2026-02-24T19:17:22.208 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.205+0000 7f9d70ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:22.208 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.205+0000 7f9d70ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:22.316 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.313+0000 7f9d7a799640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:22.316 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.313+0000 7f9d7a799640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:22.316 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.313+0000 7f9d7a799640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:22.316 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.313+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d7412e440 con 0x7f9d74059240 2026-02-24T19:17:22.338 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.335+0000 7f9d70ff9640 1 -- 10.20.193.45:0/4055951280 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3053866050) 0x7f9d6005c2c0 con 0x7f9d74059240 2026-02-24T19:17:22.338 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.335+0000 7f9d70ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:22.338 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.335+0000 7f9d70ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:22.338 INFO:teuthology.misc.health.trial045.stdout: 2026-02-24T19:17:22.338 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"738dd6f3-d81f-41eb-89dc-068883b21f11","created":"2026-02-24T19:17:05.025851+0000","modified":"2026-02-24T19:17:11.992117+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:17:11.992117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"53650ce1-deec-4943-ba8b-cdf389f4e5e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e3d2506e-9e10-4206-96d1-3dd8aa4d91cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2fe7f095-bf74-4e4a-996c-c58438826e11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"270148b3-6c77-4c1f-9d73-05d1c75990c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43b91f27-e730-4a81-a86b-b2fefdddd3e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"01c901c8-775a-4e42-b73a-5db3d938dbb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b29d58d3-b5f9-428c-8246-910655dd5490","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f182ac9b-e6ee-461e-af0c-0ef4ef51c737","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"b812d673-950b-4168-9a5e-d3719d569a7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"442018bc-d405-49b3-8934-0ab83b4613eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e5bf8aa9-8c19-494b-bd7a-c5da71af847b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"6cb63f95-82e0-483f-926b-94a88b3c54f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"b15b2174-466b-4e9a-9c6d-ed8caabe7b28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"d4e5150e-a985-488e-a911-45bf3431c165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0d938446-8802-44bc-be90-db79361a5200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"168bd4e0-e43c-4581-819c-9ed544805d2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:22.341 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 10 librados: watch_flush enter 2026-02-24T19:17:22.341 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 10 librados: watch_flush exit 2026-02-24T19:17:22.341 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 20 client.4222.objecter shutdown clearing up homeless session... 2026-02-24T19:17:22.341 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 10 client.4222.objecter successfully canceled tick 2026-02-24T19:17:22.342 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 >> v1:10.20.193.45:6800/1599977652 conn(0x7f9d44077e50 legacy=0x7f9d44098300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.342 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 10 monclient: shutdown 2026-02-24T19:17:22.342 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:22.342 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 >> v1:10.20.193.114:6789/0 conn(0x7f9d74059240 legacy=0x7f9d7413f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.342 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 shutdown_connections 2026-02-24T19:17:22.342 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 >> 10.20.193.45:0/4055951280 conn(0x7f9d740b65f0 msgr2=0x7f9d7416ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:22.342 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 shutdown_connections 2026-02-24T19:17:22.342 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 1 -- 10.20.193.45:0/4055951280 wait complete. 2026-02-24T19:17:22.342 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:22.338+0000 7f9d7a799640 1 librados: shutdown 2026-02-24T19:17:22.349 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:17:22.558 INFO:tasks.ceph.osd.1.trial114.stderr:--00:00:00:10.437 43965-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.559 INFO:tasks.ceph.osd.5.trial114.stderr:--00:00:00:10.436 43966-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.559 INFO:tasks.ceph.osd.9.trial114.stderr:--00:00:00:10.435 43967-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.562 INFO:tasks.ceph.osd.0.trial045.stderr:--00:00:00:10.454 45469-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.562 INFO:tasks.ceph.osd.4.trial045.stderr:--00:00:00:10.451 45470-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.627 INFO:tasks.ceph.osd.2.trial179.stderr:--00:00:00:10.498 43898-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.627 INFO:tasks.ceph.osd.6.trial179.stderr:--00:00:00:10.494 43899-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.652 INFO:tasks.ceph.osd.13.trial114.stderr:--00:00:00:10.524 43968-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.721 INFO:tasks.ceph.osd.8.trial045.stderr:--00:00:00:10.605 45475-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.739 INFO:tasks.ceph.osd.7.trial194.stderr:--00:00:00:10.589 44373-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.778 INFO:tasks.ceph.osd.10.trial179.stderr:--00:00:00:10.639 43901-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.784 INFO:tasks.ceph.osd.3.trial194.stderr:--00:00:00:10.634 44372-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.800 INFO:tasks.ceph.osd.12.trial045.stderr:--00:00:00:10.683 45476-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.810 INFO:tasks.ceph.osd.15.trial194.stderr:--00:00:00:10.659 44375-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.820 INFO:tasks.ceph.osd.14.trial179.stderr:--00:00:00:10.682 43900-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:22.866 INFO:tasks.ceph.osd.11.trial194.stderr:--00:00:00:10.716 44374-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:24.667 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:12.556 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.680 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:12.556 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.694 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:12.587 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.705 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:12.583 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.730 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:12.608 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.744 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:12.633 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.750 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:12.622 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.758 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:12.634 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.767 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:12.659 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.776 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:12.648 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.777 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:12.655 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.784 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:12.673 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.791 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:12.667 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.800 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:12.668 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.802 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:12.694 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.809 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:12.688 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.814 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:12.692 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.815 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:12.686 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.819 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:12.708 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.825 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:12.709 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.825 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:12.701 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.836 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:12.715 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.836 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:12.729 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.839 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:12.711 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.846 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:12.724 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.846 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:12.718 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.853 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:12.742 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.855 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:12.731 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.868 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:12.736 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.869 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:12.741 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.871 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:12.754 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.872 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:12.764 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.876 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:12.748 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.877 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:12.756 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.881 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:12.759 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.893 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:12.777 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.895 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:12.771 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.900 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:12.789 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.903 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:12.753 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.903 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:12.771 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.903 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:12.775 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.907 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:12.779 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.908 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:12.800 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.910 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:12.786 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.916 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:12.805 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.917 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:12.795 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.917 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:12.796 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.923 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:12.815 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.924 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:12.785 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.933 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:12.811 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.934 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:12.819 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.935 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:12.803 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.937 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:12.809 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.945 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:12.817 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.953 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:12.824 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.954 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:12.837 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.955 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:12.834 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.966 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:12.828 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.968 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:12.853 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.969 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:12.836 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.970 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:12.849 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.978 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:12.828 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.979 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:12.830 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.984 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:12.867 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.986 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:12.858 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.994 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:12.854 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:24.996 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:12.881 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.001 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:12.873 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.001 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:12.851 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.004 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:12.887 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.015 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:12.865 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.015 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:12.883 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.015 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:12.900 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.028 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-24T19:17:25.023+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.030 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:12.897 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.030 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:12.915 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.031 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:12.892 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.033 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-24T19:17:25.027+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.034 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:12.917 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.035 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:12.896 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.040 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:12.890 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.040 INFO:tasks.ceph.osd.9.trial114.stderr:2026-02-24T19:17:25.035+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.044 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:12.894 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.057 INFO:tasks.ceph.osd.5.trial114.stderr:2026-02-24T19:17:25.053+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.062 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:12.924 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.063 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:12.924 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.073 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:12.956 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.076 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:12.926 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.080 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:12.929 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.081 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:12.931 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.081 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:12.931 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.086 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:12.948 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.089 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:12.972 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.090 INFO:tasks.ceph.osd.2.trial179.stderr:2026-02-24T19:17:25.086+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.093 INFO:tasks.ceph.osd.1.trial114.stderr:2026-02-24T19:17:25.089+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.096 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:12.957 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.103 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:12.952 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.111 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:12.973 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.112 INFO:tasks.ceph.osd.13.trial114.stderr:2026-02-24T19:17:25.108+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.118 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:12.968 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.119 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:12.970 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.132 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:12.993 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.134 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:12.984 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.138 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:12.987 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.139 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-24T19:17:25.133+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.142 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:12.992 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.147 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:12.997 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.147 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.008 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.148 INFO:tasks.ceph.osd.6.trial179.stderr:2026-02-24T19:17:25.144+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.161 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.023 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.167 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.016 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.171 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.021 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.176 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.038 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.180 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.031 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.195 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.045 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.201 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.050 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.203 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.053 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.214 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-24T19:17:25.209+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.216 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.065 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.232 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.082 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.247 INFO:tasks.ceph.osd.7.trial194.stderr:2026-02-24T19:17:25.243+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.259 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.109 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.264 INFO:tasks.ceph.osd.10.trial179.stderr:2026-02-24T19:17:25.259+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.273 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.123 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.293 INFO:tasks.ceph.osd.3.trial194.stderr:2026-02-24T19:17:25.289+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.295 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.184 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.296 INFO:tasks.ceph.osd.14.trial179.stderr:2026-02-24T19:17:25.292+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.299 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.191 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.309 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.185 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.327 INFO:tasks.ceph.osd.15.trial194.stderr:2026-02-24T19:17:25.323+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.327 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.205 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.358 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.230 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.368 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.246 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.373 INFO:tasks.ceph.osd.11.trial194.stderr:2026-02-24T19:17:25.369+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:25.377 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.266 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.394 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.266 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.396 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.288 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.404 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.280 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.410 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.295 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.426 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.315 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.426 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.304 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.427 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.294 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.444 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.333 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.450 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.329 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.456 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.328 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.469 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.361 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.471 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.360 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.477 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.349 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.482 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.358 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.486 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.369 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.487 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.371 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.503 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.381 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.505 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.394 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.512 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.383 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.512 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.391 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.517 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.410 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.519 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.387 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.521 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.371 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.525 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.401 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.541 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.402 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.541 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.412 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.545 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.434 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.547 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.431 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.548 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.426 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.549 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.428 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.557 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.449 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.559 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.431 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.566 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.442 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.568 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.439 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.573 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.423 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.574 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.463 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.574 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.442 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.575 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.460 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.579 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.441 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.584 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.467 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.587 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.466 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.588 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.466 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.596 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.467 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.596 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.468 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.604 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.472 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.605 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.481 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.607 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.492 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.607 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.500 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.609 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.488 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.610 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.459 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.615 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.504 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.623 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.473 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.624 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.485 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.632 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.510 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.634 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.505 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.640 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.508 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.641 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.526 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.642 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.521 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.642 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.518 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.643 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.514 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.648 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.541 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.655 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.505 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.659 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.542 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.661 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.523 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.667 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.517 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.669 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.554 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.669 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.540 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.676 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.526 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.677 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.545 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.678 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.557 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.686 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.564 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.694 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.570 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.694 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.566 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.703 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.552 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.703 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.574 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.703 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.596 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.704 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.565 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.704 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.572 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.706 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.556 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.706 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.585 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.713 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.575 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.714 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.599 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.714 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.598 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.717 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.567 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.728 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.606 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.733 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.622 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.736 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.604 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.737 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.587 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.741 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.603 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.742 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.602 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.742 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.618 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.742 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.614 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.745 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.596 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.746 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.596 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.758 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.643 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.758 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.642 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.759 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.651 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.767 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.645 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.768 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.636 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.772 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.634 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.776 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.637 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.778 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.667 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.784 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.634 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.784 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.634 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.785 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.635 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.787 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.659 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.789 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.638 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.801 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.685 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.804 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.666 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.808 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.658 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.811 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.661 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.815 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.704 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.816 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.666 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.817 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.666 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.827 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.699 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.833 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.693 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.834 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.705 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.834 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.712 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.840 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.702 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.843 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.726 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.844 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.733 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.845 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.695 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.848 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:13.738 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.850 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.700 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.853 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.703 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.853 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.702 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.869 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.719 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.874 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.759 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.877 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.727 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.878 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.728 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.881 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.743 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.881 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.742 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.887 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.736 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.887 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.759 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.889 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.757 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.889 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.773 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.890 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.766 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.890 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.741 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.891 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.770 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.901 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.763 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.902 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.752 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.905 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.797 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.913 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.791 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.918 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.789 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.922 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.801 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.929 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.778 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.932 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.793 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.933 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.817 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.935 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.811 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.936 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.821 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.939 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.789 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.945 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.816 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.947 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.815 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.950 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:13.821 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.954 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.832 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.955 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.847 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.958 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:13.837 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.961 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.846 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.965 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.841 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.965 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.843 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.965 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.816 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.966 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.815 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.975 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.836 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.976 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.844 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.985 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.870 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.987 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.879 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.988 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.860 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.990 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:13.874 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.993 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.871 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.994 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.870 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.999 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:13.875 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:25.999 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.850 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.005 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.872 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.009 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:13.877 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.010 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:13.859 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.015 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.907 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.015 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.865 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.019 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:13.912 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.033 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.910 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.034 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.896 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.038 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:13.916 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.043 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.915 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.057 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.906 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.070 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.920 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.075 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.946 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.078 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:13.962 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.085 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.935 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.092 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.954 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.099 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.950 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.100 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.972 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.105 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:13.977 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.108 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.958 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.115 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.965 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.120 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:13.970 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.121 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:13.982 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.125 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:14.008 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.126 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:13.986 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.139 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:13.989 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.146 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:13.996 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.152 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:14.002 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.156 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:14.005 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.160 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:14.022 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.165 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:14.026 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.169 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:14.019 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.169 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:14.053 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.170 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:14.031 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.207 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:14.057 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.212 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:14.062 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.215 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:14.064 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.217 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:14.078 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.218 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:14.101 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.222 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:14.106 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.246 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:14.095 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.259 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:14.120 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.264 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:14.125 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.280 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:14.129 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:26.285 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:14.134 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.089 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:15.978 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.215 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:16.093 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.241 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:16.125 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.243 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:16.114 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.255 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:16.147 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.276 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:16.152 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.312 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:16.189 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.318 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:16.185 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.390 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:16.261 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.428 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:16.278 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.463 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:16.313 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.489 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:16.351 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.490 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:16.372 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.528 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:16.378 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.571 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:16.432 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:28.634 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:16.483 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:29.961 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:30.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.018+0000 7f9e0ceb1640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.018+0000 7f9e0ceb1640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.021 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.018+0000 7f9e0ceb1640 10 monclient: monmap: 2026-02-24T19:17:30.021 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:30.021 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:30.021 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:17:30.019313+0000 2026-02-24T19:17:30.021 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:17:30.019313+0000 2026-02-24T19:17:30.021 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.022 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:30.022 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:30.022 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:30.022 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:30.022 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:30.024 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.018+0000 7f9e0ceb1640 1 Processor -- start 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.018+0000 7f9e0ceb1640 1 -- start start 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.018+0000 7f9e0ceb1640 10 monclient: init 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 10 monclient(hunting): picked mon.noname-c con 0x7f9e08058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 10 monclient(hunting): picked mon.noname-b con 0x7f9e08059170 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 10 monclient(hunting): picked mon.noname-a con 0x7f9e08159ee0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0805d6e0 con 0x7f9e08159ee0 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e08164100 con 0x7f9e08059170 2026-02-24T19:17:30.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e080a8ff0 con 0x7f9e08058da0 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e0ceb1640 10 monclient(hunting): authenticate will time out at 3621.658394s 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e05d74640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f9e08059170 0x7f9e081597d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35870/0 (socket says 10.20.193.45:35870) 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e05d74640 1 -- 10.20.193.45:0/3436982547 learned_addr learned my addr 10.20.193.45:0/3436982547 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.019+0000 7f9e06d76640 1 --1- 10.20.193.45:0/3436982547 >> v1:10.20.193.45:6789/0 conn(0x7f9e08159ee0 0x7f9e08163340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:52640/0 (socket says 10.20.193.45:52640) 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457371454 0 0) 0x7f9e08164100 con 0x7f9e08059170 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): my global_id is 4273 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9df4003610 con 0x7f9e08059170 2026-02-24T19:17:30.026 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258868119 0 0) 0x7f9e0805d6e0 con 0x7f9e08159ee0 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): my global_id is 4278 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e08164100 con 0x7f9e08159ee0 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902106843 0 0) 0x7f9e080a8ff0 con 0x7f9e08058da0 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 10 monclient(hunting): my global_id is 4283 2026-02-24T19:17:30.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.021+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e0805d6e0 con 0x7f9e08058da0 2026-02-24T19:17:30.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1664030518 0 0) 0x7f9df4003610 con 0x7f9e08059170 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 >> v1:10.20.193.179:6789/0 conn(0x7f9e08058da0 legacy=0x7f9e0805cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 >> v1:10.20.193.45:6789/0 conn(0x7f9e08159ee0 legacy=0x7f9e08163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 1 monclient: found mon.noname-b 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e080a92d0 con 0x7f9e08059170 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9df0002df0 con 0x7f9e08059170 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e05573640 10 monclient: dump: 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:30.033 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e0ceb1640 5 monclient: authenticate success, global_id 4273 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.023+0000 7f9e0ceb1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9df0002fc0 con 0x7f9e08059170 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e05573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e05573640 1 -- 10.20.193.45:0/3436982547 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9df0003400 con 0x7f9e08059170 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e05573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e05573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e05573640 10 monclient: dump: 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:30.034 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 4 set_mon_vals no callback set 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 10 monclient: shutdown 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/3436982547 >> v1:10.20.193.114:6789/0 conn(0x7f9e08059170 legacy=0x7f9e081597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/3436982547 shutdown_connections 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/3436982547 >> 10.20.193.45:0/3436982547 conn(0x7f9e080b65f0 msgr2=0x7f9e080b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/3436982547 shutdown_connections 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/3436982547 wait complete. 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.024+0000 7f9e0ceb1640 10 monclient: monmap: 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:30.036 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 1 librados: starting msgr at 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 1 librados: starting objecter 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 1 Processor -- start 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 1 -- start start 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 1 librados: setting wanted keys 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 1 librados: calling monclient init 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 10 monclient: init 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 10 monclient(hunting): picked mon.noname-b con 0x7f9e08058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 10 monclient(hunting): picked mon.noname-c con 0x7f9e08059170 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 10 monclient(hunting): picked mon.noname-a con 0x7f9e08159ee0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e08161ef0 con 0x7f9e08159ee0 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e081fb910 con 0x7f9e08058da0 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e081fbbf0 con 0x7f9e08059170 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e0ceb1640 10 monclient(hunting): authenticate will time out at 3621.664638s 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e06d76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9e08159ee0 0x7f9e08133360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:52648/0 (socket says 10.20.193.45:52648) 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.025+0000 7f9e06d76640 1 -- 10.20.193.45:0/581987402 learned_addr learned my addr 10.20.193.45:0/581987402 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.026+0000 7f9deeffd640 10 client.?.objecter ms_handle_connect 0x7f9e08159ee0 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.026+0000 7f9deeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.026+0000 7f9deeffd640 10 client.?.objecter ms_handle_connect 0x7f9e08059170 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.026+0000 7f9deeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.026+0000 7f9deeffd640 10 client.?.objecter ms_handle_connect 0x7f9e08058da0 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.026+0000 7f9deeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616986519 0 0) 0x7f9e08161ef0 con 0x7f9e08159ee0 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): my global_id is 4281 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd4003610 con 0x7f9e08159ee0 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3243235940 0 0) 0x7f9e081fbbf0 con 0x7f9e08059170 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.039 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): my global_id is 4286 2026-02-24T19:17:30.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e08161ef0 con 0x7f9e08059170 2026-02-24T19:17:30.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 213569655 0 0) 0x7f9e081fb910 con 0x7f9e08058da0 2026-02-24T19:17:30.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 10 monclient(hunting): my global_id is 4276 2026-02-24T19:17:30.040 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.027+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e081fbbf0 con 0x7f9e08058da0 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.029+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 521477566 0 0) 0x7f9dd4003610 con 0x7f9e08159ee0 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.029+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e081fb910 con 0x7f9e08159ee0 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.029+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9df80033b0 con 0x7f9e08159ee0 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.029+0000 7f9deeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.029+0000 7f9deeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.029+0000 7f9deeffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.043 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.029+0000 7f9deeffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1878369072 0 0) 0x7f9e08161ef0 con 0x7f9e08059170 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9dd4003610 con 0x7f9e08059170 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9df0003310 con 0x7f9e08059170 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3107961695 0 0) 0x7f9e081fbbf0 con 0x7f9e08058da0 2026-02-24T19:17:30.045 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e08161ef0 con 0x7f9e08058da0 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9dfc003060 con 0x7f9e08058da0 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.030+0000 7f9deeffd640 10 monclient(hunting): dump: 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:30.046 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1839350071 0 0) 0x7f9e081fb910 con 0x7f9e08159ee0 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 >> v1:10.20.193.179:6789/0 conn(0x7f9e08059170 legacy=0x7f9e08151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 >> v1:10.20.193.114:6789/0 conn(0x7f9e08058da0 legacy=0x7f9e081fafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 1 monclient: found mon.a 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e08162190 con 0x7f9e08159ee0 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9deeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 5 monclient: authenticate success, global_id 4281 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 10 monclient: _renew_subs 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9e08162470 con 0x7f9e08159ee0 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 10 client.4281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 10 monclient: _renew_subs 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9e081521e0 con 0x7f9e08159ee0 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 1 librados: init done 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:30.048 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.031+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e08161c40 con 0x7f9e08159ee0 2026-02-24T19:17:30.164 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.161+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9df8004c50 con 0x7f9e08159ee0 2026-02-24T19:17:30.164 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.161+0000 7f9deeffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.164 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.161+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9df8004fa0 con 0x7f9e08159ee0 2026-02-24T19:17:30.164 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.161+0000 7f9deeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.164 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.161+0000 7f9deeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.164 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.161+0000 7f9e04d72640 4 set_mon_vals no callback set 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.161+0000 7f9deeffd640 10 monclient: dump: 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:30.165 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:30.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.161+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7f9df801ddd0 con 0x7f9e08159ee0 2026-02-24T19:17:30.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.162+0000 7f9e06575640 10 monclient: get_auth_request con 0x7f9dd4077d40 auth_method 0 2026-02-24T19:17:30.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.162+0000 7f9deeffd640 10 client.4281.objecter ms_handle_connect 0x7f9dd4077d40 2026-02-24T19:17:30.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.165+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 1454299169 0 0) 0x7f9df8059750 con 0x7f9e08159ee0 2026-02-24T19:17:30.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.165+0000 7f9deeffd640 10 client.4281.objecter ms_dispatch2 0x7f9e08000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:17:30.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.165+0000 7f9deeffd640 3 client.4281.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:17:30.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.165+0000 7f9deeffd640 3 client.4281.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:17:30.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.165+0000 7f9deeffd640 20 client.4281.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.165+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9df805dec0 con 0x7f9e08159ee0 2026-02-24T19:17:30.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.165+0000 7f9deeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.165+0000 7f9deeffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.278 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.275+0000 7f9e0ceb1640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:30.278 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.275+0000 7f9e0ceb1640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:30.279 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.275+0000 7f9e0ceb1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:30.279 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.275+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e08157ca0 con 0x7f9e08159ee0 2026-02-24T19:17:30.286 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:18.176 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.287 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.284+0000 7f9deeffd640 1 -- 10.20.193.45:0/581987402 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3053866050) 0x7f9df805d7c0 con 0x7f9e08159ee0 2026-02-24T19:17:30.287 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.284+0000 7f9deeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:30.287 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.284+0000 7f9deeffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.288 INFO:teuthology.misc.health.trial045.stdout: 2026-02-24T19:17:30.288 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"738dd6f3-d81f-41eb-89dc-068883b21f11","created":"2026-02-24T19:17:05.025851+0000","modified":"2026-02-24T19:17:11.992117+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:17:11.992117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"53650ce1-deec-4943-ba8b-cdf389f4e5e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e3d2506e-9e10-4206-96d1-3dd8aa4d91cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2fe7f095-bf74-4e4a-996c-c58438826e11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"270148b3-6c77-4c1f-9d73-05d1c75990c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43b91f27-e730-4a81-a86b-b2fefdddd3e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"01c901c8-775a-4e42-b73a-5db3d938dbb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b29d58d3-b5f9-428c-8246-910655dd5490","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f182ac9b-e6ee-461e-af0c-0ef4ef51c737","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"b812d673-950b-4168-9a5e-d3719d569a7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"442018bc-d405-49b3-8934-0ab83b4613eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"e5bf8aa9-8c19-494b-bd7a-c5da71af847b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"6cb63f95-82e0-483f-926b-94a88b3c54f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"b15b2174-466b-4e9a-9c6d-ed8caabe7b28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"d4e5150e-a985-488e-a911-45bf3431c165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0d938446-8802-44bc-be90-db79361a5200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"168bd4e0-e43c-4581-819c-9ed544805d2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 10 librados: watch_flush enter 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 10 librados: watch_flush exit 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 20 client.4281.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 10 client.4281.objecter successfully canceled tick 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 >> v1:10.20.193.45:6800/1599977652 conn(0x7f9dd4077d40 legacy=0x7f9dd40981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 10 monclient: shutdown 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 >> v1:10.20.193.45:6789/0 conn(0x7f9e08159ee0 legacy=0x7f9e08133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 shutdown_connections 2026-02-24T19:17:30.291 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 >> 10.20.193.45:0/581987402 conn(0x7f9e080b65f0 msgr2=0x7f9e08134c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.292 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 shutdown_connections 2026-02-24T19:17:30.292 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 1 -- 10.20.193.45:0/581987402 wait complete. 2026-02-24T19:17:30.292 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:30.287+0000 7f9e0ceb1640 1 librados: shutdown 2026-02-24T19:17:30.299 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:17:30.311 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:18.200 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.314 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:18.203 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.395 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:18.274 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.427 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:18.306 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.430 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:18.308 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.434 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:18.326 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.475 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:18.346 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.476 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:18.352 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.477 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:18.369 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.480 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:18.372 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.490 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:18.368 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.495 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:18.379 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.510 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:18.386 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.511 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:18.383 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.512 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:18.388 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.514 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:18.386 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.519 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:18.404 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.522 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:18.407 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.525 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:18.403 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.528 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:18.406 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.595 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:18.462 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.601 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:18.473 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.621 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:18.489 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.624 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:18.491 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.632 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:18.504 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.635 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:18.507 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.701 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:18.584 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.730 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:18.613 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.733 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:18.616 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.736 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:18.586 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.753 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:18.615 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.759 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:18.609 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.761 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:18.612 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.764 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:18.614 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.779 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:18.641 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.782 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:18.643 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.794 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:18.645 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.797 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:18.648 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.803 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:18.654 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.838 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:18.689 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.842 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:18.692 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.847 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:18.708 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.878 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:18.739 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.880 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:18.741 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.931 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:18.781 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.971 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:18.820 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:30.974 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:18.823 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:31.895 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:19.784 45470== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.034 INFO:tasks.ceph.osd.1.trial114.stderr:==00:00:00:19.913 43965== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.066 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:19.959 45469== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.110 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:19.995 45475== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.112 INFO:tasks.ceph.osd.9.trial114.stderr:==00:00:00:19.988 43967== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.120 INFO:tasks.ceph.osd.5.trial114.stderr:==00:00:00:19.998 43966== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.131 INFO:tasks.ceph.osd.2.trial179.stderr:==00:00:00:20.003 43898== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.231 INFO:tasks.ceph.osd.6.trial179.stderr:==00:00:00:20.099 43899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.236 INFO:tasks.ceph.osd.13.trial114.stderr:==00:00:00:20.108 43968== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.328 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:20.211 45476== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.392 INFO:tasks.ceph.osd.7.trial194.stderr:==00:00:00:20.242 44373== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.395 INFO:tasks.ceph.osd.14.trial179.stderr:==00:00:00:20.257 43900== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.439 INFO:tasks.ceph.osd.3.trial194.stderr:==00:00:00:20.289 44372== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.480 INFO:tasks.ceph.osd.11.trial194.stderr:==00:00:00:20.330 44374== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.517 INFO:tasks.ceph.osd.10.trial179.stderr:==00:00:00:20.378 43901== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:32.633 INFO:tasks.ceph.osd.15.trial194.stderr:==00:00:00:20.482 44375== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:34.636 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-24T19:17:34.631+0000 787f4c0 -1 osd.4 0 log_to_monitors true 2026-02-24T19:17:34.814 INFO:tasks.ceph.osd.1.trial114.stderr:2026-02-24T19:17:34.810+0000 787f4c0 -1 osd.1 0 log_to_monitors true 2026-02-24T19:17:34.827 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-24T19:17:34.822+0000 787f4c0 -1 osd.0 0 log_to_monitors true 2026-02-24T19:17:34.841 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-24T19:17:34.836+0000 787f4c0 -1 osd.8 0 log_to_monitors true 2026-02-24T19:17:34.890 INFO:tasks.ceph.osd.9.trial114.stderr:2026-02-24T19:17:34.885+0000 787f4c0 -1 osd.9 0 log_to_monitors true 2026-02-24T19:17:34.904 INFO:tasks.ceph.osd.5.trial114.stderr:2026-02-24T19:17:34.900+0000 787f4c0 -1 osd.5 0 log_to_monitors true 2026-02-24T19:17:34.937 INFO:tasks.ceph.osd.2.trial179.stderr:2026-02-24T19:17:34.933+0000 787f4c0 -1 osd.2 0 log_to_monitors true 2026-02-24T19:17:35.013 INFO:tasks.ceph.osd.13.trial114.stderr:2026-02-24T19:17:35.009+0000 787f4c0 -1 osd.13 0 log_to_monitors true 2026-02-24T19:17:35.037 INFO:tasks.ceph.osd.6.trial179.stderr:2026-02-24T19:17:35.033+0000 787f4c0 -1 osd.6 0 log_to_monitors true 2026-02-24T19:17:35.082 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-24T19:17:35.077+0000 787f4c0 -1 osd.12 0 log_to_monitors true 2026-02-24T19:17:35.214 INFO:tasks.ceph.osd.14.trial179.stderr:2026-02-24T19:17:35.211+0000 787f4c0 -1 osd.14 0 log_to_monitors true 2026-02-24T19:17:35.224 INFO:tasks.ceph.osd.7.trial194.stderr:2026-02-24T19:17:35.221+0000 787f4c0 -1 osd.7 0 log_to_monitors true 2026-02-24T19:17:35.266 INFO:tasks.ceph.osd.3.trial194.stderr:2026-02-24T19:17:35.262+0000 787f4c0 -1 osd.3 0 log_to_monitors true 2026-02-24T19:17:35.324 INFO:tasks.ceph.osd.10.trial179.stderr:2026-02-24T19:17:35.320+0000 787f4c0 -1 osd.10 0 log_to_monitors true 2026-02-24T19:17:35.333 INFO:tasks.ceph.osd.11.trial194.stderr:2026-02-24T19:17:35.329+0000 787f4c0 -1 osd.11 0 log_to_monitors true 2026-02-24T19:17:35.447 INFO:tasks.ceph.osd.15.trial194.stderr:2026-02-24T19:17:35.444+0000 787f4c0 -1 osd.15 0 log_to_monitors true 2026-02-24T19:17:36.952 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-24T19:17:36.947+0000 cf66640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T19:17:36.959 INFO:tasks.ceph.osd.6.trial179.stderr:2026-02-24T19:17:36.956+0000 df79640 -1 osd.6 0 waiting for initial osdmap 2026-02-24T19:17:36.976 INFO:tasks.ceph.osd.5.trial114.stderr:2026-02-24T19:17:36.972+0000 df79640 -1 osd.5 0 waiting for initial osdmap 2026-02-24T19:17:36.978 INFO:tasks.ceph.osd.7.trial194.stderr:2026-02-24T19:17:36.975+0000 df79640 -1 osd.7 0 waiting for initial osdmap 2026-02-24T19:17:36.982 INFO:tasks.ceph.osd.13.trial114.stderr:2026-02-24T19:17:36.979+0000 cf66640 -1 osd.13 0 waiting for initial osdmap 2026-02-24T19:17:36.989 INFO:tasks.ceph.osd.9.trial114.stderr:2026-02-24T19:17:36.987+0000 df79640 -1 osd.9 0 waiting for initial osdmap 2026-02-24T19:17:37.001 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-24T19:17:36.997+0000 df79640 -1 osd.12 0 waiting for initial osdmap 2026-02-24T19:17:37.007 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-24T19:17:37.003+0000 cf66640 -1 osd.4 0 waiting for initial osdmap 2026-02-24T19:17:37.009 INFO:tasks.ceph.osd.1.trial114.stderr:2026-02-24T19:17:37.005+0000 df79640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T19:17:37.013 INFO:tasks.ceph.osd.14.trial179.stderr:2026-02-24T19:17:37.009+0000 cf66640 -1 osd.14 0 waiting for initial osdmap 2026-02-24T19:17:37.024 INFO:tasks.ceph.osd.2.trial179.stderr:2026-02-24T19:17:37.022+0000 cf66640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T19:17:37.050 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-24T19:17:37.046+0000 df79640 -1 osd.8 0 waiting for initial osdmap 2026-02-24T19:17:37.164 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-24T19:17:37.155+0000 16569640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.185 INFO:tasks.ceph.osd.5.trial114.stderr:2026-02-24T19:17:37.177+0000 16969640 -1 osd.5 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.185 INFO:tasks.ceph.osd.6.trial179.stderr:2026-02-24T19:17:37.177+0000 12561640 -1 osd.6 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.186 INFO:tasks.ceph.osd.7.trial194.stderr:2026-02-24T19:17:37.178+0000 12561640 -1 osd.7 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.190 INFO:tasks.ceph.osd.13.trial114.stderr:2026-02-24T19:17:37.182+0000 16969640 -1 osd.13 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.194 INFO:tasks.ceph.osd.9.trial114.stderr:2026-02-24T19:17:37.186+0000 16569640 -1 osd.9 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.210 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-24T19:17:37.201+0000 12561640 -1 osd.4 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.214 INFO:tasks.ceph.osd.1.trial114.stderr:2026-02-24T19:17:37.207+0000 12561640 -1 osd.1 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.223 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-24T19:17:37.215+0000 16969640 -1 osd.12 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.227 INFO:tasks.ceph.osd.14.trial179.stderr:2026-02-24T19:17:37.219+0000 12561640 -1 osd.14 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.230 INFO:tasks.ceph.osd.2.trial179.stderr:2026-02-24T19:17:37.222+0000 12561640 -1 osd.2 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.255 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-24T19:17:37.246+0000 12561640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:37.912 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:37.977 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.974+0000 7ff3a0e3c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:37.977 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.974+0000 7ff3a0e3c640 10 monclient: build_initial_monmap 2026-02-24T19:17:37.977 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.974+0000 7ff3a0e3c640 10 monclient: monmap: 2026-02-24T19:17:37.977 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:37.977 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:37.977 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:17:37.975133+0000 2026-02-24T19:17:37.977 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:17:37.975133+0000 2026-02-24T19:17:37.978 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:37.978 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:37.978 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:37.978 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:37.978 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:37.978 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:37.979 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.974+0000 7ff3a0e3c640 1 Processor -- start 2026-02-24T19:17:37.979 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.974+0000 7ff3a0e3c640 1 -- start start 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.974+0000 7ff3a0e3c640 10 monclient: init 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 10 monclient(hunting): picked mon.noname-b con 0x7ff39c1603a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 10 monclient(hunting): picked mon.noname-c con 0x7ff39c056690 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 10 monclient(hunting): picked mon.noname-a con 0x7ff39c1613d0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c161850 con 0x7ff39c1613d0 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c0592d0 con 0x7ff39c1603a0 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c0595b0 con 0x7ff39c056690 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff3a0e3c640 10 monclient(hunting): authenticate will time out at 3629.614140s 2026-02-24T19:17:37.980 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff39a575640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7ff39c1603a0 0x7ff39c160770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:54980/0 (socket says 10.20.193.45:54980) 2026-02-24T19:17:37.981 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:37.975+0000 7ff39a575640 1 -- 10.20.193.45:0/3512088586 learned_addr learned my addr 10.20.193.45:0/3512088586 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:38.014 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.011+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253099574 0 0) 0x7ff38c002c90 con 0x7ff39c1613d0 2026-02-24T19:17:38.014 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.011+0000 7ff399573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.014 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.011+0000 7ff399573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.015 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.011+0000 7ff399573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.015 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.011+0000 7ff399573640 10 monclient(hunting): my global_id is 4329 2026-02-24T19:17:38.015 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.011+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff388003610 con 0x7ff39c1613d0 2026-02-24T19:17:38.015 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.012+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663280651 0 0) 0x7ff39c0592d0 con 0x7ff39c1603a0 2026-02-24T19:17:38.015 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.012+0000 7ff399573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.016 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.012+0000 7ff399573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.016 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.012+0000 7ff399573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.016 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.012+0000 7ff399573640 10 monclient(hunting): my global_id is 4327 2026-02-24T19:17:38.016 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.012+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff38c002c90 con 0x7ff39c1603a0 2026-02-24T19:17:38.022 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3789273879 0 0) 0x7ff38c002c90 con 0x7ff39c1603a0 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 >> v1:10.20.193.179:6789/0 conn(0x7ff39c056690 legacy=0x7ff39c057f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 >> v1:10.20.193.45:6789/0 conn(0x7ff39c1613d0 legacy=0x7ff39c0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 1 monclient: found mon.noname-b 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c059890 con 0x7ff39c1603a0 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 10 monclient: _finish_auth 0 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:38.023 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff390002df0 con 0x7ff39c1603a0 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff399573640 10 monclient: dump: 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:38.024 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:38.025 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:38.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff3a0e3c640 5 monclient: authenticate success, global_id 4327 2026-02-24T19:17:38.025 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.019+0000 7ff3a0e3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:38.027 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff390003000 con 0x7ff39c1603a0 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff399573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff399573640 1 -- 10.20.193.45:0/3512088586 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff390003400 con 0x7ff39c1603a0 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff399573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff399573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff399573640 10 monclient: dump: 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:38.028 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff3a0e3c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff3a0e3c640 4 set_mon_vals no callback set 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff3a0e3c640 10 monclient: shutdown 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff3a0e3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/3512088586 >> v1:10.20.193.114:6789/0 conn(0x7ff39c1603a0 legacy=0x7ff39c160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/3512088586 shutdown_connections 2026-02-24T19:17:38.029 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/3512088586 >> 10.20.193.45:0/3512088586 conn(0x7ff39c0b65f0 msgr2=0x7ff39c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/3512088586 shutdown_connections 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.020+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/3512088586 wait complete. 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 10 monclient: build_initial_monmap 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 10 monclient: monmap: 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:38.030 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 1 librados: starting msgr at 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 1 librados: starting objecter 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 1 Processor -- start 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 1 -- start start 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 1 librados: setting wanted keys 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 1 librados: calling monclient init 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.021+0000 7ff3a0e3c640 10 monclient: init 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:38.031 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 10 monclient(hunting): picked mon.noname-b con 0x7ff39c056690 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 10 monclient(hunting): picked mon.noname-c con 0x7ff39c1603a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 10 monclient(hunting): picked mon.noname-a con 0x7ff39c1613d0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c1f7930 con 0x7ff39c1613d0 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c1327b0 con 0x7ff39c056690 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c132a90 con 0x7ff39c1603a0 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff3a0e3c640 10 monclient(hunting): authenticate will time out at 3629.661223s 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff39a575640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7ff39c056690 0x7ff39c135c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:54988/0 (socket says 10.20.193.45:54988) 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.022+0000 7ff39a575640 1 -- 10.20.193.45:0/2294364512 learned_addr learned my addr 10.20.193.45:0/2294364512 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.023+0000 7ff382ffd640 10 client.?.objecter ms_handle_connect 0x7ff39c056690 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.023+0000 7ff382ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.024+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029989617 0 0) 0x7ff39c1327b0 con 0x7ff39c056690 2026-02-24T19:17:38.032 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.024+0000 7ff382ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.024+0000 7ff382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.024+0000 7ff382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.024+0000 7ff382ffd640 10 monclient(hunting): my global_id is 4330 2026-02-24T19:17:38.033 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.024+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff368003610 con 0x7ff39c056690 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.025+0000 7ff382ffd640 10 client.?.objecter ms_handle_connect 0x7ff39c1613d0 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.025+0000 7ff382ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.026+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481155144 0 0) 0x7ff39c1f7930 con 0x7ff39c1613d0 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.026+0000 7ff382ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.026+0000 7ff382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.026+0000 7ff382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.026+0000 7ff382ffd640 10 monclient(hunting): my global_id is 4332 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.026+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff39c1327b0 con 0x7ff39c1613d0 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.027+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 575355953 0 0) 0x7ff368003610 con 0x7ff39c056690 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.027+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff39c1f7930 con 0x7ff39c056690 2026-02-24T19:17:38.035 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.027+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff390002d00 con 0x7ff39c056690 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.027+0000 7ff382ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.027+0000 7ff382ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.027+0000 7ff382ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:38.036 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.027+0000 7ff382ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1493778397 0 0) 0x7ff39c1f7930 con 0x7ff39c056690 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 >> v1:10.20.193.179:6789/0 conn(0x7ff39c1603a0 legacy=0x7ff39c1f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 >> v1:10.20.193.45:6789/0 conn(0x7ff39c1613d0 legacy=0x7ff39c154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 1 monclient: found mon.b 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c132d70 con 0x7ff39c056690 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:38.037 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff382ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 5 monclient: authenticate success, global_id 4330 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 10 monclient: _renew_subs 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c133050 con 0x7ff39c056690 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 10 client.4330.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 10 monclient: _renew_subs 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff39c1323c0 con 0x7ff39c056690 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 1 librados: init done 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:38.038 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.029+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39c1370d0 con 0x7ff39c056690 2026-02-24T19:17:38.041 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.038+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff390002f10 con 0x7ff39c056690 2026-02-24T19:17:38.041 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.038+0000 7ff382ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.038+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff390004d20 con 0x7ff39c056690 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.038+0000 7ff382ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.038+0000 7ff382ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.038+0000 7ff398d72640 4 set_mon_vals no callback set 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.038+0000 7ff382ffd640 10 monclient: dump: 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:38.042 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:38.043 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:38.043 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:38.043 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:38.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.039+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 4245508662 0 0) 0x7ff390004f00 con 0x7ff39c056690 2026-02-24T19:17:38.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.040+0000 7ff399d74640 10 monclient: get_auth_request con 0x7ff368077d10 auth_method 0 2026-02-24T19:17:38.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.040+0000 7ff382ffd640 10 client.4330.objecter ms_handle_connect 0x7ff368077d10 2026-02-24T19:17:38.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.041+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 6808+0+0 (unknown 352937049 0 0) 0x7ff390092e80 con 0x7ff39c056690 2026-02-24T19:17:38.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.041+0000 7ff382ffd640 10 client.4330.objecter ms_dispatch2 0x7ff39c000b90 osd_map(21..21 src has 1..21) 2026-02-24T19:17:38.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.041+0000 7ff382ffd640 3 client.4330.objecter handle_osd_map got epochs [21,21] > 0 2026-02-24T19:17:38.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.041+0000 7ff382ffd640 3 client.4330.objecter handle_osd_map decoding full epoch 21 2026-02-24T19:17:38.044 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.041+0000 7ff382ffd640 20 client.4330.objecter dump_active .. 0 homeless 2026-02-24T19:17:38.066 INFO:tasks.ceph.osd.11.trial194.stderr:2026-02-24T19:17:38.063+0000 cf66640 -1 osd.11 0 waiting for initial osdmap 2026-02-24T19:17:38.066 INFO:tasks.ceph.osd.3.trial194.stderr:2026-02-24T19:17:38.063+0000 cf66640 -1 osd.3 0 waiting for initial osdmap 2026-02-24T19:17:38.079 INFO:tasks.ceph.osd.15.trial194.stderr:2026-02-24T19:17:38.074+0000 df79640 -1 osd.15 0 waiting for initial osdmap 2026-02-24T19:17:38.088 INFO:tasks.ceph.osd.10.trial179.stderr:2026-02-24T19:17:38.085+0000 cf66640 -1 osd.10 0 waiting for initial osdmap 2026-02-24T19:17:38.136 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.133+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff39005dd50 con 0x7ff39c056690 2026-02-24T19:17:38.136 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.133+0000 7ff382ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:38.137 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.133+0000 7ff382ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:38.248 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.246+0000 7ff3a0e3c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:38.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.246+0000 7ff3a0e3c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:38.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.246+0000 7ff3a0e3c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:38.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.246+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff39c136df0 con 0x7ff39c056690 2026-02-24T19:17:38.258 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.255+0000 7ff382ffd640 1 -- 10.20.193.45:0/2294364512 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+15764 (unknown 898900276 0 2026851336) 0x7ff39005d650 con 0x7ff39c056690 2026-02-24T19:17:38.258 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.255+0000 7ff382ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:38.258 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.255+0000 7ff382ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:38.258 INFO:teuthology.misc.health.trial045.stdout: 2026-02-24T19:17:38.258 INFO:teuthology.misc.health.trial045.stdout:{"epoch":21,"fsid":"738dd6f3-d81f-41eb-89dc-068883b21f11","created":"2026-02-24T19:17:05.025851+0000","modified":"2026-02-24T19:17:37.817882+0000","last_up_change":"2026-02-24T19:17:37.817882+0000","last_in_change":"2026-02-24T19:17:11.992117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"53650ce1-deec-4943-ba8b-cdf389f4e5e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":3544790624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":3544790624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":3544790624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":3544790624}]},"public_addr":"10.20.193.45:6805/3544790624","cluster_addr":"10.20.193.45:6806/3544790624","heartbeat_back_addr":"10.20.193.45:6808/3544790624","heartbeat_front_addr":"10.20.193.45:6807/3544790624","state":["exists","up"]},{"osd":1,"uuid":"e3d2506e-9e10-4206-96d1-3dd8aa4d91cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6808","nonce":1876170727}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6809","nonce":1876170727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6811","nonce":1876170727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6810","nonce":1876170727}]},"public_addr":"10.20.193.114:6808/1876170727","cluster_addr":"10.20.193.114:6809/1876170727","heartbeat_back_addr":"10.20.193.114:6811/1876170727","heartbeat_front_addr":"10.20.193.114:6810/1876170727","state":["exists","up"]},{"osd":2,"uuid":"2fe7f095-bf74-4e4a-996c-c58438826e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6800","nonce":3913807646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6801","nonce":3913807646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6803","nonce":3913807646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6802","nonce":3913807646}]},"public_addr":"10.20.193.179:6800/3913807646","cluster_addr":"10.20.193.179:6801/3913807646","heartbeat_back_addr":"10.20.193.179:6803/3913807646","heartbeat_front_addr":"10.20.193.179:6802/3913807646","state":["exists","up"]},{"osd":3,"uuid":"270148b3-6c77-4c1f-9d73-05d1c75990c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43b91f27-e730-4a81-a86b-b2fefdddd3e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1236941460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":1236941460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":1236941460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1236941460}]},"public_addr":"10.20.193.45:6801/1236941460","cluster_addr":"10.20.193.45:6802/1236941460","heartbeat_back_addr":"10.20.193.45:6804/1236941460","heartbeat_front_addr":"10.20.193.45:6803/1236941460","state":["exists","up"]},{"osd":5,"uuid":"01c901c8-775a-4e42-b73a-5db3d938dbb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6804","nonce":3576632251}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6805","nonce":3576632251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6807","nonce":3576632251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6806","nonce":3576632251}]},"public_addr":"10.20.193.114:6804/3576632251","cluster_addr":"10.20.193.114:6805/3576632251","heartbeat_back_addr":"10.20.193.114:6807/3576632251","heartbeat_front_addr":"10.20.193.114:6806/3576632251","state":["exists","up"]},{"osd":6,"uuid":"b29d58d3-b5f9-428c-8246-910655dd5490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6804","nonce":1928709825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6805","nonce":1928709825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6807","nonce":1928709825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6806","nonce":1928709825}]},"public_addr":"10.20.193.179:6804/1928709825","cluster_addr":"10.20.193.179:6805/1928709825","heartbeat_back_addr":"10.20.193.179:6807/1928709825","heartbeat_front_addr":"10.20.193.179:6806/1928709825","state":["exists","up"]},{"osd":7,"uuid":"f182ac9b-e6ee-461e-af0c-0ef4ef51c737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6800","nonce":598300563}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6801","nonce":598300563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6803","nonce":598300563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6802","nonce":598300563}]},"public_addr":"10.20.193.194:6800/598300563","cluster_addr":"10.20.193.194:6801/598300563","heartbeat_back_addr":"10.20.193.194:6803/598300563","heartbeat_front_addr":"10.20.193.194:6802/598300563","state":["exists","up"]},{"osd":8,"uuid":"b812d673-950b-4168-9a5e-d3719d569a7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":1756229077}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":1756229077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6812","nonce":1756229077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":1756229077}]},"public_addr":"10.20.193.45:6809/1756229077","cluster_addr":"10.20.193.45:6810/1756229077","heartbeat_back_addr":"10.20.193.45:6812/1756229077","heartbeat_front_addr":"10.20.193.45:6811/1756229077","state":["exists","up"]},{"osd":9,"uuid":"442018bc-d405-49b3-8934-0ab83b4613eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6800","nonce":2864194603}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6801","nonce":2864194603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6803","nonce":2864194603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6802","nonce":2864194603}]},"public_addr":"10.20.193.114:6800/2864194603","cluster_addr":"10.20.193.114:6801/2864194603","heartbeat_back_addr":"10.20.193.114:6803/2864194603","heartbeat_front_addr":"10.20.193.114:6802/2864194603","state":["exists","up"]},{"osd":10,"uuid":"e5bf8aa9-8c19-494b-bd7a-c5da71af847b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"6cb63f95-82e0-483f-926b-94a88b3c54f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"b15b2174-466b-4e9a-9c6d-ed8caabe7b28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6813","nonce":2990889504}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6814","nonce":2990889504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6816","nonce":2990889504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6815","nonce":2990889504}]},"public_addr":"10.20.193.45:6813/2990889504","cluster_addr":"10.20.193.45:6814/2990889504","heartbeat_back_addr":"10.20.193.45:6816/2990889504","heartbeat_front_addr":"10.20.193.45:6815/2990889504","state":["exists","up"]},{"osd":13,"uuid":"d4e5150e-a985-488e-a911-45bf3431c165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6812","nonce":3533295890}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6813","nonce":3533295890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6815","nonce":3533295890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6814","nonce":3533295890}]},"public_addr":"10.20.193.114:6812/3533295890","cluster_addr":"10.20.193.114:6813/3533295890","heartbeat_back_addr":"10.20.193.114:6815/3533295890","heartbeat_front_addr":"10.20.193.114:6814/3533295890","state":["exists","up"]},{"osd":14,"uuid":"0d938446-8802-44bc-be90-db79361a5200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6812","nonce":1196591242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6813","nonce":1196591242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6815","nonce":1196591242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6814","nonce":1196591242}]},"public_addr":"10.20.193.179:6812/1196591242","cluster_addr":"10.20.193.179:6813/1196591242","heartbeat_back_addr":"10.20.193.179:6815/1196591242","heartbeat_front_addr":"10.20.193.179:6814/1196591242","state":["exists","up"]},{"osd":15,"uuid":"168bd4e0-e43c-4581-819c-9ed544805d2f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:38.260 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.256+0000 7ff3a0e3c640 10 librados: watch_flush enter 2026-02-24T19:17:38.260 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.256+0000 7ff3a0e3c640 10 librados: watch_flush exit 2026-02-24T19:17:38.260 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.256+0000 7ff3a0e3c640 20 client.4330.objecter shutdown clearing up homeless session... 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.256+0000 7ff3a0e3c640 10 client.4330.objecter successfully canceled tick 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.257+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 >> v1:10.20.193.45:6800/1599977652 conn(0x7ff368077d10 legacy=0x7ff3680981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.257+0000 7ff3a0e3c640 10 monclient: shutdown 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.257+0000 7ff3a0e3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.257+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 >> v1:10.20.193.114:6789/0 conn(0x7ff39c056690 legacy=0x7ff39c135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.257+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 shutdown_connections 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.257+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 >> 10.20.193.45:0/2294364512 conn(0x7ff39c0b65f0 msgr2=0x7ff39c160770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.257+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 shutdown_connections 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.257+0000 7ff3a0e3c640 1 -- 10.20.193.45:0/2294364512 wait complete. 2026-02-24T19:17:38.261 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:38.257+0000 7ff3a0e3c640 1 librados: shutdown 2026-02-24T19:17:38.267 DEBUG:teuthology.misc:12 of 16 OSDs are up 2026-02-24T19:17:38.311 INFO:tasks.ceph.osd.11.trial194.stderr:2026-02-24T19:17:38.303+0000 12561640 -1 osd.11 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:38.340 INFO:tasks.ceph.osd.15.trial194.stderr:2026-02-24T19:17:38.333+0000 16969640 -1 osd.15 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:38.344 INFO:tasks.ceph.osd.10.trial179.stderr:2026-02-24T19:17:38.336+0000 16969640 -1 osd.10 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:38.354 INFO:tasks.ceph.osd.3.trial194.stderr:2026-02-24T19:17:38.347+0000 12561640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:45.880 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:45.942 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.937+0000 7f7ebeb10640 10 monclient: get_monmap_and_config 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.937+0000 7f7ebeb10640 10 monclient: build_initial_monmap 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.937+0000 7f7ebeb10640 10 monclient: monmap: 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:17:45.938446+0000 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:17:45.938446+0000 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:45.943 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.937+0000 7f7ebeb10640 1 Processor -- start 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.937+0000 7f7ebeb10640 1 -- start start 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.937+0000 7f7ebeb10640 10 monclient: init 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 10 monclient(hunting): picked mon.noname-b con 0x7f7eb8058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 10 monclient(hunting): picked mon.noname-c con 0x7f7eb80b0410 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 10 monclient(hunting): picked mon.noname-a con 0x7f7eb81626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:45.944 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb81655c0 con 0x7f7eb81626a0 2026-02-24T19:17:45.945 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb80b12b0 con 0x7f7eb8058da0 2026-02-24T19:17:45.945 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb80b1590 con 0x7f7eb80b0410 2026-02-24T19:17:45.945 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:45.945 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebeb10640 10 monclient(hunting): authenticate will time out at 3637.577359s 2026-02-24T19:17:45.945 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebc885640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f7eb8058da0 0x7f7eb81647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:43304/0 (socket says 10.20.193.45:43304) 2026-02-24T19:17:45.945 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.938+0000 7f7ebc885640 1 -- 10.20.193.45:0/3440847989 learned_addr learned my addr 10.20.193.45:0/3440847989 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:45.954 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316286911 0 0) 0x7f7eb81655c0 con 0x7f7eb81626a0 2026-02-24T19:17:45.954 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): my global_id is 4341 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ea4003610 con 0x7f7eb81626a0 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735373495 0 0) 0x7f7eb80b12b0 con 0x7f7eb8058da0 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): my global_id is 4339 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb81655c0 con 0x7f7eb8058da0 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77588482 0 0) 0x7f7eb80b1590 con 0x7f7eb80b0410 2026-02-24T19:17:45.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 10 monclient(hunting): my global_id is 4346 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.940+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb80b12b0 con 0x7f7eb80b0410 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1244265313 0 0) 0x7f7ea4003610 con 0x7f7eb81626a0 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 >> v1:10.20.193.179:6789/0 conn(0x7f7eb80b0410 legacy=0x7f7eb8164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 >> v1:10.20.193.114:6789/0 conn(0x7f7eb8058da0 legacy=0x7f7eb81647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 1 monclient: found mon.noname-a 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:45.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb80b1870 con 0x7f7eb81626a0 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7eb4003170 con 0x7f7eb81626a0 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7eaf7fe640 10 monclient: dump: 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.957 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7ebeb10640 5 monclient: authenticate success, global_id 4341 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.942+0000 7f7ebeb10640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7eb4003340 con 0x7f7eb81626a0 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7eaf7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7eaf7fe640 1 -- 10.20.193.45:0/3440847989 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7eb4003780 con 0x7f7eb81626a0 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7ebeb10640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:45.958 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7ebeb10640 4 set_mon_vals no callback set 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7eaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7eaf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7eaf7fe640 10 monclient: dump: 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:45.959 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7ebeb10640 10 monclient: shutdown 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7ebeb10640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7ebeb10640 1 -- 10.20.193.45:0/3440847989 >> v1:10.20.193.45:6789/0 conn(0x7f7eb81626a0 legacy=0x7f7eb81c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7ebeb10640 1 -- 10.20.193.45:0/3440847989 shutdown_connections 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7ebeb10640 1 -- 10.20.193.45:0/3440847989 >> 10.20.193.45:0/3440847989 conn(0x7f7eb80b65f0 msgr2=0x7f7eb80b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7ebeb10640 1 -- 10.20.193.45:0/3440847989 shutdown_connections 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.943+0000 7f7ebeb10640 1 -- 10.20.193.45:0/3440847989 wait complete. 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient: build_initial_monmap 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient: monmap: 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:45.960 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 1 librados: starting msgr at 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 1 librados: starting objecter 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 1 Processor -- start 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 1 -- start start 2026-02-24T19:17:45.961 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 1 librados: setting wanted keys 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 1 librados: calling monclient init 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient: init 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient(hunting): picked mon.noname-b con 0x7f7eb8058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient(hunting): picked mon.noname-a con 0x7f7eb80b0410 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient(hunting): picked mon.noname-c con 0x7f7eb81626a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb80abd30 con 0x7f7eb80b0410 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb80ac010 con 0x7f7eb8058da0 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eb80ac2f0 con 0x7f7eb81626a0 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:45.962 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.944+0000 7f7ebeb10640 10 monclient(hunting): authenticate will time out at 3637.583807s 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.945+0000 7f7eaffff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f7eb80b0410 0x7f7eb81fe750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:36658/0 (socket says 10.20.193.45:36658) 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.945+0000 7f7eaffff640 1 -- 10.20.193.45:0/183955995 learned_addr learned my addr 10.20.193.45:0/183955995 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.945+0000 7f7ead7fa640 10 client.?.objecter ms_handle_connect 0x7f7eb80b0410 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.945+0000 7f7ead7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.945+0000 7f7ead7fa640 10 client.?.objecter ms_handle_connect 0x7f7eb8058da0 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.945+0000 7f7ead7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.945+0000 7f7ead7fa640 10 client.?.objecter ms_handle_connect 0x7f7eb81626a0 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.945+0000 7f7ead7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255274532 0 0) 0x7f7eb80abd30 con 0x7f7eb80b0410 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:45.963 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): my global_id is 4344 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e88003610 con 0x7f7eb80b0410 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802546376 0 0) 0x7f7eb80ac010 con 0x7f7eb8058da0 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): my global_id is 4342 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb80abd30 con 0x7f7eb8058da0 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168558383 0 0) 0x7f7eb80ac2f0 con 0x7f7eb81626a0 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:45.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 10 monclient(hunting): my global_id is 4349 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.946+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb80ac010 con 0x7f7eb81626a0 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2856596443 0 0) 0x7f7e88003610 con 0x7f7eb80b0410 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7eb80ac2f0 con 0x7f7eb80b0410 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7ea0003170 con 0x7f7eb80b0410 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 10 monclient(hunting): dump: 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:45.965 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1264254048 0 0) 0x7f7eb80abd30 con 0x7f7eb8058da0 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7e88003610 con 0x7f7eb8058da0 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7ea80030b0 con 0x7f7eb8058da0 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:45.966 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.948+0000 7f7ead7fa640 10 monclient(hunting): dump: 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.949+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3534857445 0 0) 0x7f7eb80ac010 con 0x7f7eb81626a0 2026-02-24T19:17:45.967 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.949+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7eb80abd30 con 0x7f7eb81626a0 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.949+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7eb40034f0 con 0x7f7eb81626a0 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.949+0000 7f7ead7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.949+0000 7f7ead7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.949+0000 7f7ead7fa640 10 monclient(hunting): dump: 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:45.968 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2755771761 0 0) 0x7f7eb80ac2f0 con 0x7f7eb80b0410 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 >> v1:10.20.193.179:6789/0 conn(0x7f7eb81626a0 legacy=0x7f7eb80af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 >> v1:10.20.193.114:6789/0 conn(0x7f7eb8058da0 legacy=0x7f7eb815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 1 monclient: found mon.a 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb80ac5d0 con 0x7f7eb80b0410 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ead7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:45.969 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 5 monclient: authenticate success, global_id 4344 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 10 monclient: _renew_subs 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb80acd10 con 0x7f7eb80b0410 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 10 client.4344.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 10 monclient: _renew_subs 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7eb81fee60 con 0x7f7eb80b0410 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 1 librados: init done 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:45.970 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:45.950+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb81fe370 con 0x7f7eb80b0410 2026-02-24T19:17:46.085 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.082+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ea0003310 con 0x7f7eb80b0410 2026-02-24T19:17:46.085 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.082+0000 7f7ead7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:46.085 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.082+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7ea0003b50 con 0x7f7eb80b0410 2026-02-24T19:17:46.085 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.082+0000 7f7ead7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.082+0000 7f7ead7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.082+0000 7f7eaeffd640 4 set_mon_vals no callback set 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.082+0000 7f7ead7fa640 10 monclient: dump: 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 3 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:46.086 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:46.087 INFO:teuthology.misc.health.trial045.stderr: 2026-02-24T19:17:46.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.082+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f7ea0003d30 con 0x7f7eb80b0410 2026-02-24T19:17:46.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.083+0000 7f7ebc885640 10 monclient: get_auth_request con 0x7f7e88077e70 auth_method 0 2026-02-24T19:17:46.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.083+0000 7f7ead7fa640 10 client.4344.objecter ms_handle_connect 0x7f7e88077e70 2026-02-24T19:17:46.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.085+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 7757+0+0 (unknown 3002991106 0 0) 0x7f7ea0093410 con 0x7f7eb80b0410 2026-02-24T19:17:46.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.085+0000 7f7ead7fa640 10 client.4344.objecter ms_dispatch2 0x7f7eb8000b90 osd_map(25..25 src has 1..25) 2026-02-24T19:17:46.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.085+0000 7f7ead7fa640 3 client.4344.objecter handle_osd_map got epochs [25,25] > 0 2026-02-24T19:17:46.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.085+0000 7f7ead7fa640 3 client.4344.objecter handle_osd_map decoding full epoch 25 2026-02-24T19:17:46.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.085+0000 7f7ead7fa640 20 client.4344.objecter dump_active .. 0 homeless 2026-02-24T19:17:46.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.085+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7ea005de40 con 0x7f7eb80b0410 2026-02-24T19:17:46.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.085+0000 7f7ead7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:46.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.085+0000 7f7ead7fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:46.197 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.194+0000 7f7ebeb10640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:46.197 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.194+0000 7f7ebeb10640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:46.197 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.194+0000 7f7ebeb10640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:46.198 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.194+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7eb815ebd0 con 0x7f7eb80b0410 2026-02-24T19:17:46.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.233+0000 7f7ead7fa640 1 -- 10.20.193.45:0/183955995 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18989 (unknown 780366164 0 2158239616) 0x7f7ea005d740 con 0x7f7eb80b0410 2026-02-24T19:17:46.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.233+0000 7f7ead7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:46.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.233+0000 7f7ead7fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:46.237 INFO:teuthology.misc.health.trial045.stdout: 2026-02-24T19:17:46.237 INFO:teuthology.misc.health.trial045.stdout:{"epoch":25,"fsid":"738dd6f3-d81f-41eb-89dc-068883b21f11","created":"2026-02-24T19:17:05.025851+0000","modified":"2026-02-24T19:17:42.125426+0000","last_up_change":"2026-02-24T19:17:38.901135+0000","last_in_change":"2026-02-24T19:17:11.992117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:39.816057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53650ce1-deec-4943-ba8b-cdf389f4e5e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":3544790624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":3544790624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":3544790624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":3544790624}]},"public_addr":"10.20.193.45:6805/3544790624","cluster_addr":"10.20.193.45:6806/3544790624","heartbeat_back_addr":"10.20.193.45:6808/3544790624","heartbeat_front_addr":"10.20.193.45:6807/3544790624","state":["exists","up"]},{"osd":1,"uuid":"e3d2506e-9e10-4206-96d1-3dd8aa4d91cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6808","nonce":1876170727}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6809","nonce":1876170727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6811","nonce":1876170727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6810","nonce":1876170727}]},"public_addr":"10.20.193.114:6808/1876170727","cluster_addr":"10.20.193.114:6809/1876170727","heartbeat_back_addr":"10.20.193.114:6811/1876170727","heartbeat_front_addr":"10.20.193.114:6810/1876170727","state":["exists","up"]},{"osd":2,"uuid":"2fe7f095-bf74-4e4a-996c-c58438826e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6800","nonce":3913807646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6801","nonce":3913807646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6803","nonce":3913807646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6802","nonce":3913807646}]},"public_addr":"10.20.193.179:6800/3913807646","cluster_addr":"10.20.193.179:6801/3913807646","heartbeat_back_addr":"10.20.193.179:6803/3913807646","heartbeat_front_addr":"10.20.193.179:6802/3913807646","state":["exists","up"]},{"osd":3,"uuid":"270148b3-6c77-4c1f-9d73-05d1c75990c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6804","nonce":3920278128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6805","nonce":3920278128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6807","nonce":3920278128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6806","nonce":3920278128}]},"public_addr":"10.20.193.194:6804/3920278128","cluster_addr":"10.20.193.194:6805/3920278128","heartbeat_back_addr":"10.20.193.194:6807/3920278128","heartbeat_front_addr":"10.20.193.194:6806/3920278128","state":["exists","up"]},{"osd":4,"uuid":"43b91f27-e730-4a81-a86b-b2fefdddd3e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1236941460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":1236941460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":1236941460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1236941460}]},"public_addr":"10.20.193.45:6801/1236941460","cluster_addr":"10.20.193.45:6802/1236941460","heartbeat_back_addr":"10.20.193.45:6804/1236941460","heartbeat_front_addr":"10.20.193.45:6803/1236941460","state":["exists","up"]},{"osd":5,"uuid":"01c901c8-775a-4e42-b73a-5db3d938dbb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6804","nonce":3576632251}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6805","nonce":3576632251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6807","nonce":3576632251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6806","nonce":3576632251}]},"public_addr":"10.20.193.114:6804/3576632251","cluster_addr":"10.20.193.114:6805/3576632251","heartbeat_back_addr":"10.20.193.114:6807/3576632251","heartbeat_front_addr":"10.20.193.114:6806/3576632251","state":["exists","up"]},{"osd":6,"uuid":"b29d58d3-b5f9-428c-8246-910655dd5490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6804","nonce":1928709825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6805","nonce":1928709825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6807","nonce":1928709825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6806","nonce":1928709825}]},"public_addr":"10.20.193.179:6804/1928709825","cluster_addr":"10.20.193.179:6805/1928709825","heartbeat_back_addr":"10.20.193.179:6807/1928709825","heartbeat_front_addr":"10.20.193.179:6806/1928709825","state":["exists","up"]},{"osd":7,"uuid":"f182ac9b-e6ee-461e-af0c-0ef4ef51c737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6800","nonce":598300563}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6801","nonce":598300563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6803","nonce":598300563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6802","nonce":598300563}]},"public_addr":"10.20.193.194:6800/598300563","cluster_addr":"10.20.193.194:6801/598300563","heartbeat_back_addr":"10.20.193.194:6803/598300563","heartbeat_front_addr":"10.20.193.194:6802/598300563","state":["exists","up"]},{"osd":8,"uuid":"b812d673-950b-4168-9a5e-d3719d569a7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":1756229077}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":1756229077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6812","nonce":1756229077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":1756229077}]},"public_addr":"10.20.193.45:6809/1756229077","cluster_addr":"10.20.193.45:6810/1756229077","heartbeat_back_addr":"10.20.193.45:6812/1756229077","heartbeat_front_addr":"10.20.193.45:6811/1756229077","state":["exists","up"]},{"osd":9,"uuid":"442018bc-d405-49b3-8934-0ab83b4613eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6800","nonce":2864194603}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6801","nonce":2864194603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6803","nonce":2864194603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6802","nonce":2864194603}]},"public_addr":"10.20.193.114:6800/2864194603","cluster_addr":"10.20.193.114:6801/2864194603","heartbeat_back_addr":"10.20.193.114:6803/2864194603","heartbeat_front_addr":"10.20.193.114:6802/2864194603","state":["exists","up"]},{"osd":10,"uuid":"e5bf8aa9-8c19-494b-bd7a-c5da71af847b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6808","nonce":2982984950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6809","nonce":2982984950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6811","nonce":2982984950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6810","nonce":2982984950}]},"public_addr":"10.20.193.179:6808/2982984950","cluster_addr":"10.20.193.179:6809/2982984950","heartbeat_back_addr":"10.20.193.179:6811/2982984950","heartbeat_front_addr":"10.20.193.179:6810/2982984950","state":["exists","up"]},{"osd":11,"uuid":"6cb63f95-82e0-483f-926b-94a88b3c54f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6812","nonce":1154629099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6813","nonce":1154629099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6815","nonce":1154629099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6814","nonce":1154629099}]},"public_addr":"10.20.193.194:6812/1154629099","cluster_addr":"10.20.193.194:6813/1154629099","heartbeat_back_addr":"10.20.193.194:6815/1154629099","heartbeat_front_addr":"10.20.193.194:6814/1154629099","state":["exists","up"]},{"osd":12,"uuid":"b15b2174-466b-4e9a-9c6d-ed8caabe7b28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6813","nonce":2990889504}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6814","nonce":2990889504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6816","nonce":2990889504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6815","nonce":2990889504}]},"public_addr":"10.20.193.45:6813/2990889504","cluster_addr":"10.20.193.45:6814/2990889504","heartbeat_back_addr":"10.20.193.45:6816/2990889504","heartbeat_front_addr":"10.20.193.45:6815/2990889504","state":["exists","up"]},{"osd":13,"uuid":"d4e5150e-a985-488e-a911-45bf3431c165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6812","nonce":3533295890}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6813","nonce":3533295890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6815","nonce":3533295890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6814","nonce":3533295890}]},"public_addr":"10.20.193.114:6812/3533295890","cluster_addr":"10.20.193.114:6813/3533295890","heartbeat_back_addr":"10.20.193.114:6815/3533295890","heartbeat_front_addr":"10.20.193.114:6814/3533295890","state":["exists","up"]},{"osd":14,"uuid":"0d938446-8802-44bc-be90-db79361a5200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6812","nonce":1196591242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6813","nonce":1196591242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6815","nonce":1196591242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6814","nonce":1196591242}]},"public_addr":"10.20.193.179:6812/1196591242","cluster_addr":"10.20.193.179:6813/1196591242","heartbeat_back_addr":"10.20.193.179:6815/1196591242","heartbeat_front_addr":"10.20.193.179:6814/1196591242","state":["exists","up"]},{"osd":15,"uuid":"168bd4e0-e43c-4581-819c-9ed544805d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6808","nonce":4057136445}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6809","nonce":4057136445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6811","nonce":4057136445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6810","nonce":4057136445}]},"public_addr":"10.20.193.194:6808/4057136445","cluster_addr":"10.20.193.194:6809/4057136445","heartbeat_back_addr":"10.20.193.194:6811/4057136445","heartbeat_front_addr":"10.20.193.194:6810/4057136445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.220980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.228412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.338875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.688002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.014119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.286056+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.427234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.631440+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.219386+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.261939+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.709299+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.693747+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.443973+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.370797+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.581997+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.896088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:46.239 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 10 librados: watch_flush enter 2026-02-24T19:17:46.239 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 10 librados: watch_flush exit 2026-02-24T19:17:46.239 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 20 client.4344.objecter shutdown clearing up homeless session... 2026-02-24T19:17:46.239 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 10 client.4344.objecter successfully canceled tick 2026-02-24T19:17:46.239 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 >> v1:10.20.193.45:6800/1599977652 conn(0x7f7e88077e70 legacy=0x7f7e88098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.239 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 10 monclient: shutdown 2026-02-24T19:17:46.239 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:46.240 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 >> v1:10.20.193.45:6789/0 conn(0x7f7eb80b0410 legacy=0x7f7eb81fe750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.240 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 shutdown_connections 2026-02-24T19:17:46.240 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 >> 10.20.193.45:0/183955995 conn(0x7f7eb80b65f0 msgr2=0x7f7eb8162b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:46.240 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 shutdown_connections 2026-02-24T19:17:46.240 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 1 -- 10.20.193.45:0/183955995 wait complete. 2026-02-24T19:17:46.240 INFO:teuthology.misc.health.trial045.stderr:2026-02-24T19:17:46.235+0000 7f7ebeb10640 1 librados: shutdown 2026-02-24T19:17:46.247 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-24T19:17:46.247 INFO:tasks.ceph:Creating RBD pool 2026-02-24T19:17:46.247 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-24T19:17:46.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.308+0000 7fae571ac640 10 monclient: get_monmap_and_config 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.308+0000 7fae571ac640 10 monclient: build_initial_monmap 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.308+0000 7fae571ac640 10 monclient: monmap: 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:46.309865+0000 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:46.309865+0000 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:46.312 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:46.313 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:46.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.309+0000 7fae571ac640 1 Processor -- start 2026-02-24T19:17:46.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.309+0000 7fae571ac640 1 -- start start 2026-02-24T19:17:46.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.309+0000 7fae571ac640 10 monclient: init 2026-02-24T19:17:46.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:46.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:46.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 10 monclient(hunting): picked mon.noname-c con 0x7fae5015afd0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:46.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 10 monclient(hunting): picked mon.noname-a con 0x7fae5015b3a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:46.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 10 monclient(hunting): picked mon.noname-b con 0x7fae50162760 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:46.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5005e100 con 0x7fae5015b3a0 2026-02-24T19:17:46.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae500b1820 con 0x7fae50162760 2026-02-24T19:17:46.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae500b1b00 con 0x7fae5015afd0 2026-02-24T19:17:46.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:46.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae571ac640 10 monclient(hunting): authenticate will time out at 3637.949191s 2026-02-24T19:17:46.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae55722640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fae50162760 0x7fae50164480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:43314/0 (socket says 10.20.193.45:43314) 2026-02-24T19:17:46.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.310+0000 7fae55722640 1 -- 10.20.193.45:0/1075065130 learned_addr learned my addr 10.20.193.45:0/1075065130 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:46.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.317+0000 7fae477fe640 1 -- 10.20.193.45:0/1075065130 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1538112584 0 0) 0x7fae5005e100 con 0x7fae5015b3a0 2026-02-24T19:17:46.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.317+0000 7fae477fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:46.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.317+0000 7fae477fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:46.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.317+0000 7fae477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:46.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.317+0000 7fae477fe640 10 monclient(hunting): my global_id is 4347 2026-02-24T19:17:46.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.317+0000 7fae477fe640 1 -- 10.20.193.45:0/1075065130 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae3c003610 con 0x7fae5015b3a0 2026-02-24T19:17:46.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 1 -- 10.20.193.45:0/1075065130 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1026592992 0 0) 0x7fae3c003610 con 0x7fae5015b3a0 2026-02-24T19:17:46.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 1 -- 10.20.193.45:0/1075065130 >> v1:10.20.193.179:6789/0 conn(0x7fae5015afd0 legacy=0x7fae50059be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 1 -- 10.20.193.45:0/1075065130 >> v1:10.20.193.114:6789/0 conn(0x7fae50162760 legacy=0x7fae50164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:46.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 1 monclient: found mon.noname-a 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 1 -- 10.20.193.45:0/1075065130 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae500b1de0 con 0x7fae5015b3a0 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 1 -- 10.20.193.45:0/1075065130 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fae38002df0 con 0x7fae5015b3a0 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae477fe640 10 monclient: dump: 2026-02-24T19:17:46.324 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae571ac640 5 monclient: authenticate success, global_id 4347 2026-02-24T19:17:46.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.319+0000 7fae571ac640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:46.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae477fe640 1 -- 10.20.193.45:0/1075065130 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae38003000 con 0x7fae5015b3a0 2026-02-24T19:17:46.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae477fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:46.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae477fe640 1 -- 10.20.193.45:0/1075065130 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fae38003440 con 0x7fae5015b3a0 2026-02-24T19:17:46.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae477fe640 10 monclient: dump: 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:46.329 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 4 set_mon_vals no callback set 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 10 monclient: shutdown 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 1 -- 10.20.193.45:0/1075065130 >> v1:10.20.193.45:6789/0 conn(0x7fae5015b3a0 legacy=0x7fae5005d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 1 -- 10.20.193.45:0/1075065130 shutdown_connections 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 1 -- 10.20.193.45:0/1075065130 >> 10.20.193.45:0/1075065130 conn(0x7fae500b2f10 msgr2=0x7fae500b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 1 -- 10.20.193.45:0/1075065130 shutdown_connections 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 1 -- 10.20.193.45:0/1075065130 wait complete. 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 10 monclient: build_initial_monmap 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.321+0000 7fae571ac640 10 monclient: monmap: 2026-02-24T19:17:46.330 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 1 librados: starting msgr at 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 1 librados: starting objecter 2026-02-24T19:17:46.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 1 Processor -- start 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 1 -- start start 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 1 librados: setting wanted keys 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 1 librados: calling monclient init 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 10 monclient: init 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 10 monclient(hunting): picked mon.noname-b con 0x7fae5015afd0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 10 monclient(hunting): picked mon.noname-a con 0x7fae5015b3a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 10 monclient(hunting): picked mon.noname-c con 0x7fae50162760 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae500b0430 con 0x7fae5015b3a0 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae500576c0 con 0x7fae5015afd0 2026-02-24T19:17:46.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae500af5d0 con 0x7fae50162760 2026-02-24T19:17:46.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:46.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.322+0000 7fae571ac640 10 monclient(hunting): authenticate will time out at 3637.961552s 2026-02-24T19:17:46.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.323+0000 7fae47fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fae5015b3a0 0x7fae50137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:36692/0 (socket says 10.20.193.45:36692) 2026-02-24T19:17:46.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.323+0000 7fae47fff640 1 -- 10.20.193.45:0/3940303136 learned_addr learned my addr 10.20.193.45:0/3940303136 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:46.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.325+0000 7fae457fa640 10 client.?.objecter ms_handle_connect 0x7fae5015b3a0 2026-02-24T19:17:46.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.325+0000 7fae457fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:46.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.326+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855811395 0 0) 0x7fae500b0430 con 0x7fae5015b3a0 2026-02-24T19:17:46.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.326+0000 7fae457fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:46.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.326+0000 7fae457fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:46.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.326+0000 7fae457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:46.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.326+0000 7fae457fa640 10 monclient(hunting): my global_id is 4353 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.326+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae20003610 con 0x7fae5015b3a0 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.329+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2861209851 0 0) 0x7fae20003610 con 0x7fae5015b3a0 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.329+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae500b0430 con 0x7fae5015b3a0 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.329+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fae38003390 con 0x7fae5015b3a0 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.329+0000 7fae457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.330+0000 7fae457fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.330+0000 7fae457fa640 10 monclient(hunting): dump: 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.335 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:46.336 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:46.336 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:46.336 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:46.336 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:46.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.330+0000 7fae457fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:46.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3755270345 0 0) 0x7fae500b0430 con 0x7fae5015b3a0 2026-02-24T19:17:46.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 >> v1:10.20.193.179:6789/0 conn(0x7fae50162760 legacy=0x7fae50158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 >> v1:10.20.193.114:6789/0 conn(0x7fae5015afd0 legacy=0x7fae50056fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:46.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 1 monclient: found mon.a 2026-02-24T19:17:46.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:46.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae500af8b0 con 0x7fae5015b3a0 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae571ac640 5 monclient: authenticate success, global_id 4353 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae571ac640 10 monclient: _renew_subs 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae571ac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae500afb90 con 0x7fae5015b3a0 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae571ac640 10 client.4353.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae571ac640 10 monclient: _renew_subs 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae571ac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:46.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fae500b0150 con 0x7fae5015b3a0 2026-02-24T19:17:46.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.343+0000 7fae571ac640 1 librados: init done 2026-02-24T19:17:46.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.344+0000 7fae571ac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:46.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.344+0000 7fae571ac640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:46.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.344+0000 7fae571ac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:46.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:46.344+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae50137750 con 0x7fae5015b3a0 2026-02-24T19:17:47.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.138+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae38003000 con 0x7fae5015b3a0 2026-02-24T19:17:47.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.138+0000 7fae457fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:47.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.138+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fae38003c30 con 0x7fae5015b3a0 2026-02-24T19:17:47.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.138+0000 7fae457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:47.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.138+0000 7fae457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:47.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.138+0000 7fae46ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.138+0000 7fae457fa640 10 monclient: dump: 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:47.143 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:47.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.139+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fae38003e10 con 0x7fae5015b3a0 2026-02-24T19:17:47.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.139+0000 7fae54f21640 10 monclient: get_auth_request con 0x7fae20077c30 auth_method 0 2026-02-24T19:17:47.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.139+0000 7fae457fa640 10 client.4353.objecter ms_handle_connect 0x7fae20077c30 2026-02-24T19:17:47.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.143+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 7757+0+0 (unknown 3002991106 0 0) 0x7fae380933b0 con 0x7fae5015b3a0 2026-02-24T19:17:47.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.143+0000 7fae457fa640 10 client.4353.objecter ms_dispatch2 0x7fae50000b90 osd_map(25..25 src has 1..25) 2026-02-24T19:17:47.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.143+0000 7fae457fa640 3 client.4353.objecter handle_osd_map got epochs [25,25] > 0 2026-02-24T19:17:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.143+0000 7fae457fa640 3 client.4353.objecter handle_osd_map decoding full epoch 25 2026-02-24T19:17:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.143+0000 7fae457fa640 20 client.4353.objecter dump_active .. 0 homeless 2026-02-24T19:17:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.143+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fae3805dde0 con 0x7fae5015b3a0 2026-02-24T19:17:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.143+0000 7fae457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.143+0000 7fae457fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:47.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.250+0000 7fae571ac640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-24T19:17:47.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.250+0000 7fae571ac640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-24T19:17:47.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.250+0000 7fae571ac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:47.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:47.250+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fae50162020 con 0x7fae5015b3a0 2026-02-24T19:17:48.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.451+0000 7fae457fa640 1 -- 10.20.193.45:0/3940303136 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v26) ==== 109+0+0 (unknown 437888687 0 0) 0x7fae3805d6e0 con 0x7fae5015b3a0 2026-02-24T19:17:48.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.451+0000 7fae457fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-24T19:17:48.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.451+0000 7fae457fa640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-24T19:17:48.454 INFO:teuthology.orchestra.run.trial045.stderr:pool 'rbd' created 2026-02-24T19:17:48.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 10 librados: watch_flush enter 2026-02-24T19:17:48.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 10 librados: watch_flush exit 2026-02-24T19:17:48.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 20 client.4353.objecter shutdown clearing up homeless session... 2026-02-24T19:17:48.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 10 client.4353.objecter successfully canceled tick 2026-02-24T19:17:48.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 >> v1:10.20.193.45:6800/1599977652 conn(0x7fae20077c30 legacy=0x7fae200980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:48.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 10 monclient: shutdown 2026-02-24T19:17:48.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:48.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 >> v1:10.20.193.45:6789/0 conn(0x7fae5015b3a0 legacy=0x7fae50137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:48.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 shutdown_connections 2026-02-24T19:17:48.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 >> 10.20.193.45:0/3940303136 conn(0x7fae500b2f10 msgr2=0x7fae500b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:48.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 shutdown_connections 2026-02-24T19:17:48.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.453+0000 7fae571ac640 1 -- 10.20.193.45:0/3940303136 wait complete. 2026-02-24T19:17:48.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.454+0000 7fae571ac640 1 librados: shutdown 2026-02-24T19:17:48.465 DEBUG:teuthology.orchestra.run.trial045:> rbd --cluster ceph pool init rbd 2026-02-24T19:17:48.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.496+0000 7fb1e99e5300 10 monclient: get_monmap_and_config 2026-02-24T19:17:48.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.496+0000 7fb1e99e5300 10 monclient: build_initial_monmap 2026-02-24T19:17:48.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.496+0000 7fb1e99e5300 10 monclient: monmap: 2026-02-24T19:17:48.499 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:48.499 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:48.499 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:48.497182+0000 2026-02-24T19:17:48.499 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:48.497182+0000 2026-02-24T19:17:48.499 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:48.500 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:48.500 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:48.500 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:48.500 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:48.500 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:48.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.496+0000 7fb1e99e5300 1 Processor -- start 2026-02-24T19:17:48.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.496+0000 7fb1e99e5300 1 -- start start 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.496+0000 7fb1e99e5300 10 monclient: init 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 10 monclient: _reopen_session rank -1 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 10 monclient(hunting): picked mon.noname-b con 0x55828407c5d0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 10 monclient(hunting): picked mon.noname-c con 0x558284165dc0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 10 monclient(hunting): picked mon.noname-a con 0x55828407c9a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558283ed50c0 con 0x55828407c9a0 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558283ee4a80 con 0x55828407c5d0 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558284081e90 con 0x558284165dc0 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 10 monclient(hunting): _renew_subs 2026-02-24T19:17:48.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e99e5300 10 monclient(hunting): authenticate will time out at 3640.136360s 2026-02-24T19:17:48.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e37fe640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x558284165dc0 0x55828416f500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:39842/0 (socket says 10.20.193.45:39842) 2026-02-24T19:17:48.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.497+0000 7fb1e37fe640 1 -- 10.20.193.45:0/2276535368 learned_addr learned my addr 10.20.193.45:0/2276535368 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:48.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.499+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3316222673 0 0) 0x558284081e90 con 0x558284165dc0 2026-02-24T19:17:48.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.499+0000 7fb1e2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:48.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.499+0000 7fb1e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:48.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.499+0000 7fb1e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:48.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.499+0000 7fb1e2ffd640 10 monclient(hunting): my global_id is 4358 2026-02-24T19:17:48.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.499+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1cc001e10 con 0x558284165dc0 2026-02-24T19:17:48.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.500+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547248396 0 0) 0x558283ed50c0 con 0x55828407c9a0 2026-02-24T19:17:48.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.500+0000 7fb1e2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:48.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.500+0000 7fb1e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:48.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.500+0000 7fb1e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:48.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.500+0000 7fb1e2ffd640 10 monclient(hunting): my global_id is 4356 2026-02-24T19:17:48.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.500+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x558284081e90 con 0x55828407c9a0 2026-02-24T19:17:48.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3371949100 0 0) 0x558284081e90 con 0x55828407c9a0 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 >> v1:10.20.193.179:6789/0 conn(0x558284165dc0 legacy=0x55828416f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 >> v1:10.20.193.114:6789/0 conn(0x55828407c5d0 legacy=0x5582841656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558284082170 con 0x55828407c9a0 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:48.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb1dc001970 con 0x55828407c9a0 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: dump: 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:48.510 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e99e5300 5 monclient: authenticate success, global_id 4356 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e99e5300 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1dc001b80 con 0x55828407c9a0 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 1 -- 10.20.193.45:0/2276535368 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb1dc001fc0 con 0x55828407c9a0 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e2ffd640 10 monclient: dump: 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:48.511 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e99e5300 10 monclient: get_monmap_and_config success 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.502+0000 7fb1e99e5300 4 set_mon_vals no callback set 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 10 monclient: shutdown 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:48.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 1 -- 10.20.193.45:0/2276535368 >> v1:10.20.193.45:6789/0 conn(0x55828407c9a0 legacy=0x5582841d4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 1 -- 10.20.193.45:0/2276535368 shutdown_connections 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 1 -- 10.20.193.45:0/2276535368 >> 10.20.193.45:0/2276535368 conn(0x5582840c6ed0 msgr2=0x5582840c72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 1 -- 10.20.193.45:0/2276535368 shutdown_connections 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 1 -- 10.20.193.45:0/2276535368 wait complete. 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 10 monclient: build_initial_monmap 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 10 monclient: monmap: 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:48.513 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 1 librados: starting msgr at 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.503+0000 7fb1e99e5300 1 librados: starting objecter 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 1 Processor -- start 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 1 -- start start 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 1 librados: setting wanted keys 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 1 librados: calling monclient init 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 10 monclient: init 2026-02-24T19:17:48.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 10 monclient: _reopen_session rank -1 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 10 monclient(hunting): picked mon.noname-c con 0x55828407c5d0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 10 monclient(hunting): picked mon.noname-a con 0x55828407c9a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 10 monclient(hunting): picked mon.noname-b con 0x558284165dc0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5582840c0860 con 0x55828407c9a0 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5582841810c0 con 0x558284165dc0 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5582841813a0 con 0x55828407c5d0 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 10 monclient(hunting): _renew_subs 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e99e5300 10 monclient(hunting): authenticate will time out at 3640.143573s 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e3fff640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x55828407c5d0 0x5582840c0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:39852/0 (socket says 10.20.193.45:39852) 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.504+0000 7fb1e3fff640 1 -- 10.20.193.45:0/3634394039 learned_addr learned my addr 10.20.193.45:0/3634394039 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.505+0000 7fb1d3fff640 10 client.?.objecter ms_handle_connect 0x55828407c5d0 2026-02-24T19:17:48.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.505+0000 7fb1d3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:48.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.505+0000 7fb1d3fff640 10 client.?.objecter ms_handle_connect 0x558284165dc0 2026-02-24T19:17:48.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.505+0000 7fb1d3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:48.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.505+0000 7fb1d3fff640 10 client.?.objecter ms_handle_connect 0x55828407c9a0 2026-02-24T19:17:48.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.505+0000 7fb1d3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:48.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266698664 0 0) 0x5582841813a0 con 0x55828407c5d0 2026-02-24T19:17:48.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:48.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:48.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:48.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): my global_id is 4361 2026-02-24T19:17:48.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1c8001e10 con 0x55828407c5d0 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517820534 0 0) 0x5582841810c0 con 0x558284165dc0 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): my global_id is 4351 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5582841813a0 con 0x558284165dc0 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131805092 0 0) 0x5582840c0860 con 0x55828407c9a0 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 10 monclient(hunting): my global_id is 4359 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.506+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5582841810c0 con 0x55828407c9a0 2026-02-24T19:17:48.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 220341995 0 0) 0x7fb1c8001e10 con 0x55828407c5d0 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5582840c0860 con 0x55828407c5d0 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb1d40017d0 con 0x55828407c5d0 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:48.521 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1194902315 0 0) 0x5582841813a0 con 0x558284165dc0 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1c8001e10 con 0x558284165dc0 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1960359284 0 0) 0x5582841810c0 con 0x55828407c9a0 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5582841813a0 con 0x55828407c9a0 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb1d8001730 con 0x55828407c9a0 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:48.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb1dc001cf0 con 0x558284165dc0 2026-02-24T19:17:48.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.509+0000 7fb1d3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:48.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4095530581 0 0) 0x5582840c0860 con 0x55828407c5d0 2026-02-24T19:17:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 >> v1:10.20.193.114:6789/0 conn(0x558284165dc0 legacy=0x558284180270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 >> v1:10.20.193.45:6789/0 conn(0x55828407c9a0 legacy=0x55828417ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 1 monclient: found mon.c 2026-02-24T19:17:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558284181680 con 0x55828407c5d0 2026-02-24T19:17:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:48.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:48.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:48.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1e99e5300 5 monclient: authenticate success, global_id 4361 2026-02-24T19:17:48.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1e99e5300 10 monclient: _renew_subs 2026-02-24T19:17:48.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1e99e5300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:48.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.510+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x558284181960 con 0x55828407c5d0 2026-02-24T19:17:48.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.511+0000 7fb1e99e5300 10 client.4361.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.511+0000 7fb1e99e5300 10 monclient: _renew_subs 2026-02-24T19:17:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.511+0000 7fb1e99e5300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.511+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x55828417d560 con 0x55828407c5d0 2026-02-24T19:17:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.511+0000 7fb1e99e5300 1 librados: init done 2026-02-24T19:17:48.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.511+0000 7fb1e99e5300 10 librados: wait_for_osdmap waiting 2026-02-24T19:17:48.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.518+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1d4001970 con 0x55828407c5d0 2026-02-24T19:17:48.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.518+0000 7fb1d3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:48.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.518+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb1d4003390 con 0x55828407c5d0 2026-02-24T19:17:48.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.518+0000 7fb1d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.518+0000 7fb1d3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.518+0000 7fb1d3fff640 10 monclient: dump: 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:48.532 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.518+0000 7fb1e27fc640 4 set_mon_vals no callback set 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.519+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fb1d401c200 con 0x55828407c5d0 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.519+0000 7fb1e37fe640 10 monclient: get_auth_request con 0x7fb1c8076760 auth_method 0 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.519+0000 7fb1d3fff640 10 client.4361.objecter ms_handle_connect 0x7fb1c8076760 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(26..26 src has 1..26) ==== 8102+0+0 (unknown 105321360 0 0) 0x7fb1d40919d0 con 0x55828407c5d0 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1d3fff640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 osd_map(26..26 src has 1..26) 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1d3fff640 3 client.4361.objecter handle_osd_map got epochs [26,26] > 0 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1d3fff640 3 client.4361.objecter handle_osd_map decoding full epoch 26 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1d3fff640 20 client.4361.objecter dump_active .. 0 homeless 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1e99e5300 10 librados: wait_for_osdmap done waiting 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1e99e5300 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1e99e5300 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1e99e5300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:48.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:48.520+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x558284180b90 con 0x55828407c5d0 2026-02-24T19:17:49.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.525+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v27) ==== 141+0+0 (unknown 3716993650 0 0) 0x7fb1d405c400 con 0x55828407c5d0 2026-02-24T19:17:49.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.525+0000 7fb1d3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-24T19:17:49.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.525+0000 7fb1d3fff640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-24T19:17:49.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.525+0000 7fb1e99e5300 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:49.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.525+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x558283f6dfb0 con 0x55828407c5d0 2026-02-24T19:17:49.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.526+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (unknown 2135480514 0 0) 0x7fb1d405bad0 con 0x55828407c5d0 2026-02-24T19:17:49.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.526+0000 7fb1d3fff640 10 monclient: handle_get_version_reply finishing 1 version 27 2026-02-24T19:17:49.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.527+0000 7fb1e27fc640 10 client.4361.objecter _get_latest_version latest 27, waiting 2026-02-24T19:17:49.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.527+0000 7fb1e27fc640 10 client.4361.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:49.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.527+0000 7fb1e27fc640 10 monclient: _renew_subs 2026-02-24T19:17:49.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.527+0000 7fb1e27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:49.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.527+0000 7fb1e27fc640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=27}) -- 0x7fb1c0002ae0 con 0x55828407c5d0 2026-02-24T19:17:49.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 11 ==== osd_map(27..27 src has 1..27) ==== 661+0+0 (unknown 3937352280 0 0) 0x7fb1d405b5c0 con 0x55828407c5d0 2026-02-24T19:17:49.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1d3fff640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 osd_map(27..27 src has 1..27) 2026-02-24T19:17:49.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1d3fff640 3 client.4361.objecter handle_osd_map got epochs [27,27] > 26 2026-02-24T19:17:49.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1d3fff640 3 client.4361.objecter handle_osd_map decoding incremental epoch 27 2026-02-24T19:17:49.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1d3fff640 20 client.4361.objecter dump_active .. 0 homeless 2026-02-24T19:17:49.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 10 librados: create oid=rbd_trash nspace= 2026-02-24T19:17:49.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 10 client.4361.objecter _op_submit op 0x55828417f880 2026-02-24T19:17:49.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 20 client.4361.objecter _calc_target epoch 27 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:17:49.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 20 client.4361.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-24T19:17:49.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 10 client.4361.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [7,12] primary 7 2026-02-24T19:17:49.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 20 client.4361.objecter _get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:49.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 10 client.4361.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.7 2026-02-24T19:17:49.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 20 client.4361.objecter get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:49.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 15 client.4361.objecter _session_op_assign 7 1 2026-02-24T19:17:49.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 15 client.4361.objecter _send_op 1 to 2.3 on osd.7 2026-02-24T19:17:49.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5582842069a0 con 0x5582841e4ea0 2026-02-24T19:17:49.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:49.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.528+0000 7fb1e99e5300 5 client.4361.objecter 1 in flight 2026-02-24T19:17:49.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.532+0000 7fb1e9723640 10 monclient: get_auth_request con 0x5582841e4ea0 auth_method 0 2026-02-24T19:17:49.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:49.534+0000 7fb1d3fff640 10 client.4361.objecter ms_handle_connect 0x5582841e4ea0 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 1 -- 10.20.193.45:0/3634394039 <== osd.7 v1:10.20.193.194:6800/598300563 1 ==== osd_op_reply(1 rbd_trash [create] v27'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 3684242346 0 0) 0x7fb1dc0044b0 con 0x5582841e4ea0 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 osd_op_reply(1 rbd_trash [create] v27'1 uv1 ondisk = 0) 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 10 client.4361.objecter in handle_osd_op_reply 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 7 client.4361.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 10 client.4361.objecter op 0 rval 0 len 0 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 15 client.4361.objecter handle_osd_op_reply completed tid 1 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 15 client.4361.objecter _finish_op 1 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 15 client.4361.objecter _session_op_remove 7 1 2026-02-24T19:17:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e9723640 5 client.4361.objecter 0 in flight 2026-02-24T19:17:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.141+0000 7fb1e99e5300 10 librados: Objecter returned from create r=0 2026-02-24T19:17:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 10 client.4361.objecter _op_submit op 0x558284241400 2026-02-24T19:17:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 20 client.4361.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:17:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 20 client.4361.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:17:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 10 client.4361.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [7,10] primary 7 2026-02-24T19:17:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 10 client.4361.objecter chose random osd.7 of [7,10] 2026-02-24T19:17:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 20 client.4361.objecter _get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 10 client.4361.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.7 2026-02-24T19:17:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 20 client.4361.objecter get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 15 client.4361.objecter _session_op_assign 7 2 2026-02-24T19:17:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 15 client.4361.objecter _send_op 2 to 2.2 on osd.7 2026-02-24T19:17:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e27) -- 0x558284241930 con 0x5582841e4ea0 2026-02-24T19:17:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.142+0000 7fb1e99e5300 5 client.4361.objecter 1 in flight 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 1 -- 10.20.193.45:0/3634394039 <== osd.7 v1:10.20.193.194:6800/598300563 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1379133595 0 0) 0x7fb1dc0044b0 con 0x5582841e4ea0 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 10 client.4361.objecter in handle_osd_op_reply 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 7 client.4361.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 10 client.4361.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 10 client.4361.objecter op 0 rval 0 len 0 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 15 client.4361.objecter handle_osd_op_reply completed tid 2 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 15 client.4361.objecter _finish_op 2 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 15 client.4361.objecter _session_op_remove 7 2 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e9723640 5 client.4361.objecter 0 in flight 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 10 client.4361.objecter _op_submit op 0x558284240560 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 20 client.4361.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 20 client.4361.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 10 client.4361.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [7,10] primary 7 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 10 client.4361.objecter chose random osd.7 of [7,10] 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 20 client.4361.objecter _get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 10 client.4361.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.7 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 20 client.4361.objecter get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 15 client.4361.objecter _session_op_assign 7 3 2026-02-24T19:17:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 15 client.4361.objecter _send_op 3 to 2.2 on osd.7 2026-02-24T19:17:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e27) -- 0x558284240a10 con 0x5582841e4ea0 2026-02-24T19:17:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.156+0000 7fb1e99e5300 5 client.4361.objecter 1 in flight 2026-02-24T19:17:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 1 -- 10.20.193.45:0/3634394039 <== osd.7 v1:10.20.193.194:6800/598300563 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1399001751 0 0) 0x7fb1dc0044b0 con 0x5582841e4ea0 2026-02-24T19:17:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:17:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 10 client.4361.objecter in handle_osd_op_reply 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 7 client.4361.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 10 client.4361.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 10 client.4361.objecter op 0 rval 0 len 0 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 15 client.4361.objecter handle_osd_op_reply completed tid 3 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 15 client.4361.objecter _finish_op 3 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 15 client.4361.objecter _session_op_remove 7 3 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e9723640 5 client.4361.objecter 0 in flight 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e1ffb640 10 client.4361.objecter allocate_selfmanaged_snap; pool: 2 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e1ffb640 10 client.4361.objecter pool_op_submit 4 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.160+0000 7fb1e1ffb640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fb1c4003110 con 0x55828407c5d0 2026-02-24T19:17:50.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 12 ==== pool_op_reply(tid 4 (0) Success v28) ==== 55+0+0 (unknown 1799263780 0 0) 0x7fb1d405bd00 con 0x55828407c5d0 2026-02-24T19:17:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 pool_op_reply(tid 4 (0) Success v28) 2026-02-24T19:17:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 10 client.4361.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v28) 2026-02-24T19:17:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 10 client.4361.objecter have request 4 at 0x7fb1c40030a0 Op: create unmanaged snap 2026-02-24T19:17:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 20 client.4361.objecter waiting for client to reach epoch 28 before calling back 2026-02-24T19:17:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 10 client.4361.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 10 monclient: _renew_subs 2026-02-24T19:17:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=28}) -- 0x5582840c0860 con 0x55828407c5d0 2026-02-24T19:17:50.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.596+0000 7fb1d3fff640 10 client.4361.objecter done 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.597+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 13 ==== osd_map(28..28 src has 1..28) ==== 637+0+0 (unknown 1435835676 0 0) 0x7fb1d405b7c0 con 0x55828407c5d0 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.597+0000 7fb1d3fff640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 osd_map(28..28 src has 1..28) 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.597+0000 7fb1d3fff640 3 client.4361.objecter handle_osd_map got epochs [28,28] > 27 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.597+0000 7fb1d3fff640 3 client.4361.objecter handle_osd_map decoding incremental epoch 28 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.597+0000 7fb1d3fff640 20 client.4361.objecter dump_active .. 0 homeless 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 20 librados: queue_aio_write 0x55828423c990 completion 0x5582841701f0 write_seq 1 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 10 client.4361.objecter _op_submit op 0x7fb1c0006400 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 20 client.4361.objecter _calc_target epoch 28 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 20 client.4361.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 10 client.4361.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [7,10] primary 7 2026-02-24T19:17:50.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 20 client.4361.objecter _get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:50.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 10 client.4361.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.7 2026-02-24T19:17:50.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 20 client.4361.objecter get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:50.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 15 client.4361.objecter _session_op_assign 7 5 2026-02-24T19:17:50.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 15 client.4361.objecter _send_op 5 to 2.2 on osd.7 2026-02-24T19:17:50.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) -- 0x7fb1c0006910 con 0x5582841e4ea0 2026-02-24T19:17:50.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:50.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.598+0000 7fb1e27fc640 5 client.4361.objecter 1 in flight 2026-02-24T19:17:50.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 1 -- 10.20.193.45:0/3634394039 <== osd.7 v1:10.20.193.194:6800/598300563 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v28'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 444517681 0 0) 0x7fb1dc0044b0 con 0x5582841e4ea0 2026-02-24T19:17:50.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 osd_op_reply(5 rbd_info [create,write 0~8] v28'1 uv1 ondisk = 0) 2026-02-24T19:17:50.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 10 client.4361.objecter in handle_osd_op_reply 2026-02-24T19:17:50.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 7 client.4361.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-24T19:17:50.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 10 client.4361.objecter op 0 rval 0 len 0 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 10 client.4361.objecter op 1 rval 0 len 0 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 15 client.4361.objecter handle_osd_op_reply completed tid 5 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 15 client.4361.objecter _finish_op 5 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 15 client.4361.objecter _session_op_remove 7 5 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 5 client.4361.objecter 0 in flight 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e9723640 20 librados: complete_aio_write 0x5582841701f0 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e1ffb640 10 client.4361.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e1ffb640 10 client.4361.objecter pool_op_submit 6 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:50.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:50.730+0000 7fb1e1ffb640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v28) -- 0x7fb1c40033b0 con 0x55828407c5d0 2026-02-24T19:17:51.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.504+0000 7fb1d2ffd640 10 monclient: tick 2026-02-24T19:17:51.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.504+0000 7fb1d2ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:51.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.504+0000 7fb1d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:51.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.504+0000 7fb1d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:51.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 14 ==== pool_op_reply(tid 6 (0) Success v29) ==== 43+0+0 (unknown 1989426854 0 0) 0x7fb1d40613e0 con 0x55828407c5d0 2026-02-24T19:17:51.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 pool_op_reply(tid 6 (0) Success v29) 2026-02-24T19:17:51.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 10 client.4361.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v29) 2026-02-24T19:17:51.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 10 client.4361.objecter have request 6 at 0x7fb1c40030a0 Op: delete unmanaged snap 2026-02-24T19:17:51.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 20 client.4361.objecter waiting for client to reach epoch 29 before calling back 2026-02-24T19:17:51.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 10 client.4361.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:51.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 10 monclient: _renew_subs 2026-02-24T19:17:51.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:51.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=29}) -- 0x5582841810c0 con 0x55828407c5d0 2026-02-24T19:17:51.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.643+0000 7fb1d3fff640 10 client.4361.objecter done 2026-02-24T19:17:51.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1d3fff640 1 -- 10.20.193.45:0/3634394039 <== mon.2 v1:10.20.193.179:6789/0 15 ==== osd_map(29..29 src has 1..29) ==== 657+0+0 (unknown 995704295 0 0) 0x7fb1d4059a00 con 0x55828407c5d0 2026-02-24T19:17:51.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1d3fff640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 osd_map(29..29 src has 1..29) 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1d3fff640 3 client.4361.objecter handle_osd_map got epochs [29,29] > 28 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1d3fff640 3 client.4361.objecter handle_osd_map decoding incremental epoch 29 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1d3fff640 20 client.4361.objecter dump_active .. 0 homeless 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 20 librados: queue_aio_write 0x55828423c990 completion 0x7fb1c4001da0 write_seq 2 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 10 client.4361.objecter _op_submit op 0x7fb1c0006400 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 20 client.4361.objecter _calc_target epoch 29 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 20 client.4361.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 10 client.4361.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [7,10] primary 7 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 20 client.4361.objecter _get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:51.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 10 client.4361.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.7 2026-02-24T19:17:51.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 20 client.4361.objecter get_session s=0x558283eee280 osd=7 3 2026-02-24T19:17:51.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 15 client.4361.objecter _session_op_assign 7 7 2026-02-24T19:17:51.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 15 client.4361.objecter _send_op 7 to 2.2 on osd.7 2026-02-24T19:17:51.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 1 -- 10.20.193.45:0/3634394039 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x7fb1c0006e40 con 0x5582841e4ea0 2026-02-24T19:17:51.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:51.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.644+0000 7fb1e27fc640 5 client.4361.objecter 1 in flight 2026-02-24T19:17:51.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 1 -- 10.20.193.45:0/3634394039 <== osd.7 v1:10.20.193.194:6800/598300563 5 ==== osd_op_reply(7 rbd_info [write 0~19] v29'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 2480773985 0 0) 0x7fb1dc0044b0 con 0x5582841e4ea0 2026-02-24T19:17:51.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 10 client.4361.objecter ms_dispatch2 0x558283f91d50 osd_op_reply(7 rbd_info [write 0~19] v29'2 uv2 ondisk = 0) 2026-02-24T19:17:51.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 10 client.4361.objecter in handle_osd_op_reply 2026-02-24T19:17:51.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 7 client.4361.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 10 client.4361.objecter op 0 rval 0 len 0 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 15 client.4361.objecter handle_osd_op_reply completed tid 7 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 15 client.4361.objecter _finish_op 7 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 20 client.4361.objecter put_session s=0x558283eee280 osd=7 4 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 15 client.4361.objecter _session_op_remove 7 7 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 5 client.4361.objecter 0 in flight 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 20 librados: complete_aio_write 0x7fb1c4001da0 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 10 librados: watch_flush enter 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 10 librados: watch_flush exit 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 10 client.4361.objecter close_session for osd.7 2026-02-24T19:17:51.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 >> v1:10.20.193.194:6800/598300563 conn(0x5582841e4ea0 legacy=0x558284205280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 20 client.4361.objecter put_session s=0x558283eee280 osd=7 1 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 20 client.4361.objecter shutdown clearing up homeless session... 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 10 client.4361.objecter successfully canceled tick 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 >> v1:10.20.193.45:6800/1599977652 conn(0x7fb1c8076760 legacy=0x7fb1c8096c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 10 monclient: shutdown 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 >> v1:10.20.193.179:6789/0 conn(0x55828407c5d0 legacy=0x5582840c0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e9723640 1 -- 10.20.193.45:0/3634394039 reap_dead start 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 shutdown_connections 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 >> 10.20.193.45:0/3634394039 conn(0x5582840c6ed0 msgr2=0x558284161810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 shutdown_connections 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 1 -- 10.20.193.45:0/3634394039 wait complete. 2026-02-24T19:17:51.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.740+0000 7fb1e99e5300 1 librados: shutdown 2026-02-24T19:17:51.748 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-24T19:17:51.749 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-24T19:17:51.749 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-24T19:17:51.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.860+0000 7fbb21a8a640 10 monclient: get_monmap_and_config 2026-02-24T19:17:51.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.860+0000 7fbb21a8a640 10 monclient: build_initial_monmap 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.860+0000 7fbb21a8a640 10 monclient: monmap: 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:51.861633+0000 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:51.861633+0000 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:51.864 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:51.865 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:51.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 1 Processor -- start 2026-02-24T19:17:51.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 1 -- start start 2026-02-24T19:17:51.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 10 monclient: init 2026-02-24T19:17:51.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:51.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:51.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 10 monclient(hunting): picked mon.noname-b con 0x7fbb1c0b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 10 monclient(hunting): picked mon.noname-a con 0x7fbb1c0ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 10 monclient(hunting): picked mon.noname-c con 0x7fbb1c0585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c163930 con 0x7fbb1c0ba350 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c163bb0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c163e90 con 0x7fbb1c0585e0 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.861+0000 7fbb21a8a640 10 monclient(hunting): authenticate will time out at 3643.500845s 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.862+0000 7fbb1affd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fbb1c0ba350 0x7fbb1c057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43732/0 (socket says 10.20.193.45:43732) 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.862+0000 7fbb1affd640 1 -- 10.20.193.45:0/2384064651 learned_addr learned my addr 10.20.193.45:0/2384064651 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675061069 0 0) 0x7fbb1c163e90 con 0x7fbb1c0585e0 2026-02-24T19:17:51.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): my global_id is 4364 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb00003610 con 0x7fbb1c0585e0 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128544024 0 0) 0x7fbb1c163bb0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): my global_id is 4354 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb1c163e90 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961785903 0 0) 0x7fbb0c002910 con 0x7fbb1c0ba350 2026-02-24T19:17:51.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:51.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:51.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:51.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 10 monclient(hunting): my global_id is 4362 2026-02-24T19:17:51.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.863+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb1c163bb0 con 0x7fbb1c0ba350 2026-02-24T19:17:51.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3894540643 0 0) 0x7fbb1c163e90 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 >> v1:10.20.193.179:6789/0 conn(0x7fbb1c0585e0 legacy=0x7fbb1c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:51.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 >> v1:10.20.193.45:6789/0 conn(0x7fbb1c0ba350 legacy=0x7fbb1c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:51.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:51.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 1 monclient: found mon.noname-b 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c0573f0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbb08002df0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb1a7fc640 10 monclient: dump: 2026-02-24T19:17:51.875 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb21a8a640 5 monclient: authenticate success, global_id 4354 2026-02-24T19:17:51.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.865+0000 7fbb21a8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb08002fc0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb1a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb1a7fc640 1 -- 10.20.193.45:0/2384064651 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbb08003400 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb1a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb1a7fc640 10 monclient: dump: 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:51.877 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb21a8a640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb21a8a640 4 set_mon_vals no callback set 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb21a8a640 10 monclient: shutdown 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb21a8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb21a8a640 1 -- 10.20.193.45:0/2384064651 >> v1:10.20.193.114:6789/0 conn(0x7fbb1c0b9f80 legacy=0x7fbb1c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb21a8a640 1 -- 10.20.193.45:0/2384064651 shutdown_connections 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb21a8a640 1 -- 10.20.193.45:0/2384064651 >> 10.20.193.45:0/2384064651 conn(0x7fbb1c0b7990 msgr2=0x7fbb1c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:51.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb21a8a640 1 -- 10.20.193.45:0/2384064651 shutdown_connections 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.866+0000 7fbb21a8a640 1 -- 10.20.193.45:0/2384064651 wait complete. 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient: build_initial_monmap 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient: monmap: 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:51.879 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 1 librados: starting msgr at 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 1 librados: starting objecter 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 1 Processor -- start 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 1 -- start start 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 1 librados: setting wanted keys 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 1 librados: calling monclient init 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient: init 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:51.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient(hunting): picked mon.noname-b con 0x7fbb1c0585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient(hunting): picked mon.noname-c con 0x7fbb1c0b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient(hunting): picked mon.noname-a con 0x7fbb1c0ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c0b2bf0 con 0x7fbb1c0ba350 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c0b3b00 con 0x7fbb1c0585e0 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c0b3de0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.867+0000 7fbb21a8a640 10 monclient(hunting): authenticate will time out at 3643.506982s 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.868+0000 7fbb1bfff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fbb1c0ba350 0x7fbb1c0b1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43734/0 (socket says 10.20.193.45:43734) 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.868+0000 7fbb1bfff640 1 -- 10.20.193.45:0/3094493663 learned_addr learned my addr 10.20.193.45:0/3094493663 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.868+0000 7fbaf7fff640 10 client.?.objecter ms_handle_connect 0x7fbb1c0ba350 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.868+0000 7fbaf7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.868+0000 7fbaf7fff640 10 client.?.objecter ms_handle_connect 0x7fbb1c0b9f80 2026-02-24T19:17:51.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.868+0000 7fbaf7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.868+0000 7fbaf7fff640 10 client.?.objecter ms_handle_connect 0x7fbb1c0585e0 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.868+0000 7fbaf7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036441033 0 0) 0x7fbb1c0b3b00 con 0x7fbb1c0585e0 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): my global_id is 4357 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaec003610 con 0x7fbb1c0585e0 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010110136 0 0) 0x7fbb1c0b2bf0 con 0x7fbb1c0ba350 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:51.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:51.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:51.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): my global_id is 4365 2026-02-24T19:17:51.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb1c0b3b00 con 0x7fbb1c0ba350 2026-02-24T19:17:51.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272607703 0 0) 0x7fbb1c0b3de0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:51.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:51.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:51.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 10 monclient(hunting): my global_id is 4367 2026-02-24T19:17:51.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.869+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb1c0b2bf0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 178128469 0 0) 0x7fbb1c0b3b00 con 0x7fbb1c0ba350 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb1c0b3de0 con 0x7fbb1c0ba350 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbb100033b0 con 0x7fbb1c0ba350 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 10 monclient(hunting): dump: 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.886 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4218012291 0 0) 0x7fbb1c0b2bf0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb1c0b3b00 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbb0c003180 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.872+0000 7fbaf7fff640 10 monclient(hunting): dump: 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:51.888 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3373877479 0 0) 0x7fbaec003610 con 0x7fbb1c0585e0 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb1c0b2bf0 con 0x7fbb1c0585e0 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbb08003310 con 0x7fbb1c0585e0 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 10 monclient(hunting): dump: 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.889 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1343325361 0 0) 0x7fbb1c0b3b00 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 >> v1:10.20.193.114:6789/0 conn(0x7fbb1c0585e0 legacy=0x7fbb1c1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 >> v1:10.20.193.45:6789/0 conn(0x7fbb1c0ba350 legacy=0x7fbb1c0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 1 monclient: found mon.c 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:51.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c0b40c0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbaf7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbb21a8a640 5 monclient: authenticate success, global_id 4367 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbb21a8a640 10 monclient: _renew_subs 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbb21a8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c0b43a0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbb21a8a640 10 client.4367.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbb21a8a640 10 monclient: _renew_subs 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbb21a8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb1c1630e0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.874+0000 7fbb21a8a640 1 librados: init done 2026-02-24T19:17:51.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.875+0000 7fbb21a8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:51.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.875+0000 7fbb21a8a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:51.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.875+0000 7fbb21a8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:51.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.875+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c0b64c0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb0c0048d0 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbaf7fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:51.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbb0c004c20 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbaf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:51.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbaf7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbaf7fff640 10 monclient: dump: 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:51.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbb19ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:51.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fbb0c01da90 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbb1b7fe640 10 monclient: get_auth_request con 0x7fbaec077ef0 auth_method 0 2026-02-24T19:17:51.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.967+0000 7fbaf7fff640 10 client.4367.objecter ms_handle_connect 0x7fbaec077ef0 2026-02-24T19:17:51.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.968+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fbb0c093080 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.968+0000 7fbaf7fff640 10 client.4367.objecter ms_dispatch2 0x7fbb1c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:51.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.968+0000 7fbaf7fff640 3 client.4367.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:51.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.968+0000 7fbaf7fff640 3 client.4367.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:51.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.968+0000 7fbaf7fff640 20 client.4367.objecter dump_active .. 0 homeless 2026-02-24T19:17:51.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.969+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fbb1c163930 con 0x7fbb1c0b9f80 2026-02-24T19:17:51.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.969+0000 7fbaf7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:51.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:51.969+0000 7fbaf7fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:52.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.074+0000 7fbb21a8a640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-24T19:17:52.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.074+0000 7fbb21a8a640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-24T19:17:52.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.074+0000 7fbb21a8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:52.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.074+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fbb1c0b94f0 con 0x7fbb1c0b9f80 2026-02-24T19:17:52.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.082+0000 7fbaf7fff640 1 -- 10.20.193.45:0/3094493663 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7fbb0c05dab0 con 0x7fbb1c0b9f80 2026-02-24T19:17:52.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.082+0000 7fbaf7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-24T19:17:52.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.082+0000 7fbaf7fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:52.085 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:17:52.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 10 librados: watch_flush enter 2026-02-24T19:17:52.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 10 librados: watch_flush exit 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 20 client.4367.objecter shutdown clearing up homeless session... 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 10 client.4367.objecter successfully canceled tick 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 >> v1:10.20.193.45:6800/1599977652 conn(0x7fbaec077ef0 legacy=0x7fbaec0983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 10 monclient: shutdown 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 >> v1:10.20.193.179:6789/0 conn(0x7fbb1c0b9f80 legacy=0x7fbb1c165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 shutdown_connections 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 >> 10.20.193.45:0/3094493663 conn(0x7fbb1c0b7990 msgr2=0x7fbb1c15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 shutdown_connections 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 1 -- 10.20.193.45:0/3094493663 wait complete. 2026-02-24T19:17:52.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.083+0000 7fbb21a8a640 1 librados: shutdown 2026-02-24T19:17:52.094 INFO:teuthology.orchestra.run.trial045.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-24T19:17:52.094 INFO:tasks.ceph_manager:config epoch is 1 2026-02-24T19:17:52.094 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T19:17:52.094 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-24T19:17:52.095 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-24T19:17:52.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.161+0000 7fc3c48fe640 10 monclient: get_monmap_and_config 2026-02-24T19:17:52.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.161+0000 7fc3c48fe640 10 monclient: build_initial_monmap 2026-02-24T19:17:52.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.161+0000 7fc3c48fe640 10 monclient: monmap: 2026-02-24T19:17:52.164 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:52.164 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.164 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:52.162314+0000 2026-02-24T19:17:52.164 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:52.162314+0000 2026-02-24T19:17:52.165 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:52.165 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.165 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:52.165 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:52.165 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:52.165 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.161+0000 7fc3c48fe640 1 Processor -- start 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.161+0000 7fc3c48fe640 1 -- start start 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.161+0000 7fc3c48fe640 10 monclient: init 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 10 monclient(hunting): picked mon.noname-a con 0x7fc3bc058da0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 10 monclient(hunting): picked mon.noname-c con 0x7fc3bc059170 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 10 monclient(hunting): picked mon.noname-b con 0x7fc3bc159ee0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc05d6e0 con 0x7fc3bc058da0 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc164100 con 0x7fc3bc159ee0 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc0a8ff0 con 0x7fc3bc059170 2026-02-24T19:17:52.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c48fe640 10 monclient(hunting): authenticate will time out at 3643.801332s 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c2e74640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fc3bc159ee0 0x7fc3bc163340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48636/0 (socket says 10.20.193.45:48636) 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.162+0000 7fc3c2e74640 1 -- 10.20.193.45:0/2308835994 learned_addr learned my addr 10.20.193.45:0/2308835994 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297253178 0 0) 0x7fc3bc164100 con 0x7fc3bc159ee0 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): my global_id is 4360 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ac003610 con 0x7fc3bc159ee0 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847083310 0 0) 0x7fc3bc05d6e0 con 0x7fc3bc058da0 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): my global_id is 4368 2026-02-24T19:17:52.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3bc164100 con 0x7fc3bc058da0 2026-02-24T19:17:52.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870852 0 0) 0x7fc3bc0a8ff0 con 0x7fc3bc059170 2026-02-24T19:17:52.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 10 monclient(hunting): my global_id is 4370 2026-02-24T19:17:52.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.164+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3bc05d6e0 con 0x7fc3bc059170 2026-02-24T19:17:52.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 325483650 0 0) 0x7fc3ac003610 con 0x7fc3bc159ee0 2026-02-24T19:17:52.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 >> v1:10.20.193.179:6789/0 conn(0x7fc3bc059170 legacy=0x7fc3bc1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 >> v1:10.20.193.45:6789/0 conn(0x7fc3bc058da0 legacy=0x7fc3bc05cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 10 monclient: _finish_hunting 0 2026-02-24T19:17:52.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 1 monclient: found mon.noname-b 2026-02-24T19:17:52.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc0a92d0 con 0x7fc3bc159ee0 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 10 monclient: _finish_auth 0 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 10 monclient: _check_auth_tickets 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3b0003170 con 0x7fc3bc159ee0 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c48fe640 5 monclient: authenticate success, global_id 4360 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c48fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c1671640 10 monclient: dump: 2026-02-24T19:17:52.176 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.165+0000 7fc3c48fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:52.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.166+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3b0003340 con 0x7fc3bc159ee0 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.166+0000 7fc3c1671640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.166+0000 7fc3c1671640 1 -- 10.20.193.45:0/2308835994 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3b0003780 con 0x7fc3bc159ee0 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.166+0000 7fc3c1671640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.166+0000 7fc3c1671640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.166+0000 7fc3c1671640 10 monclient: dump: 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.178 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.166+0000 7fc3c48fe640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.166+0000 7fc3c48fe640 4 set_mon_vals no callback set 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 10 monclient: shutdown 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 -- 10.20.193.45:0/2308835994 >> v1:10.20.193.114:6789/0 conn(0x7fc3bc159ee0 legacy=0x7fc3bc163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 -- 10.20.193.45:0/2308835994 shutdown_connections 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 -- 10.20.193.45:0/2308835994 >> 10.20.193.45:0/2308835994 conn(0x7fc3bc0b65f0 msgr2=0x7fc3bc0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 -- 10.20.193.45:0/2308835994 shutdown_connections 2026-02-24T19:17:52.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 -- 10.20.193.45:0/2308835994 wait complete. 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 10 monclient: build_initial_monmap 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 10 monclient: monmap: 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:52.180 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 librados: starting msgr at 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 librados: starting objecter 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 Processor -- start 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 -- start start 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 librados: setting wanted keys 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 1 librados: calling monclient init 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.167+0000 7fc3c48fe640 10 monclient: init 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 10 monclient(hunting): picked mon.noname-b con 0x7fc3bc058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 10 monclient(hunting): picked mon.noname-a con 0x7fc3bc059170 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:52.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 10 monclient(hunting): picked mon.noname-c con 0x7fc3bc159ee0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc136ed0 con 0x7fc3bc059170 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc1371b0 con 0x7fc3bc058da0 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3bc137490 con 0x7fc3bc159ee0 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c48fe640 10 monclient(hunting): authenticate will time out at 3643.807320s 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c1e72640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc3bc059170 0x7fc3bc056eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43752/0 (socket says 10.20.193.45:43752) 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3c1e72640 1 -- 10.20.193.45:0/1782843637 learned_addr learned my addr 10.20.193.45:0/1782843637 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3a6ffd640 10 client.?.objecter ms_handle_connect 0x7fc3bc059170 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3a6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3a6ffd640 10 client.?.objecter ms_handle_connect 0x7fc3bc058da0 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.168+0000 7fc3a6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 client.?.objecter ms_handle_connect 0x7fc3bc159ee0 2026-02-24T19:17:52.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273854880 0 0) 0x7fc3bc136ed0 con 0x7fc3bc059170 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 monclient(hunting): my global_id is 4371 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc38c003610 con 0x7fc3bc059170 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145498109 0 0) 0x7fc3bc1371b0 con 0x7fc3bc058da0 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 10 monclient(hunting): my global_id is 4363 2026-02-24T19:17:52.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.169+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3bc136ed0 con 0x7fc3bc058da0 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.170+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611582079 0 0) 0x7fc3bc137490 con 0x7fc3bc159ee0 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.170+0000 7fc3a6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.170+0000 7fc3a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.170+0000 7fc3a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.170+0000 7fc3a6ffd640 10 monclient(hunting): my global_id is 4373 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.170+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3bc1371b0 con 0x7fc3bc159ee0 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3262234278 0 0) 0x7fc38c003610 con 0x7fc3bc059170 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3bc137490 con 0x7fc3bc059170 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3a8003170 con 0x7fc3bc059170 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:52.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2200967269 0 0) 0x7fc3bc136ed0 con 0x7fc3bc058da0 2026-02-24T19:17:52.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc38c003610 con 0x7fc3bc058da0 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3b40030b0 con 0x7fc3bc058da0 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.172+0000 7fc3a6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.186 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.187 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3118347529 0 0) 0x7fc3bc1371b0 con 0x7fc3bc159ee0 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3bc136ed0 con 0x7fc3bc159ee0 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3b00034f0 con 0x7fc3bc159ee0 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.189 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3842883283 0 0) 0x7fc3bc137490 con 0x7fc3bc059170 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 >> v1:10.20.193.179:6789/0 conn(0x7fc3bc159ee0 legacy=0x7fc3bc161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 >> v1:10.20.193.114:6789/0 conn(0x7fc3bc058da0 legacy=0x7fc3bc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 1 monclient: found mon.a 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc137770 con 0x7fc3bc059170 2026-02-24T19:17:52.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3c48fe640 5 monclient: authenticate success, global_id 4371 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3c48fe640 10 monclient: _renew_subs 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3c48fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc137a50 con 0x7fc3bc059170 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3c48fe640 10 client.4371.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3c48fe640 10 monclient: _renew_subs 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3c48fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3bc0575c0 con 0x7fc3bc059170 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.173+0000 7fc3c48fe640 1 librados: init done 2026-02-24T19:17:52.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.174+0000 7fc3c48fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:52.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.174+0000 7fc3c48fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:52.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.174+0000 7fc3c48fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.174+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3bc157f40 con 0x7fc3bc059170 2026-02-24T19:17:52.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.307+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3a8003310 con 0x7fc3bc059170 2026-02-24T19:17:52.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.307+0000 7fc3a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:52.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.307+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3a8003b50 con 0x7fc3bc059170 2026-02-24T19:17:52.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.307+0000 7fc3a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:52.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.307+0000 7fc3a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.307+0000 7fc3a6ffd640 10 monclient: dump: 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.307+0000 7fc3c0e70640 4 set_mon_vals no callback set 2026-02-24T19:17:52.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.307+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fc3a8003d30 con 0x7fc3bc059170 2026-02-24T19:17:52.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.308+0000 7fc3c2673640 10 monclient: get_auth_request con 0x7fc38c077e70 auth_method 0 2026-02-24T19:17:52.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.308+0000 7fc3a6ffd640 10 client.4371.objecter ms_handle_connect 0x7fc38c077e70 2026-02-24T19:17:52.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.310+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fc3a80933a0 con 0x7fc3bc059170 2026-02-24T19:17:52.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.310+0000 7fc3a6ffd640 10 client.4371.objecter ms_dispatch2 0x7fc3bc000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:52.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.310+0000 7fc3a6ffd640 3 client.4371.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:52.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.310+0000 7fc3a6ffd640 3 client.4371.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:52.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.310+0000 7fc3a6ffd640 20 client.4371.objecter dump_active .. 0 homeless 2026-02-24T19:17:52.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.310+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc3a805ddd0 con 0x7fc3bc059170 2026-02-24T19:17:52.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.310+0000 7fc3a6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:52.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.310+0000 7fc3a6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:52.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.445+0000 7fc3c48fe640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-24T19:17:52.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.445+0000 7fc3c48fe640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-24T19:17:52.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.445+0000 7fc3c48fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.445+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc3bc157c60 con 0x7fc3bc059170 2026-02-24T19:17:52.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.488+0000 7fc3a6ffd640 1 -- 10.20.193.45:0/1782843637 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193211 (unknown 481731318 0 1055384829) 0x7fc3a805d6d0 con 0x7fc3bc059170 2026-02-24T19:17:52.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.488+0000 7fc3a6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-24T19:17:52.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.488+0000 7fc3a6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:52.494 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:17:52.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 10 librados: watch_flush enter 2026-02-24T19:17:52.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 10 librados: watch_flush exit 2026-02-24T19:17:52.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 20 client.4371.objecter shutdown clearing up homeless session... 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 10 client.4371.objecter successfully canceled tick 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 >> v1:10.20.193.45:6800/1599977652 conn(0x7fc38c077e70 legacy=0x7fc38c098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 10 monclient: shutdown 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 >> v1:10.20.193.45:6789/0 conn(0x7fc3bc059170 legacy=0x7fc3bc056eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 shutdown_connections 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 >> 10.20.193.45:0/1782843637 conn(0x7fc3bc0b65f0 msgr2=0x7fc3bc153f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 shutdown_connections 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 1 -- 10.20.193.45:0/1782843637 wait complete. 2026-02-24T19:17:52.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.491+0000 7fc3c48fe640 1 librados: shutdown 2026-02-24T19:17:52.502 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6800","nonce":1599977652}]},"active_addr":"10.20.193.45:6800/1599977652","active_change":"2026-02-24T19:17:07.557003+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":4115,"name":"x","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.45:0","nonce":176280475}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.45:0","nonce":361144349}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.45:0","nonce":3937186252}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.45:0","nonce":2230907200}]}]} 2026-02-24T19:17:52.511 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-24T19:17:52.512 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-24T19:17:52.512 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:52.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.611+0000 7f8a9c44d640 10 monclient: get_monmap_and_config 2026-02-24T19:17:52.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.611+0000 7f8a9c44d640 10 monclient: build_initial_monmap 2026-02-24T19:17:52.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.611+0000 7f8a9c44d640 10 monclient: monmap: 2026-02-24T19:17:52.613 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:52.613 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.613 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:52.611303+0000 2026-02-24T19:17:52.613 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:52.611303+0000 2026-02-24T19:17:52.614 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:52.614 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.614 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:52.614 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:52.614 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:52.614 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.611+0000 7f8a9c44d640 1 Processor -- start 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.611+0000 7f8a9c44d640 1 -- start start 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.611+0000 7f8a9c44d640 10 monclient: init 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 10 monclient(hunting): picked mon.noname-b con 0x7f8a9415d1f0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 10 monclient(hunting): picked mon.noname-a con 0x7f8a9415d5c0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 10 monclient(hunting): picked mon.noname-c con 0x7f8a940b5cf0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a940b84c0 con 0x7f8a9415d5c0 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a940b1060 con 0x7f8a9415d1f0 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a940b2770 con 0x7f8a940b5cf0 2026-02-24T19:17:52.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:52.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9c44d640 10 monclient(hunting): authenticate will time out at 3644.250600s 2026-02-24T19:17:52.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9a1c2640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f8a9415d1f0 0x7f8a940b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48658/0 (socket says 10.20.193.45:48658) 2026-02-24T19:17:52.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.612+0000 7f8a9a1c2640 1 -- 10.20.193.45:0/378202766 learned_addr learned my addr 10.20.193.45:0/378202766 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:52.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.641+0000 7f8a991c0640 1 -- 10.20.193.45:0/378202766 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2962247532 0 0) 0x7f8a88002910 con 0x7f8a9415d5c0 2026-02-24T19:17:52.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.641+0000 7f8a991c0640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.641+0000 7f8a991c0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.641+0000 7f8a991c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.641+0000 7f8a991c0640 10 monclient(hunting): my global_id is 4374 2026-02-24T19:17:52.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.641+0000 7f8a991c0640 1 -- 10.20.193.45:0/378202766 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a7c003610 con 0x7f8a9415d5c0 2026-02-24T19:17:52.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 1 -- 10.20.193.45:0/378202766 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3144964666 0 0) 0x7f8a7c003610 con 0x7f8a9415d5c0 2026-02-24T19:17:52.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 1 -- 10.20.193.45:0/378202766 >> v1:10.20.193.179:6789/0 conn(0x7f8a940b5cf0 legacy=0x7f8a940b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 1 -- 10.20.193.45:0/378202766 >> v1:10.20.193.114:6789/0 conn(0x7f8a9415d1f0 legacy=0x7f8a940b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 10 monclient: _finish_hunting 0 2026-02-24T19:17:52.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 1 monclient: found mon.noname-a 2026-02-24T19:17:52.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:52.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 1 -- 10.20.193.45:0/378202766 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a940b2a50 con 0x7f8a9415d5c0 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 10 monclient: _finish_auth 0 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 10 monclient: _check_auth_tickets 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 1 -- 10.20.193.45:0/378202766 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8a88002fc0 con 0x7f8a9415d5c0 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a991c0640 10 monclient: dump: 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.646 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.647 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.647 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.647 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.647 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.647 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.647 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.647 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a9c44d640 5 monclient: authenticate success, global_id 4374 2026-02-24T19:17:52.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.643+0000 7f8a9c44d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:52.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a991c0640 1 -- 10.20.193.45:0/378202766 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a880031d0 con 0x7f8a9415d5c0 2026-02-24T19:17:52.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a991c0640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:52.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a991c0640 1 -- 10.20.193.45:0/378202766 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8a88003700 con 0x7f8a9415d5c0 2026-02-24T19:17:52.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a9c44d640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a9c44d640 4 set_mon_vals no callback set 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a991c0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a991c0640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a991c0640 10 monclient: dump: 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.651 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a9c44d640 10 monclient: shutdown 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a9c44d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.644+0000 7f8a9c44d640 1 -- 10.20.193.45:0/378202766 >> v1:10.20.193.45:6789/0 conn(0x7f8a9415d5c0 legacy=0x7f8a940b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 1 -- 10.20.193.45:0/378202766 shutdown_connections 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 1 -- 10.20.193.45:0/378202766 >> 10.20.193.45:0/378202766 conn(0x7f8a940b5210 msgr2=0x7f8a940b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 1 -- 10.20.193.45:0/378202766 shutdown_connections 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 1 -- 10.20.193.45:0/378202766 wait complete. 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 10 monclient: build_initial_monmap 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 10 monclient: monmap: 2026-02-24T19:17:52.652 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 1 librados: starting msgr at 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 1 librados: starting objecter 2026-02-24T19:17:52.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.645+0000 7f8a9c44d640 1 Processor -- start 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 1 -- start start 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 1 librados: setting wanted keys 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 1 librados: calling monclient init 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 10 monclient: init 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 10 monclient(hunting): picked mon.noname-a con 0x7f8a940b5cf0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 10 monclient(hunting): picked mon.noname-c con 0x7f8a9415d1f0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 10 monclient(hunting): picked mon.noname-b con 0x7f8a9415d5c0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a941fba60 con 0x7f8a940b5cf0 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a941fbd40 con 0x7f8a9415d5c0 2026-02-24T19:17:52.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a941fc020 con 0x7f8a9415d1f0 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9c44d640 10 monclient(hunting): authenticate will time out at 3644.284573s 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9a1c2640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f8a940b5cf0 0x7f8a94141bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43760/0 (socket says 10.20.193.45:43760) 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.646+0000 7f8a9a1c2640 1 -- 10.20.193.45:0/2490275505 learned_addr learned my addr 10.20.193.45:0/2490275505 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.647+0000 7f8a7affd640 10 client.?.objecter ms_handle_connect 0x7f8a940b5cf0 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.647+0000 7f8a7affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.648+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859848721 0 0) 0x7f8a941fba60 con 0x7f8a940b5cf0 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.648+0000 7f8a7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.648+0000 7f8a7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.648+0000 7f8a7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.648+0000 7f8a7affd640 10 monclient(hunting): my global_id is 4377 2026-02-24T19:17:52.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.648+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a64003610 con 0x7f8a940b5cf0 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.650+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1374244372 0 0) 0x7f8a64003610 con 0x7f8a940b5cf0 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.650+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a941fba60 con 0x7f8a940b5cf0 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.650+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8a84003010 con 0x7f8a940b5cf0 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.650+0000 7f8a7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.650+0000 7f8a7affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.650+0000 7f8a7affd640 10 monclient(hunting): dump: 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.658 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.650+0000 7f8a7affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1443605982 0 0) 0x7f8a941fba60 con 0x7f8a940b5cf0 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 >> v1:10.20.193.179:6789/0 conn(0x7f8a9415d1f0 legacy=0x7f8a941ff280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 >> v1:10.20.193.114:6789/0 conn(0x7f8a9415d5c0 legacy=0x7f8a9413cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 1 monclient: found mon.a 2026-02-24T19:17:52.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a941fc300 con 0x7f8a940b5cf0 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 10 monclient: _finish_auth 0 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a9c44d640 5 monclient: authenticate success, global_id 4377 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a9c44d640 10 monclient: _renew_subs 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a9c44d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8a941413b0 con 0x7f8a940b5cf0 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a9c44d640 10 client.4377.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a9c44d640 10 monclient: _renew_subs 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a9c44d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8a941fcc90 con 0x7f8a940b5cf0 2026-02-24T19:17:52.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.652+0000 7f8a9c44d640 1 librados: init done 2026-02-24T19:17:52.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.653+0000 7f8a9c44d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:52.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.653+0000 7f8a9c44d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:52.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.653+0000 7f8a9c44d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.653+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a94160b20 con 0x7f8a940b5cf0 2026-02-24T19:17:52.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.785+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a840048d0 con 0x7f8a940b5cf0 2026-02-24T19:17:52.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.785+0000 7f8a7affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:52.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.785+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8a84004b00 con 0x7f8a940b5cf0 2026-02-24T19:17:52.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.785+0000 7f8a7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:52.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.785+0000 7f8a989bf640 4 set_mon_vals no callback set 2026-02-24T19:17:52.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.785+0000 7f8a7affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:52.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.785+0000 7f8a7affd640 10 monclient: dump: 2026-02-24T19:17:52.787 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:52.788 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.788 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.788 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:52.788 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:52.788 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.788 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:52.788 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:52.788 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:52.788 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.785+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f8a84004ce0 con 0x7f8a940b5cf0 2026-02-24T19:17:52.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.786+0000 7f8a999c1640 10 monclient: get_auth_request con 0x7f8a64077d50 auth_method 0 2026-02-24T19:17:52.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.786+0000 7f8a7affd640 10 client.4377.objecter ms_handle_connect 0x7f8a64077d50 2026-02-24T19:17:52.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.789+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f8a840933f0 con 0x7f8a940b5cf0 2026-02-24T19:17:52.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.789+0000 7f8a7affd640 10 client.4377.objecter ms_dispatch2 0x7f8a94000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:52.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.789+0000 7f8a7affd640 3 client.4377.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:52.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.789+0000 7f8a7affd640 3 client.4377.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:52.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.790+0000 7f8a7affd640 20 client.4377.objecter dump_active .. 0 homeless 2026-02-24T19:17:52.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.790+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8a8405de20 con 0x7f8a940b5cf0 2026-02-24T19:17:52.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.790+0000 7f8a7affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:52.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.790+0000 7f8a7affd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:52.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.894+0000 7f8a9c44d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:52.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.894+0000 7f8a9c44d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:52.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.894+0000 7f8a9c44d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:52.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.894+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a94165630 con 0x7f8a940b5cf0 2026-02-24T19:17:52.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.909+0000 7f8a7affd640 1 -- 10.20.193.45:0/2490275505 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20992 (unknown 3676990683 0 2494000247) 0x7f8a8405d720 con 0x7f8a940b5cf0 2026-02-24T19:17:52.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.909+0000 7f8a7affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:52.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.909+0000 7f8a7affd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:52.911 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:17:52.911 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":29,"fsid":"738dd6f3-d81f-41eb-89dc-068883b21f11","created":"2026-02-24T19:17:05.025851+0000","modified":"2026-02-24T19:17:51.564619+0000","last_up_change":"2026-02-24T19:17:38.901135+0000","last_in_change":"2026-02-24T19:17:11.992117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:39.816057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T19:17:47.256373+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53650ce1-deec-4943-ba8b-cdf389f4e5e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":3544790624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":3544790624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":3544790624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":3544790624}]},"public_addr":"10.20.193.45:6805/3544790624","cluster_addr":"10.20.193.45:6806/3544790624","heartbeat_back_addr":"10.20.193.45:6808/3544790624","heartbeat_front_addr":"10.20.193.45:6807/3544790624","state":["exists","up"]},{"osd":1,"uuid":"e3d2506e-9e10-4206-96d1-3dd8aa4d91cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6808","nonce":1876170727}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6809","nonce":1876170727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6811","nonce":1876170727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6810","nonce":1876170727}]},"public_addr":"10.20.193.114:6808/1876170727","cluster_addr":"10.20.193.114:6809/1876170727","heartbeat_back_addr":"10.20.193.114:6811/1876170727","heartbeat_front_addr":"10.20.193.114:6810/1876170727","state":["exists","up"]},{"osd":2,"uuid":"2fe7f095-bf74-4e4a-996c-c58438826e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6800","nonce":3913807646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6801","nonce":3913807646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6803","nonce":3913807646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6802","nonce":3913807646}]},"public_addr":"10.20.193.179:6800/3913807646","cluster_addr":"10.20.193.179:6801/3913807646","heartbeat_back_addr":"10.20.193.179:6803/3913807646","heartbeat_front_addr":"10.20.193.179:6802/3913807646","state":["exists","up"]},{"osd":3,"uuid":"270148b3-6c77-4c1f-9d73-05d1c75990c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6804","nonce":3920278128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6805","nonce":3920278128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6807","nonce":3920278128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6806","nonce":3920278128}]},"public_addr":"10.20.193.194:6804/3920278128","cluster_addr":"10.20.193.194:6805/3920278128","heartbeat_back_addr":"10.20.193.194:6807/3920278128","heartbeat_front_addr":"10.20.193.194:6806/3920278128","state":["exists","up"]},{"osd":4,"uuid":"43b91f27-e730-4a81-a86b-b2fefdddd3e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1236941460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":1236941460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":1236941460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1236941460}]},"public_addr":"10.20.193.45:6801/1236941460","cluster_addr":"10.20.193.45:6802/1236941460","heartbeat_back_addr":"10.20.193.45:6804/1236941460","heartbeat_front_addr":"10.20.193.45:6803/1236941460","state":["exists","up"]},{"osd":5,"uuid":"01c901c8-775a-4e42-b73a-5db3d938dbb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6804","nonce":3576632251}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6805","nonce":3576632251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6807","nonce":3576632251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6806","nonce":3576632251}]},"public_addr":"10.20.193.114:6804/3576632251","cluster_addr":"10.20.193.114:6805/3576632251","heartbeat_back_addr":"10.20.193.114:6807/3576632251","heartbeat_front_addr":"10.20.193.114:6806/3576632251","state":["exists","up"]},{"osd":6,"uuid":"b29d58d3-b5f9-428c-8246-910655dd5490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6804","nonce":1928709825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6805","nonce":1928709825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6807","nonce":1928709825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6806","nonce":1928709825}]},"public_addr":"10.20.193.179:6804/1928709825","cluster_addr":"10.20.193.179:6805/1928709825","heartbeat_back_addr":"10.20.193.179:6807/1928709825","heartbeat_front_addr":"10.20.193.179:6806/1928709825","state":["exists","up"]},{"osd":7,"uuid":"f182ac9b-e6ee-461e-af0c-0ef4ef51c737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6800","nonce":598300563}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6801","nonce":598300563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6803","nonce":598300563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6802","nonce":598300563}]},"public_addr":"10.20.193.194:6800/598300563","cluster_addr":"10.20.193.194:6801/598300563","heartbeat_back_addr":"10.20.193.194:6803/598300563","heartbeat_front_addr":"10.20.193.194:6802/598300563","state":["exists","up"]},{"osd":8,"uuid":"b812d673-950b-4168-9a5e-d3719d569a7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":1756229077}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":1756229077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6812","nonce":1756229077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":1756229077}]},"public_addr":"10.20.193.45:6809/1756229077","cluster_addr":"10.20.193.45:6810/1756229077","heartbeat_back_addr":"10.20.193.45:6812/1756229077","heartbeat_front_addr":"10.20.193.45:6811/1756229077","state":["exists","up"]},{"osd":9,"uuid":"442018bc-d405-49b3-8934-0ab83b4613eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6800","nonce":2864194603}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6801","nonce":2864194603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6803","nonce":2864194603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6802","nonce":2864194603}]},"public_addr":"10.20.193.114:6800/2864194603","cluster_addr":"10.20.193.114:6801/2864194603","heartbeat_back_addr":"10.20.193.114:6803/2864194603","heartbeat_front_addr":"10.20.193.114:6802/2864194603","state":["exists","up"]},{"osd":10,"uuid":"e5bf8aa9-8c19-494b-bd7a-c5da71af847b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6808","nonce":2982984950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6809","nonce":2982984950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6811","nonce":2982984950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6810","nonce":2982984950}]},"public_addr":"10.20.193.179:6808/2982984950","cluster_addr":"10.20.193.179:6809/2982984950","heartbeat_back_addr":"10.20.193.179:6811/2982984950","heartbeat_front_addr":"10.20.193.179:6810/2982984950","state":["exists","up"]},{"osd":11,"uuid":"6cb63f95-82e0-483f-926b-94a88b3c54f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6812","nonce":1154629099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6813","nonce":1154629099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6815","nonce":1154629099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6814","nonce":1154629099}]},"public_addr":"10.20.193.194:6812/1154629099","cluster_addr":"10.20.193.194:6813/1154629099","heartbeat_back_addr":"10.20.193.194:6815/1154629099","heartbeat_front_addr":"10.20.193.194:6814/1154629099","state":["exists","up"]},{"osd":12,"uuid":"b15b2174-466b-4e9a-9c6d-ed8caabe7b28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6813","nonce":2990889504}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6814","nonce":2990889504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6816","nonce":2990889504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6815","nonce":2990889504}]},"public_addr":"10.20.193.45:6813/2990889504","cluster_addr":"10.20.193.45:6814/2990889504","heartbeat_back_addr":"10.20.193.45:6816/2990889504","heartbeat_front_addr":"10.20.193.45:6815/2990889504","state":["exists","up"]},{"osd":13,"uuid":"d4e5150e-a985-488e-a911-45bf3431c165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6812","nonce":3533295890}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6813","nonce":3533295890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6815","nonce":3533295890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6814","nonce":3533295890}]},"public_addr":"10.20.193.114:6812/3533295890","cluster_addr":"10.20.193.114:6813/3533295890","heartbeat_back_addr":"10.20.193.114:6815/3533295890","heartbeat_front_addr":"10.20.193.114:6814/3533295890","state":["exists","up"]},{"osd":14,"uuid":"0d938446-8802-44bc-be90-db79361a5200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6812","nonce":1196591242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6813","nonce":1196591242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6815","nonce":1196591242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6814","nonce":1196591242}]},"public_addr":"10.20.193.179:6812/1196591242","cluster_addr":"10.20.193.179:6813/1196591242","heartbeat_back_addr":"10.20.193.179:6815/1196591242","heartbeat_front_addr":"10.20.193.179:6814/1196591242","state":["exists","up"]},{"osd":15,"uuid":"168bd4e0-e43c-4581-819c-9ed544805d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6808","nonce":4057136445}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6809","nonce":4057136445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6811","nonce":4057136445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6810","nonce":4057136445}]},"public_addr":"10.20.193.194:6808/4057136445","cluster_addr":"10.20.193.194:6809/4057136445","heartbeat_back_addr":"10.20.193.194:6811/4057136445","heartbeat_front_addr":"10.20.193.194:6810/4057136445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.220980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.228412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.338875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.688002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.014119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.286056+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.427234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.631440+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.219386+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.261939+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.709299+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.693747+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.443973+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.370797+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.581997+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.896088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:52.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 10 librados: watch_flush enter 2026-02-24T19:17:52.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 10 librados: watch_flush exit 2026-02-24T19:17:52.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 20 client.4377.objecter shutdown clearing up homeless session... 2026-02-24T19:17:52.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 10 client.4377.objecter successfully canceled tick 2026-02-24T19:17:52.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 >> v1:10.20.193.45:6800/1599977652 conn(0x7f8a64077d50 legacy=0x7f8a64098200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 10 monclient: shutdown 2026-02-24T19:17:52.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:52.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 >> v1:10.20.193.45:6789/0 conn(0x7f8a940b5cf0 legacy=0x7f8a94141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 shutdown_connections 2026-02-24T19:17:52.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 >> 10.20.193.45:0/2490275505 conn(0x7f8a940b5210 msgr2=0x7f8a9413dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:52.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 shutdown_connections 2026-02-24T19:17:52.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 1 -- 10.20.193.45:0/2490275505 wait complete. 2026-02-24T19:17:52.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.910+0000 7f8a9c44d640 1 librados: shutdown 2026-02-24T19:17:52.922 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-24T19:17:52.922 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:52.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 10 monclient: get_monmap_and_config 2026-02-24T19:17:52.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 10 monclient: build_initial_monmap 2026-02-24T19:17:52.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 10 monclient: monmap: 2026-02-24T19:17:52.989 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:52.989 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:52.989 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:52.987102+0000 2026-02-24T19:17:52.989 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:52.987102+0000 2026-02-24T19:17:52.989 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:52.989 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:52.989 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:52.990 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:52.990 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:52.990 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:52.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 1 Processor -- start 2026-02-24T19:17:52.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 1 -- start start 2026-02-24T19:17:52.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 10 monclient: init 2026-02-24T19:17:52.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:52.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:52.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 10 monclient(hunting): picked mon.noname-b con 0x7f8548058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 10 monclient(hunting): picked mon.noname-a con 0x7f85480b0410 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 10 monclient(hunting): picked mon.noname-c con 0x7f85481626a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85481655c0 con 0x7f85480b0410 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.987+0000 7f854ff33640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85480b12b0 con 0x7f8548058da0 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.988+0000 7f854ff33640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85480b1590 con 0x7f85481626a0 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.988+0000 7f854ff33640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.988+0000 7f854ff33640 10 monclient(hunting): authenticate will time out at 3644.626007s 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.988+0000 7f854dca8640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f8548058da0 0x7f85481647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48668/0 (socket says 10.20.193.45:48668) 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.988+0000 7f854dca8640 1 -- 10.20.193.45:0/3390733220 learned_addr learned my addr 10.20.193.45:0/3390733220 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894774199 0 0) 0x7f85480b12b0 con 0x7f8548058da0 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): my global_id is 4369 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8530003610 con 0x7f8548058da0 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 549444120 0 0) 0x7f85481655c0 con 0x7f85480b0410 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): my global_id is 4380 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85480b12b0 con 0x7f85480b0410 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1263326770 0 0) 0x7f85480b1590 con 0x7f85481626a0 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): _negotiate 2026-02-24T19:17:52.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:52.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:52.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 10 monclient(hunting): my global_id is 4379 2026-02-24T19:17:52.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.989+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85481655c0 con 0x7f85481626a0 2026-02-24T19:17:52.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3879104510 0 0) 0x7f85481655c0 con 0x7f85481626a0 2026-02-24T19:17:52.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 >> v1:10.20.193.114:6789/0 conn(0x7f8548058da0 legacy=0x7f85481647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 >> v1:10.20.193.45:6789/0 conn(0x7f85480b0410 legacy=0x7f8548164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:52.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 10 monclient: _finish_hunting 0 2026-02-24T19:17:52.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 1 monclient: found mon.noname-c 2026-02-24T19:17:52.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:52.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85480b1870 con 0x7f85481626a0 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8544003150 con 0x7f85481626a0 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854cca6640 10 monclient: dump: 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.000 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854ff33640 5 monclient: authenticate success, global_id 4379 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.991+0000 7f854ff33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f85440032f0 con 0x7f85481626a0 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854cca6640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854cca6640 1 -- 10.20.193.45:0/3390733220 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f85440036f0 con 0x7f85481626a0 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854cca6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854cca6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854cca6640 10 monclient: dump: 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854ff33640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854ff33640 4 set_mon_vals no callback set 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854ff33640 10 monclient: shutdown 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854ff33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.992+0000 7f854ff33640 1 -- 10.20.193.45:0/3390733220 >> v1:10.20.193.179:6789/0 conn(0x7f85481626a0 legacy=0x7f85481c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 -- 10.20.193.45:0/3390733220 shutdown_connections 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 -- 10.20.193.45:0/3390733220 >> 10.20.193.45:0/3390733220 conn(0x7f85480b65f0 msgr2=0x7f85480b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 -- 10.20.193.45:0/3390733220 shutdown_connections 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 -- 10.20.193.45:0/3390733220 wait complete. 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 10 monclient: monmap: 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.003 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 librados: starting msgr at 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 librados: starting objecter 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 Processor -- start 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 -- start start 2026-02-24T19:17:53.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 librados: setting wanted keys 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 1 librados: calling monclient init 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.993+0000 7f854ff33640 10 monclient: init 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 10 monclient(hunting): picked mon.noname-b con 0x7f8548058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 10 monclient(hunting): picked mon.noname-c con 0x7f85480b0410 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 10 monclient(hunting): picked mon.noname-a con 0x7f85481626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8548150db0 con 0x7f85481626a0 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854811d280 con 0x7f8548058da0 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854811d560 con 0x7f85480b0410 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854ff33640 10 monclient(hunting): authenticate will time out at 3644.632157s 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854dca8640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f8548058da0 0x7f85481506a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48684/0 (socket says 10.20.193.45:48684) 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f854dca8640 1 -- 10.20.193.45:0/2066582968 learned_addr learned my addr 10.20.193.45:0/2066582968 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f85367fc640 10 client.?.objecter ms_handle_connect 0x7f8548058da0 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f85367fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f85367fc640 10 client.?.objecter ms_handle_connect 0x7f85480b0410 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.994+0000 7f85367fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 client.?.objecter ms_handle_connect 0x7f85481626a0 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909619236 0 0) 0x7f854811d280 con 0x7f8548058da0 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 monclient(hunting): my global_id is 4372 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8518003610 con 0x7f8548058da0 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652398431 0 0) 0x7f854811d560 con 0x7f85480b0410 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 10 monclient(hunting): my global_id is 4382 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.995+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f854811d280 con 0x7f85480b0410 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.996+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1020758080 0 0) 0x7f8548150db0 con 0x7f85481626a0 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.996+0000 7f85367fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.996+0000 7f85367fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.996+0000 7f85367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.996+0000 7f85367fc640 10 monclient(hunting): my global_id is 4383 2026-02-24T19:17:53.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.996+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f854811d560 con 0x7f85481626a0 2026-02-24T19:17:53.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1224966236 0 0) 0x7f854811d280 con 0x7f85480b0410 2026-02-24T19:17:53.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8548150db0 con 0x7f85480b0410 2026-02-24T19:17:53.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f853c0031c0 con 0x7f85480b0410 2026-02-24T19:17:53.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): dump: 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.012 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 44522889 0 0) 0x7f8518003610 con 0x7f8548058da0 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f854811d280 con 0x7f8548058da0 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f85380030b0 con 0x7f8548058da0 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): dump: 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.013 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 613494093 0 0) 0x7f854811d560 con 0x7f85481626a0 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8518003610 con 0x7f85481626a0 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8544003640 con 0x7f85481626a0 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.998+0000 7f85367fc640 10 monclient(hunting): dump: 2026-02-24T19:17:53.014 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 625828810 0 0) 0x7f8548150db0 con 0x7f85480b0410 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 >> v1:10.20.193.114:6789/0 conn(0x7f8548058da0 legacy=0x7f85481506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 >> v1:10.20.193.45:6789/0 conn(0x7f85481626a0 legacy=0x7f8548120cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 1 monclient: found mon.c 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854811d840 con 0x7f85480b0410 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f85367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f854ff33640 5 monclient: authenticate success, global_id 4382 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f854ff33640 10 monclient: _renew_subs 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f854ff33640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f854811db20 con 0x7f85480b0410 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f854ff33640 10 client.4382.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f854ff33640 10 monclient: _renew_subs 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f854ff33640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f854811ea30 con 0x7f85480b0410 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:52.999+0000 7f854ff33640 1 librados: init done 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.000+0000 7f854ff33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.000+0000 7f854ff33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.000+0000 7f854ff33640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.000+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8548055260 con 0x7f85480b0410 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.000+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f853c003610 con 0x7f85480b0410 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.000+0000 7f85367fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.000+0000 7f8537fff640 4 set_mon_vals no callback set 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.007+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f853c0039a0 con 0x7f85480b0410 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.007+0000 7f85367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.007+0000 7f85367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.007+0000 7f85367fc640 10 monclient: dump: 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.008+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f853c003bc0 con 0x7f85480b0410 2026-02-24T19:17:53.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.008+0000 7f854dca8640 10 monclient: get_auth_request con 0x7f8518077e70 auth_method 0 2026-02-24T19:17:53.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.009+0000 7f85367fc640 10 client.4382.objecter ms_handle_connect 0x7f8518077e70 2026-02-24T19:17:53.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.009+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f853c0582e0 con 0x7f85480b0410 2026-02-24T19:17:53.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.009+0000 7f85367fc640 10 client.4382.objecter ms_dispatch2 0x7f8548000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.009+0000 7f85367fc640 3 client.4382.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.009+0000 7f85367fc640 3 client.4382.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.009+0000 7f85367fc640 20 client.4382.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.095+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8548055260 con 0x7f85480b0410 2026-02-24T19:17:53.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.095+0000 7f85367fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.095+0000 7f85367fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:53.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.199+0000 7f854ff33640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:53.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.199+0000 7f854ff33640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:53.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.199+0000 7f854ff33640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.199+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8548059e60 con 0x7f85480b0410 2026-02-24T19:17:53.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.258+0000 7f85367fc640 1 -- 10.20.193.45:0/2066582968 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20992 (unknown 3676990683 0 2494000247) 0x7f853c05ca50 con 0x7f85480b0410 2026-02-24T19:17:53.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.258+0000 7f85367fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:53.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.258+0000 7f85367fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:53.261 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:17:53.261 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":29,"fsid":"738dd6f3-d81f-41eb-89dc-068883b21f11","created":"2026-02-24T19:17:05.025851+0000","modified":"2026-02-24T19:17:51.564619+0000","last_up_change":"2026-02-24T19:17:38.901135+0000","last_in_change":"2026-02-24T19:17:11.992117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:39.816057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T19:17:47.256373+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53650ce1-deec-4943-ba8b-cdf389f4e5e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":3544790624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":3544790624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":3544790624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":3544790624}]},"public_addr":"10.20.193.45:6805/3544790624","cluster_addr":"10.20.193.45:6806/3544790624","heartbeat_back_addr":"10.20.193.45:6808/3544790624","heartbeat_front_addr":"10.20.193.45:6807/3544790624","state":["exists","up"]},{"osd":1,"uuid":"e3d2506e-9e10-4206-96d1-3dd8aa4d91cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6808","nonce":1876170727}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6809","nonce":1876170727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6811","nonce":1876170727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6810","nonce":1876170727}]},"public_addr":"10.20.193.114:6808/1876170727","cluster_addr":"10.20.193.114:6809/1876170727","heartbeat_back_addr":"10.20.193.114:6811/1876170727","heartbeat_front_addr":"10.20.193.114:6810/1876170727","state":["exists","up"]},{"osd":2,"uuid":"2fe7f095-bf74-4e4a-996c-c58438826e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6800","nonce":3913807646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6801","nonce":3913807646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6803","nonce":3913807646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6802","nonce":3913807646}]},"public_addr":"10.20.193.179:6800/3913807646","cluster_addr":"10.20.193.179:6801/3913807646","heartbeat_back_addr":"10.20.193.179:6803/3913807646","heartbeat_front_addr":"10.20.193.179:6802/3913807646","state":["exists","up"]},{"osd":3,"uuid":"270148b3-6c77-4c1f-9d73-05d1c75990c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6804","nonce":3920278128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6805","nonce":3920278128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6807","nonce":3920278128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6806","nonce":3920278128}]},"public_addr":"10.20.193.194:6804/3920278128","cluster_addr":"10.20.193.194:6805/3920278128","heartbeat_back_addr":"10.20.193.194:6807/3920278128","heartbeat_front_addr":"10.20.193.194:6806/3920278128","state":["exists","up"]},{"osd":4,"uuid":"43b91f27-e730-4a81-a86b-b2fefdddd3e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1236941460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":1236941460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":1236941460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1236941460}]},"public_addr":"10.20.193.45:6801/1236941460","cluster_addr":"10.20.193.45:6802/1236941460","heartbeat_back_addr":"10.20.193.45:6804/1236941460","heartbeat_front_addr":"10.20.193.45:6803/1236941460","state":["exists","up"]},{"osd":5,"uuid":"01c901c8-775a-4e42-b73a-5db3d938dbb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6804","nonce":3576632251}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6805","nonce":3576632251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6807","nonce":3576632251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6806","nonce":3576632251}]},"public_addr":"10.20.193.114:6804/3576632251","cluster_addr":"10.20.193.114:6805/3576632251","heartbeat_back_addr":"10.20.193.114:6807/3576632251","heartbeat_front_addr":"10.20.193.114:6806/3576632251","state":["exists","up"]},{"osd":6,"uuid":"b29d58d3-b5f9-428c-8246-910655dd5490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6804","nonce":1928709825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6805","nonce":1928709825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6807","nonce":1928709825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6806","nonce":1928709825}]},"public_addr":"10.20.193.179:6804/1928709825","cluster_addr":"10.20.193.179:6805/1928709825","heartbeat_back_addr":"10.20.193.179:6807/1928709825","heartbeat_front_addr":"10.20.193.179:6806/1928709825","state":["exists","up"]},{"osd":7,"uuid":"f182ac9b-e6ee-461e-af0c-0ef4ef51c737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6800","nonce":598300563}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6801","nonce":598300563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6803","nonce":598300563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6802","nonce":598300563}]},"public_addr":"10.20.193.194:6800/598300563","cluster_addr":"10.20.193.194:6801/598300563","heartbeat_back_addr":"10.20.193.194:6803/598300563","heartbeat_front_addr":"10.20.193.194:6802/598300563","state":["exists","up"]},{"osd":8,"uuid":"b812d673-950b-4168-9a5e-d3719d569a7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":1756229077}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":1756229077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6812","nonce":1756229077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":1756229077}]},"public_addr":"10.20.193.45:6809/1756229077","cluster_addr":"10.20.193.45:6810/1756229077","heartbeat_back_addr":"10.20.193.45:6812/1756229077","heartbeat_front_addr":"10.20.193.45:6811/1756229077","state":["exists","up"]},{"osd":9,"uuid":"442018bc-d405-49b3-8934-0ab83b4613eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6800","nonce":2864194603}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6801","nonce":2864194603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6803","nonce":2864194603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6802","nonce":2864194603}]},"public_addr":"10.20.193.114:6800/2864194603","cluster_addr":"10.20.193.114:6801/2864194603","heartbeat_back_addr":"10.20.193.114:6803/2864194603","heartbeat_front_addr":"10.20.193.114:6802/2864194603","state":["exists","up"]},{"osd":10,"uuid":"e5bf8aa9-8c19-494b-bd7a-c5da71af847b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6808","nonce":2982984950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6809","nonce":2982984950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6811","nonce":2982984950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6810","nonce":2982984950}]},"public_addr":"10.20.193.179:6808/2982984950","cluster_addr":"10.20.193.179:6809/2982984950","heartbeat_back_addr":"10.20.193.179:6811/2982984950","heartbeat_front_addr":"10.20.193.179:6810/2982984950","state":["exists","up"]},{"osd":11,"uuid":"6cb63f95-82e0-483f-926b-94a88b3c54f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6812","nonce":1154629099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6813","nonce":1154629099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6815","nonce":1154629099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6814","nonce":1154629099}]},"public_addr":"10.20.193.194:6812/1154629099","cluster_addr":"10.20.193.194:6813/1154629099","heartbeat_back_addr":"10.20.193.194:6815/1154629099","heartbeat_front_addr":"10.20.193.194:6814/1154629099","state":["exists","up"]},{"osd":12,"uuid":"b15b2174-466b-4e9a-9c6d-ed8caabe7b28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6813","nonce":2990889504}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6814","nonce":2990889504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6816","nonce":2990889504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6815","nonce":2990889504}]},"public_addr":"10.20.193.45:6813/2990889504","cluster_addr":"10.20.193.45:6814/2990889504","heartbeat_back_addr":"10.20.193.45:6816/2990889504","heartbeat_front_addr":"10.20.193.45:6815/2990889504","state":["exists","up"]},{"osd":13,"uuid":"d4e5150e-a985-488e-a911-45bf3431c165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6812","nonce":3533295890}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6813","nonce":3533295890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6815","nonce":3533295890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6814","nonce":3533295890}]},"public_addr":"10.20.193.114:6812/3533295890","cluster_addr":"10.20.193.114:6813/3533295890","heartbeat_back_addr":"10.20.193.114:6815/3533295890","heartbeat_front_addr":"10.20.193.114:6814/3533295890","state":["exists","up"]},{"osd":14,"uuid":"0d938446-8802-44bc-be90-db79361a5200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6812","nonce":1196591242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6813","nonce":1196591242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6815","nonce":1196591242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6814","nonce":1196591242}]},"public_addr":"10.20.193.179:6812/1196591242","cluster_addr":"10.20.193.179:6813/1196591242","heartbeat_back_addr":"10.20.193.179:6815/1196591242","heartbeat_front_addr":"10.20.193.179:6814/1196591242","state":["exists","up"]},{"osd":15,"uuid":"168bd4e0-e43c-4581-819c-9ed544805d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6808","nonce":4057136445}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6809","nonce":4057136445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6811","nonce":4057136445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6810","nonce":4057136445}]},"public_addr":"10.20.193.194:6808/4057136445","cluster_addr":"10.20.193.194:6809/4057136445","heartbeat_back_addr":"10.20.193.194:6811/4057136445","heartbeat_front_addr":"10.20.193.194:6810/4057136445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.220980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.228412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.338875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.688002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.014119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.286056+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.427234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.631440+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.219386+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.261939+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.709299+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.693747+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.443973+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.370797+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.581997+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.896088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 10 librados: watch_flush enter 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 10 librados: watch_flush exit 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 20 client.4382.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 10 client.4382.objecter successfully canceled tick 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 >> v1:10.20.193.45:6800/1599977652 conn(0x7f8518077e70 legacy=0x7f8518098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 10 monclient: shutdown 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 >> v1:10.20.193.179:6789/0 conn(0x7f85480b0410 legacy=0x7f854811e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 shutdown_connections 2026-02-24T19:17:53.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 >> 10.20.193.45:0/2066582968 conn(0x7f85480b65f0 msgr2=0x7f854805bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 shutdown_connections 2026-02-24T19:17:53.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 1 -- 10.20.193.45:0/2066582968 wait complete. 2026-02-24T19:17:53.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.260+0000 7f854ff33640 1 librados: shutdown 2026-02-24T19:17:53.272 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-24T19:17:53.273 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-24T19:17:53.273 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-24T19:17:53.274 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-24T19:17:53.274 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-24T19:17:53.274 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-24T19:17:53.275 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-24T19:17:53.275 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-24T19:17:53.276 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-24T19:17:53.276 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-24T19:17:53.277 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-24T19:17:53.277 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-24T19:17:53.277 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-24T19:17:53.278 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-24T19:17:53.278 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-24T19:17:53.278 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-24T19:17:53.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.356+0000 7fdefee24640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.356+0000 7fdefee24640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.356+0000 7fdefee24640 10 monclient: monmap: 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.356745+0000 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.356745+0000 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.359 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.360 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.360 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7f80f7055640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7f80f7055640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7f80f7055640 10 monclient: monmap: 2026-02-24T19:17:53.360 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.360 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.360 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.357154+0000 2026-02-24T19:17:53.361 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.357154+0000 2026-02-24T19:17:53.361 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.361 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.361 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.361 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.361 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.361 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7fdefee24640 1 Processor -- start 2026-02-24T19:17:53.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7fdefee24640 1 -- start start 2026-02-24T19:17:53.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7fdefee24640 10 monclient: init 2026-02-24T19:17:53.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7f80f7055640 1 Processor -- start 2026-02-24T19:17:53.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7f80f7055640 1 -- start start 2026-02-24T19:17:53.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7f80f7055640 10 monclient: init 2026-02-24T19:17:53.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.357+0000 7fdefee24640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefee24640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefee24640 10 monclient(hunting): picked mon.noname-b con 0x7fdef8155b20 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefee24640 10 monclient(hunting): picked mon.noname-c con 0x7fdef805b740 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefee24640 10 monclient(hunting): picked mon.noname-a con 0x7fdef8162f10 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefee24640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef80b18f0 con 0x7fdef8162f10 2026-02-24T19:17:53.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefee24640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef80b1bd0 con 0x7fdef8155b20 2026-02-24T19:17:53.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefee24640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef80b1eb0 con 0x7fdef805b740 2026-02-24T19:17:53.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefee24640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefee24640 10 monclient(hunting): authenticate will time out at 3644.996161s 2026-02-24T19:17:53.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 10 monclient(hunting): picked mon.noname-a con 0x7f80f00b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 10 monclient(hunting): picked mon.noname-c con 0x7f80f00ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 10 monclient(hunting): picked mon.noname-b con 0x7f80f00585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f0163930 con 0x7f80f00b9f80 2026-02-24T19:17:53.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f0163bb0 con 0x7f80f00585e0 2026-02-24T19:17:53.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f0163e90 con 0x7f80f00ba350 2026-02-24T19:17:53.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f7055640 10 monclient(hunting): authenticate will time out at 3644.996393s 2026-02-24T19:17:53.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefcb99640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fdef8155b20 0x7fdef80b0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48690/0 (socket says 10.20.193.45:48690) 2026-02-24T19:17:53.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7fdefcb99640 1 -- 10.20.193.45:0/3839711878 learned_addr learned my addr 10.20.193.45:0/3839711878 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f67af6e1640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f67af6e1640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f67af6e1640 10 monclient: monmap: 2026-02-24T19:17:53.367 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.367 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.367 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.358889+0000 2026-02-24T19:17:53.367 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.358889+0000 2026-02-24T19:17:53.367 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.367 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.368 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.368 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.368 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.368 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f4dca640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f80f00b9f80 0x7f80f0163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43778/0 (socket says 10.20.193.45:43778) 2026-02-24T19:17:53.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.358+0000 7f80f4dca640 1 -- 10.20.193.45:0/1861743926 learned_addr learned my addr 10.20.193.45:0/1861743926 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.359+0000 7f5b1ce13640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.359+0000 7f5b1ce13640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.359+0000 7f5b1ce13640 10 monclient: monmap: 2026-02-24T19:17:53.369 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.369 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.370 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.359281+0000 2026-02-24T19:17:53.370 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.359281+0000 2026-02-24T19:17:53.370 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.370 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.370 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.370 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.370 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.370 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.359+0000 7f67af6e1640 1 Processor -- start 2026-02-24T19:17:53.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.359+0000 7f67af6e1640 1 -- start start 2026-02-24T19:17:53.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.359+0000 7f67af6e1640 10 monclient: init 2026-02-24T19:17:53.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.359+0000 7f5b1ce13640 1 Processor -- start 2026-02-24T19:17:53.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f5b1ce13640 1 -- start start 2026-02-24T19:17:53.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f5b1ce13640 10 monclient: init 2026-02-24T19:17:53.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 10 monclient(hunting): picked mon.noname-c con 0x7f67a8159a70 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 10 monclient(hunting): picked mon.noname-b con 0x7f67a8159e40 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 10 monclient(hunting): picked mon.noname-a con 0x7f67a8058070 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a8163930 con 0x7f67a8058070 2026-02-24T19:17:53.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a8163bf0 con 0x7f67a8159e40 2026-02-24T19:17:53.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a8163ed0 con 0x7f67a8159a70 2026-02-24T19:17:53.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f67af6e1640 10 monclient(hunting): authenticate will time out at 3644.998442s 2026-02-24T19:17:53.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202434380 0 0) 0x7fdef80b1bd0 con 0x7fdef8155b20 2026-02-24T19:17:53.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7fdeef7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7fdeef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7fdeef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7fdeef7fe640 10 monclient(hunting): my global_id is 4375 2026-02-24T19:17:53.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee4003610 con 0x7fdef8155b20 2026-02-24T19:17:53.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f456e493640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f456e493640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f456e493640 10 monclient: monmap: 2026-02-24T19:17:53.375 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.375 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.375 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.360766+0000 2026-02-24T19:17:53.375 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.360766+0000 2026-02-24T19:17:53.375 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.375 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.376 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.376 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.376 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.376 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f5b1ce13640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f5b1ce13640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f5b1ce13640 10 monclient(hunting): picked mon.noname-c con 0x7f5b1815b0a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f5b1ce13640 10 monclient(hunting): picked mon.noname-a con 0x7f5b180b3190 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f5b1ce13640 10 monclient(hunting): picked mon.noname-b con 0x7f5b180b5da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f5b1ce13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b180b3610 con 0x7f5b180b3190 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.360+0000 7f5b1ce13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b180b38f0 con 0x7f5b180b5da0 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f5b1ce13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b180b3bd0 con 0x7f5b1815b0a0 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f5b1ce13640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f5b1ce13640 10 monclient(hunting): authenticate will time out at 3644.999022s 2026-02-24T19:17:53.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f456e493640 1 Processor -- start 2026-02-24T19:17:53.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f456e493640 1 -- start start 2026-02-24T19:17:53.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f456e493640 10 monclient: init 2026-02-24T19:17:53.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370706410 0 0) 0x7fdef80b1eb0 con 0x7fdef805b740 2026-02-24T19:17:53.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7fdeef7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7fdeef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7fdeef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7fdeef7fe640 10 monclient(hunting): my global_id is 4385 2026-02-24T19:17:53.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdef80b1bd0 con 0x7fdef805b740 2026-02-24T19:17:53.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f67adc57640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f67a8058070 0x7f67a8058460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43784/0 (socket says 10.20.193.45:43784) 2026-02-24T19:17:53.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f67adc57640 1 -- 10.20.193.45:0/852266308 learned_addr learned my addr 10.20.193.45:0/852266308 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f5b16575640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f5b1815b0a0 0x7f5b18162300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35682/0 (socket says 10.20.193.45:35682) 2026-02-24T19:17:53.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f5b16575640 1 -- 10.20.193.45:0/3841128557 learned_addr learned my addr 10.20.193.45:0/3841128557 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f456e493640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f456e493640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f456e493640 10 monclient(hunting): picked mon.noname-c con 0x7f45680b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f456e493640 10 monclient(hunting): picked mon.noname-a con 0x7f45680ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f456e493640 10 monclient(hunting): picked mon.noname-b con 0x7f45680585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.361+0000 7f456e493640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4568163930 con 0x7f45680ba350 2026-02-24T19:17:53.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f456e493640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4568163bb0 con 0x7f45680585e0 2026-02-24T19:17:53.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f456e493640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4568163e90 con 0x7f45680b9f80 2026-02-24T19:17:53.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f456e493640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f456e493640 10 monclient(hunting): authenticate will time out at 3645.000073s 2026-02-24T19:17:53.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521560791 0 0) 0x7f80f0163e90 con 0x7f80f00ba350 2026-02-24T19:17:53.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f80e77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f80e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f80e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f80e77fe640 10 monclient(hunting): my global_id is 4388 2026-02-24T19:17:53.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80dc003610 con 0x7f80f00ba350 2026-02-24T19:17:53.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f456ca09640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f45680585e0 0x7f4568166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48734/0 (socket says 10.20.193.45:48734) 2026-02-24T19:17:53.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.362+0000 7f456ca09640 1 -- 10.20.193.45:0/1287227828 learned_addr learned my addr 10.20.193.45:0/1287227828 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.364+0000 7f5abf888640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.364+0000 7f5abf888640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.364+0000 7f5abf888640 10 monclient: monmap: 2026-02-24T19:17:53.384 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.364180+0000 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.364180+0000 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.364+0000 7f5abf888640 1 Processor -- start 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.364+0000 7f5abf888640 1 -- start start 2026-02-24T19:17:53.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.364+0000 7f5abf888640 10 monclient: init 2026-02-24T19:17:53.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f2c88b8a640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f2c88b8a640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f2c88b8a640 10 monclient: monmap: 2026-02-24T19:17:53.386 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.386 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.386 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.365223+0000 2026-02-24T19:17:53.386 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.365223+0000 2026-02-24T19:17:53.386 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.386 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.387 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.387 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.387 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.387 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 10 monclient(hunting): picked mon.noname-b con 0x7f5ab80b7910 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2669217471 0 0) 0x7f67a8163930 con 0x7f67a8058070 2026-02-24T19:17:53.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 10 monclient(hunting): my global_id is 4392 2026-02-24T19:17:53.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 10 monclient(hunting): picked mon.noname-c con 0x7f5ab805a180 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6790003610 con 0x7f67a8058070 2026-02-24T19:17:53.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 10 monclient(hunting): picked mon.noname-a con 0x7f5ab80b5d20 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab8058e00 con 0x7f5ab80b5d20 2026-02-24T19:17:53.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab80590e0 con 0x7f5ab80b7910 2026-02-24T19:17:53.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab80593c0 con 0x7f5ab805a180 2026-02-24T19:17:53.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f5abf888640 10 monclient(hunting): authenticate will time out at 3645.003434s 2026-02-24T19:17:53.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 583192014 0 0) 0x7f67a8163bf0 con 0x7f67a8159e40 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 10 monclient(hunting): my global_id is 4381 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67a8163930 con 0x7f67a8159e40 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574930371 0 0) 0x7f80f0163bb0 con 0x7f80f00585e0 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f80e77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f80e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f80e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f80e77fe640 10 monclient(hunting): my global_id is 4378 2026-02-24T19:17:53.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80f0163e90 con 0x7f80f00585e0 2026-02-24T19:17:53.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f2c88b8a640 1 Processor -- start 2026-02-24T19:17:53.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f2c88b8a640 1 -- start start 2026-02-24T19:17:53.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7f2c88b8a640 10 monclient: init 2026-02-24T19:17:53.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 128596331 0 0) 0x7fdee4003610 con 0x7fdef8155b20 2026-02-24T19:17:53.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 >> v1:10.20.193.179:6789/0 conn(0x7fdef805b740 legacy=0x7fdef8162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 >> v1:10.20.193.45:6789/0 conn(0x7fdef8162f10 legacy=0x7fdef8056c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef80b2190 con 0x7fdef8155b20 2026-02-24T19:17:53.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdee8002df0 con 0x7fdef8155b20 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdeef7fe640 10 monclient: dump: 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.394 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.395 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdefee24640 5 monclient: authenticate success, global_id 4375 2026-02-24T19:17:53.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f5b15573640 1 -- 10.20.193.45:0/3841128557 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172698961 0 0) 0x7f5b180b3bd0 con 0x7f5b1815b0a0 2026-02-24T19:17:53.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f5b15573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.365+0000 7fdefee24640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f5b15573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f5b15573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f5b15573640 10 monclient(hunting): my global_id is 4391 2026-02-24T19:17:53.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f5b15573640 1 -- 10.20.193.45:0/3841128557 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b04003610 con 0x7f5b1815b0a0 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 10 monclient(hunting): picked mon.noname-a con 0x7f2c840b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 10 monclient(hunting): picked mon.noname-c con 0x7f2c840ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 10 monclient(hunting): picked mon.noname-b con 0x7f2c840585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c84163930 con 0x7f2c840b9f80 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c84163bb0 con 0x7f2c840585e0 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c84163e90 con 0x7f2c840ba350 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f2c88b8a640 10 monclient(hunting): authenticate will time out at 3645.004734s 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7ff90909f640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7ff90909f640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7ff90909f640 10 monclient: monmap: 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.366823+0000 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.366823+0000 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499939554 0 0) 0x7f80e0002840 con 0x7f80f00b9f80 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f80e77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f80e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f80e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f80e77fe640 10 monclient(hunting): my global_id is 4389 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.366+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80f0163bb0 con 0x7f80f00b9f80 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.367+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1507604208 0 0) 0x7f4558002910 con 0x7f45680ba350 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.367+0000 7f4566ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.367+0000 7f4566ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.367+0000 7f4566ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.367+0000 7f4566ffd640 10 monclient(hunting): my global_id is 4395 2026-02-24T19:17:53.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.367+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f454c003610 con 0x7f45680ba350 2026-02-24T19:17:53.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.367+0000 7ff90909f640 1 Processor -- start 2026-02-24T19:17:53.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.367+0000 7ff90909f640 1 -- start start 2026-02-24T19:17:53.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.367+0000 7ff90909f640 10 monclient: init 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 10 monclient(hunting): picked mon.noname-a con 0x7ff90415d0c0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 10 monclient(hunting): picked mon.noname-c con 0x7ff9040b0ca0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 10 monclient(hunting): picked mon.noname-b con 0x7ff9040b28b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9040b8540 con 0x7ff90415d0c0 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9040b5da0 con 0x7ff9040b28b0 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9040b6080 con 0x7ff9040b0ca0 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7ff90909f640 10 monclient(hunting): authenticate will time out at 3645.006092s 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 1 -- 10.20.193.45:0/3841128557 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1233459680 0 0) 0x7f5b04003610 con 0x7f5b1815b0a0 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 1 -- 10.20.193.45:0/3841128557 >> v1:10.20.193.114:6789/0 conn(0x7f5b180b5da0 legacy=0x7f5b180b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 1 -- 10.20.193.45:0/3841128557 >> v1:10.20.193.45:6789/0 conn(0x7f5b180b3190 legacy=0x7f5b180b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 1 -- 10.20.193.45:0/3841128557 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b180b3eb0 con 0x7f5b1815b0a0 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b15573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b1ce13640 5 monclient: authenticate success, global_id 4391 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.368+0000 7f5b1ce13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f5b15573640 1 -- 10.20.193.45:0/3841128557 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5b0c002df0 con 0x7f5b1815b0a0 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f5b15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f5b15573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f5b15573640 10 monclient: dump: 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f5b1ce13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093771438 0 0) 0x7f4568163bb0 con 0x7f45680585e0 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f4566ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f4566ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f4566ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f4566ffd640 10 monclient(hunting): my global_id is 4384 2026-02-24T19:17:53.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4558002910 con 0x7f45680585e0 2026-02-24T19:17:53.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f5abddfe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f5ab80b5d20 0x7f5ab815e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43810/0 (socket says 10.20.193.45:43810) 2026-02-24T19:17:53.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f5abddfe640 1 -- 10.20.193.45:0/746433002 learned_addr learned my addr 10.20.193.45:0/746433002 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2591024696 0 0) 0x7f80dc003610 con 0x7f80f00ba350 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 >> v1:10.20.193.114:6789/0 conn(0x7f80f00585e0 legacy=0x7f80f0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 >> v1:10.20.193.45:6789/0 conn(0x7f80f00b9f80 legacy=0x7f80f0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f00573f0 con 0x7f80f00ba350 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7fe8ce2e8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7fe8ce2e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7fe8ce2e8640 10 monclient: monmap: 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.370021+0000 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.370021+0000 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f80d8002df0 con 0x7f80f00ba350 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.369+0000 7f80f7055640 5 monclient: authenticate success, global_id 4388 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.370+0000 7f80f7055640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.370+0000 7f80e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.370+0000 7f80e77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.370+0000 7f80e77fe640 10 monclient: dump: 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.370+0000 7f80f7055640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.370+0000 7fe8ce2e8640 1 Processor -- start 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.370+0000 7fe8ce2e8640 1 -- start start 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.370+0000 7fe8ce2e8640 10 monclient: init 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 10 monclient(hunting): picked mon.noname-a con 0x7fe8c80b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 10 monclient(hunting): picked mon.noname-c con 0x7fe8c80ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4186370782 0 0) 0x7f67a8163930 con 0x7f67a8159e40 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 >> v1:10.20.193.179:6789/0 conn(0x7f67a8159a70 legacy=0x7f67a80b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 10 monclient(hunting): picked mon.noname-b con 0x7fe8c80585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 >> v1:10.20.193.45:6789/0 conn(0x7f67a8058070 legacy=0x7f67a8058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a8057590 con 0x7f67a8159e40 2026-02-24T19:17:53.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c8163930 con 0x7fe8c80b9f80 2026-02-24T19:17:53.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f679c002df0 con 0x7f67a8159e40 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c8163bb0 con 0x7fe8c80585e0 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f67af6e1640 5 monclient: authenticate success, global_id 4381 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f67af6e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6797fff640 10 monclient: dump: 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.410 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.411 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.411 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.411 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.411 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f67af6e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c8163e90 con 0x7fe8c80ba350 2026-02-24T19:17:53.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7fe8ce2e8640 10 monclient(hunting): authenticate will time out at 3645.009309s 2026-02-24T19:17:53.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1710093937 0 0) 0x7f4568163e90 con 0x7f45680b9f80 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f4566ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f4566ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f4566ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f4566ffd640 10 monclient(hunting): my global_id is 4397 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4568163bb0 con 0x7f45680b9f80 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6d028d7640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6d028d7640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6d028d7640 10 monclient: monmap: 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.371520+0000 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.371520+0000 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.412 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.413 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.371+0000 7f6d028d7640 1 Processor -- start 2026-02-24T19:17:53.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.372+0000 7f6d028d7640 1 -- start start 2026-02-24T19:17:53.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.372+0000 7f6d028d7640 10 monclient: init 2026-02-24T19:17:53.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.372+0000 7f2c82d76640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f2c840585e0 0x7f2c84166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48740/0 (socket says 10.20.193.45:48740) 2026-02-24T19:17:53.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.372+0000 7f2c82d76640 1 -- 10.20.193.45:0/4163643061 learned_addr learned my addr 10.20.193.45:0/4163643061 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 10 monclient(hunting): picked mon.noname-c con 0x7f6cfc0b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 10 monclient(hunting): picked mon.noname-b con 0x7f6cfc0ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 10 monclient(hunting): picked mon.noname-a con 0x7f6cfc0585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc163930 con 0x7f6cfc0585e0 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc163bb0 con 0x7f6cfc0ba350 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc163e90 con 0x7f6cfc0b9f80 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f6d028d7640 10 monclient(hunting): authenticate will time out at 3645.011579s 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f253a867640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f253a867640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.373+0000 7f253a867640 10 monclient: monmap: 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.373880+0000 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.373880+0000 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.414 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7fe8cc85e640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fe8c80585e0 0x7fe8c8166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48752/0 (socket says 10.20.193.45:48752) 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7fe8cc85e640 1 -- 10.20.193.45:0/1167807855 learned_addr learned my addr 10.20.193.45:0/1167807855 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7ff902575640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7ff9040b0ca0 0x7ff9040b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35730/0 (socket says 10.20.193.45:35730) 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7ff902575640 1 -- 10.20.193.45:0/4002673041 learned_addr learned my addr 10.20.193.45:0/4002673041 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80d8003000 con 0x7f80f00ba350 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80e77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80e77fe640 1 -- 10.20.193.45:0/1861743926 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f80d8003400 con 0x7f80f00ba350 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80e77fe640 10 monclient: dump: 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80f7055640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80f7055640 4 set_mon_vals no callback set 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f04bc404640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f04bc404640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f04bc404640 10 monclient: monmap: 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.374552+0000 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.374552+0000 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.416 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80f7055640 10 monclient: shutdown 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80f7055640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80f7055640 1 -- 10.20.193.45:0/1861743926 >> v1:10.20.193.179:6789/0 conn(0x7f80f00ba350 legacy=0x7f80f0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f253a867640 1 Processor -- start 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80f7055640 1 -- 10.20.193.45:0/1861743926 shutdown_connections 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80f7055640 1 -- 10.20.193.45:0/1861743926 >> 10.20.193.45:0/1861743926 conn(0x7f80f00b7990 msgr2=0x7f80f00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f253a867640 1 -- start start 2026-02-24T19:17:53.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f253a867640 10 monclient: init 2026-02-24T19:17:53.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80f7055640 1 -- 10.20.193.45:0/1861743926 shutdown_connections 2026-02-24T19:17:53.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.374+0000 7f80f7055640 1 -- 10.20.193.45:0/1861743926 wait complete. 2026-02-24T19:17:53.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 1 Processor -- start 2026-02-24T19:17:53.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 1 -- start start 2026-02-24T19:17:53.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 10 monclient: init 2026-02-24T19:17:53.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 10 monclient: monmap: 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 10 monclient(hunting): picked mon.noname-a con 0x7f25340b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 10 monclient(hunting): picked mon.noname-c con 0x7f25340ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 10 monclient(hunting): picked mon.noname-b con 0x7f25340585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2534163930 con 0x7f25340b9f80 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2534163bb0 con 0x7f25340585e0 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2534163e90 con 0x7f25340ba350 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f253a867640 10 monclient(hunting): authenticate will time out at 3645.013680s 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 1 librados: starting msgr at 2026-02-24T19:17:53.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 10 monclient(hunting): picked mon.noname-b con 0x7f04b40b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 10 monclient(hunting): picked mon.noname-a con 0x7f04b40ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 1 librados: starting objecter 2026-02-24T19:17:53.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 10 monclient(hunting): picked mon.noname-c con 0x7f04b40585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b4163930 con 0x7f04b40ba350 2026-02-24T19:17:53.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b4163bb0 con 0x7f04b40b9f80 2026-02-24T19:17:53.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b4163e90 con 0x7f04b40585e0 2026-02-24T19:17:53.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f04bc404640 10 monclient(hunting): authenticate will time out at 3645.013761s 2026-02-24T19:17:53.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 1 Processor -- start 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 1 -- start start 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 1 librados: setting wanted keys 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 1 librados: calling monclient init 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f80f7055640 10 monclient: init 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3141010629 0 0) 0x7f454c003610 con 0x7f45680ba350 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 >> v1:10.20.193.179:6789/0 conn(0x7f45680b9f80 legacy=0x7f4568163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 >> v1:10.20.193.114:6789/0 conn(0x7f45680585e0 legacy=0x7f4568166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45680573f0 con 0x7f45680ba350 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4558002fc0 con 0x7f45680ba350 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f4566ffd640 10 monclient: dump: 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f456e493640 5 monclient: authenticate success, global_id 4395 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.375+0000 7f456e493640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7fa4d7eb8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7fa4d7eb8640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7fa4d7eb8640 10 monclient: monmap: 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.376119+0000 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.376119+0000 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.423 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 10 monclient(hunting): picked mon.noname-c con 0x7f80f00585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 10 monclient(hunting): picked mon.noname-b con 0x7f80f00b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7fa4d7eb8640 1 Processor -- start 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 10 monclient(hunting): picked mon.noname-a con 0x7f80f00ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f0161500 con 0x7f80f00ba350 2026-02-24T19:17:53.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f015f760 con 0x7f80f00b9f80 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7fa4d7eb8640 1 -- start start 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7fa4d7eb8640 10 monclient: init 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80f015fa40 con 0x7f80f00585e0 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.376+0000 7f80f7055640 10 monclient(hunting): authenticate will time out at 3645.014642s 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 10 monclient(hunting): picked mon.noname-a con 0x7fa4d00b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 10 monclient(hunting): picked mon.noname-b con 0x7fa4d00ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 10 monclient(hunting): picked mon.noname-c con 0x7fa4d00585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d0163930 con 0x7fa4d00b9f80 2026-02-24T19:17:53.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d0163bb0 con 0x7fa4d00ba350 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d0163e90 con 0x7fa4d00585e0 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.377+0000 7fa4d7eb8640 10 monclient(hunting): authenticate will time out at 3645.015178s 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f2c81573640 1 -- 10.20.193.45:0/4163643061 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495442368 0 0) 0x7f2c84163bb0 con 0x7f2c840585e0 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f2c81573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f2c81573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f2c81573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f2c81573640 10 monclient(hunting): my global_id is 4390 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f2c81573640 1 -- 10.20.193.45:0/4163643061 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c70003610 con 0x7f2c840585e0 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f13ede13640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f13ede13640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f13ede13640 10 monclient: monmap: 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.378170+0000 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.378170+0000 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.426 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f679c003000 con 0x7f67a8159e40 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f6797fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f6797fff640 1 -- 10.20.193.45:0/852266308 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f679c003440 con 0x7f67a8159e40 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f6797fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f6797fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f6797fff640 10 monclient: dump: 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f67af6e1640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f67af6e1640 4 set_mon_vals no callback set 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f13ede13640 1 Processor -- start 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7fe05aa24640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7fe05aa24640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7fe05aa24640 10 monclient: monmap: 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.378804+0000 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.378804+0000 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f67af6e1640 10 monclient: shutdown 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f67af6e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f67af6e1640 1 -- 10.20.193.45:0/852266308 >> v1:10.20.193.114:6789/0 conn(0x7f67a8159e40 legacy=0x7f67a8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f13ede13640 1 -- start start 2026-02-24T19:17:53.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.378+0000 7f13ede13640 10 monclient: init 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 -- 10.20.193.45:0/852266308 shutdown_connections 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 -- 10.20.193.45:0/852266308 >> 10.20.193.45:0/852266308 conn(0x7f67a80b7780 msgr2=0x7f67a80b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 10 monclient: monmap: 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.379105+0000 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.379105+0000 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 -- 10.20.193.45:0/852266308 shutdown_connections 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 -- 10.20.193.45:0/852266308 wait complete. 2026-02-24T19:17:53.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7fe05aa24640 1 Processor -- start 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7fe05aa24640 1 -- start start 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7fe05aa24640 10 monclient: init 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 10 monclient(hunting): picked mon.noname-b con 0x7f13e8159a70 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 10 monclient(hunting): picked mon.noname-c con 0x7f13e8159e40 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 10 monclient(hunting): picked mon.noname-a con 0x7f13e8058070 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e8163930 con 0x7f13e8058070 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e8163bf0 con 0x7f13e8159a70 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e8163ed0 con 0x7f13e8159e40 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f13ede13640 10 monclient(hunting): authenticate will time out at 3645.017552s 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 10 monclient: monmap: 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.430 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548116189 0 0) 0x7f5ab8058e00 con 0x7f5ab80b5d20 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 10 monclient(hunting): my global_id is 4401 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa0003610 con 0x7f5ab80b5d20 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 librados: starting msgr at 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 librados: starting objecter 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 1 Processor -- start 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 1 -- start start 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 10 monclient: init 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f04b9978640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f04b40ba350 0x7f04b4057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43858/0 (socket says 10.20.193.45:43858) 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 Processor -- start 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f04b9978640 1 -- 10.20.193.45:0/87126030 learned_addr learned my addr 10.20.193.45:0/87126030 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 -- start start 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 librados: setting wanted keys 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 1 librados: calling monclient init 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f67af6e1640 10 monclient: init 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7fe05aa24640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7fe05aa24640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7fe05aa24640 10 monclient(hunting): picked mon.noname-c con 0x7fe0540b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 10 monclient(hunting): picked mon.noname-a con 0x7f6e44161430 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f6e49f0a640 10 monclient(hunting): picked mon.noname-c con 0x7f6e44161800 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199404013 0 0) 0x7f5ab80593c0 con 0x7f5ab805a180 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.379+0000 7f5aa7fff640 10 monclient(hunting): my global_id is 4400 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ab8058e00 con 0x7f5ab805a180 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f2533fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f25340b9f80 0x7f2534163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43852/0 (socket says 10.20.193.45:43852) 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f2533fff640 1 -- 10.20.193.45:0/653728461 learned_addr learned my addr 10.20.193.45:0/653728461 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f6e49f0a640 10 monclient(hunting): picked mon.noname-b con 0x7f6e4416ad30 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f6e49f0a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e440b1800 con 0x7f6e44161430 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f6e49f0a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e440b1ae0 con 0x7f6e4416ad30 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f6e49f0a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e440b1dc0 con 0x7f6e44161800 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f6e49f0a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f6e49f0a640 10 monclient(hunting): authenticate will time out at 3645.018096s 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7fe05aa24640 10 monclient(hunting): picked mon.noname-a con 0x7fe0540ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7fe05aa24640 10 monclient(hunting): picked mon.noname-b con 0x7fe0540585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7fe05aa24640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe054163930 con 0x7fe0540ba350 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7fe05aa24640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe054163bb0 con 0x7fe0540585e0 2026-02-24T19:17:53.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7fe05aa24640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe054163e90 con 0x7fe0540b9f80 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7fe05aa24640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7fe05aa24640 10 monclient(hunting): authenticate will time out at 3645.018068s 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 10 monclient(hunting): picked mon.noname-b con 0x7f67a8058070 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 10 monclient(hunting): picked mon.noname-a con 0x7f67a8159a70 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 10 monclient(hunting): picked mon.noname-c con 0x7f67a8159e40 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a81557f0 con 0x7f67a8159a70 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a81ff040 con 0x7f67a8058070 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a81fafe0 con 0x7f67a8159e40 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.380+0000 7f67af6e1640 10 monclient(hunting): authenticate will time out at 3645.018443s 2026-02-24T19:17:53.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7fe8c6ffd640 1 -- 10.20.193.45:0/1167807855 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408330810 0 0) 0x7fe8c8163bb0 con 0x7fe8c80585e0 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7fe8c6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7fe8c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7fe8c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7fe8c6ffd640 10 monclient(hunting): my global_id is 4393 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7fe8c6ffd640 1 -- 10.20.193.45:0/1167807855 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8ac003610 con 0x7fe8c80585e0 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f5b15573640 1 -- 10.20.193.45:0/3841128557 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b0c003000 con 0x7f5b1815b0a0 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f5b15573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f5b15573640 1 -- 10.20.193.45:0/3841128557 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5b0c003440 con 0x7f5b1815b0a0 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f5b15573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f5b15573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f5b15573640 10 monclient: dump: 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f5b1ce13640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f5b1ce13640 4 set_mon_vals no callback set 2026-02-24T19:17:53.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 1 -- 10.20.193.45:0/4163643061 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2350091942 0 0) 0x7f2c70003610 con 0x7f2c840585e0 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 1 -- 10.20.193.45:0/4163643061 >> v1:10.20.193.179:6789/0 conn(0x7f2c840ba350 legacy=0x7f2c84057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 1 -- 10.20.193.45:0/4163643061 >> v1:10.20.193.45:6789/0 conn(0x7f2c840b9f80 legacy=0x7f2c84163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 1 -- 10.20.193.45:0/4163643061 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c840573f0 con 0x7f2c840585e0 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 1 -- 10.20.193.45:0/4163643061 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2c74003170 con 0x7f2c840585e0 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c81573640 10 monclient: dump: 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c88b8a640 5 monclient: authenticate success, global_id 4390 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.381+0000 7f2c88b8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7f5b1ce13640 10 monclient: shutdown 2026-02-24T19:17:53.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7f5b1ce13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3841128557 >> v1:10.20.193.179:6789/0 conn(0x7f5b1815b0a0 legacy=0x7f5b18162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3841128557 shutdown_connections 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3841128557 >> 10.20.193.45:0/3841128557 conn(0x7f5b180b5290 msgr2=0x7f5b180b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3841128557 shutdown_connections 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3841128557 wait complete. 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fa4d5c2d640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fa4d00b9f80 0x7fa4d0163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43880/0 (socket says 10.20.193.45:43880) 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fa4d5c2d640 1 -- 10.20.193.45:0/1159456984 learned_addr learned my addr 10.20.193.45:0/1159456984 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7f5b1ce13640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7f5b1ce13640 10 monclient: monmap: 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdee8003000 con 0x7fdef8155b20 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fdeef7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fdeef7fe640 1 -- 10.20.193.45:0/3839711878 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdee8003440 con 0x7fdef8155b20 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fdeef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fdeef7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fdeef7fe640 10 monclient: dump: 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fdefee24640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.382+0000 7fdefee24640 4 set_mon_vals no callback set 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 1 librados: starting msgr at 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 1 librados: starting objecter 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 1 Processor -- start 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f6cfbfff640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f6cfc0b9f80 0x7f6cfc163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35746/0 (socket says 10.20.193.45:35746) 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f6cfbfff640 1 -- 10.20.193.45:0/969880186 learned_addr learned my addr 10.20.193.45:0/969880186 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7fdefee24640 10 monclient: shutdown 2026-02-24T19:17:53.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7fdefee24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7fdefee24640 1 -- 10.20.193.45:0/3839711878 >> v1:10.20.193.114:6789/0 conn(0x7fdef8155b20 legacy=0x7fdef80b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 1 -- start start 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 1 librados: setting wanted keys 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7fdefee24640 1 -- 10.20.193.45:0/3839711878 shutdown_connections 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 1 librados: calling monclient init 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 10 monclient: init 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7fdefee24640 1 -- 10.20.193.45:0/3839711878 >> 10.20.193.45:0/3839711878 conn(0x7fdef80b2ef0 msgr2=0x7fdef80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7fdefee24640 1 -- 10.20.193.45:0/3839711878 shutdown_connections 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7fdefee24640 1 -- 10.20.193.45:0/3839711878 wait complete. 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752891866 0 0) 0x7ff9040b6080 con 0x7ff9040b0ca0 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7ff901d74640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7ff901d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7ff901d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7ff901d74640 10 monclient(hunting): my global_id is 4403 2026-02-24T19:17:53.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f0003610 con 0x7ff9040b0ca0 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 10 monclient(hunting): picked mon.noname-c con 0x7f5b180b5da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.383+0000 7f5b1ce13640 10 monclient(hunting): picked mon.noname-b con 0x7f5b1815b0a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7f5b1ce13640 10 monclient(hunting): picked mon.noname-a con 0x7f5b181fd430 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7f5b1ce13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b18154a60 con 0x7f5b181fd430 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7f5b1ce13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b18160590 con 0x7f5b1815b0a0 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient: monmap: 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.440 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7f5b1ce13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b18160870 con 0x7f5b180b5da0 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7f5b1ce13640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7f5b1ce13640 10 monclient(hunting): authenticate will time out at 3645.022107s 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 1 librados: starting msgr at 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 1 librados: starting objecter 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 1 Processor -- start 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 1 -- start start 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 1 librados: setting wanted keys 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 1 librados: calling monclient init 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient: init 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 1 -- 10.20.193.45:0/1167807855 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1125891502 0 0) 0x7fe8ac003610 con 0x7fe8c80585e0 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 1 -- 10.20.193.45:0/1167807855 >> v1:10.20.193.179:6789/0 conn(0x7fe8c80ba350 legacy=0x7fe8c8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 1 -- 10.20.193.45:0/1167807855 >> v1:10.20.193.45:6789/0 conn(0x7fe8c80b9f80 legacy=0x7fe8c8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient(hunting): picked mon.noname-c con 0x7fdef805b740 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient(hunting): picked mon.noname-a con 0x7fdef8155b20 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient(hunting): picked mon.noname-b con 0x7fdef8162f10 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef80aefc0 con 0x7fdef8155b20 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef80ad070 con 0x7fdef8162f10 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef80a9850 con 0x7fdef805b740 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fdefee24640 10 monclient(hunting): authenticate will time out at 3645.022908s 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 1 -- 10.20.193.45:0/1167807855 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c80573f0 con 0x7fe8c80585e0 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 1 -- 10.20.193.45:0/1167807855 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8bc003170 con 0x7fe8c80585e0 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8c6ffd640 10 monclient: dump: 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.442 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8ce2e8640 5 monclient: authenticate success, global_id 4393 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.384+0000 7fe8ce2e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f6e42ffd640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f6e44161800 0x7f6e44168c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35812/0 (socket says 10.20.193.45:35812) 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f6e42ffd640 1 -- 10.20.193.45:0/1724428259 learned_addr learned my addr 10.20.193.45:0/1724428259 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f80f4dca640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f80f00585e0 0x7f80f0160df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35778/0 (socket says 10.20.193.45:35778) 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f80f4dca640 1 -- 10.20.193.45:0/442495374 learned_addr learned my addr 10.20.193.45:0/442495374 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504865298 0 0) 0x7f04a8002910 con 0x7f04b40ba350 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f04b9177640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f04b9177640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f04b9177640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f04b9177640 10 monclient(hunting): my global_id is 4413 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f049c003610 con 0x7f04b40ba350 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f13e7fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f13e8058070 0x7f13e8058460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43894/0 (socket says 10.20.193.45:43894) 2026-02-24T19:17:53.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.387+0000 7f13e7fff640 1 -- 10.20.193.45:0/742994675 learned_addr learned my addr 10.20.193.45:0/742994675 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.388+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102959350 0 0) 0x7f5ab80590e0 con 0x7f5ab80b7910 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.388+0000 7f5aa7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.388+0000 7f5aa7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.388+0000 7f5aa7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.388+0000 7f5aa7fff640 10 monclient(hunting): my global_id is 4396 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.388+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ab80593c0 con 0x7f5ab80b7910 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7f80e57fa640 10 client.?.objecter ms_handle_connect 0x7f80f00585e0 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7f80e57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2175483903 0 0) 0x7ff9040b5da0 con 0x7ff9040b28b0 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7ff901d74640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7ff901d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7ff901d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7ff901d74640 10 monclient(hunting): my global_id is 4399 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9040b6080 con 0x7ff9040b28b0 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7f80e57fa640 10 client.?.objecter ms_handle_connect 0x7f80f00b9f80 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.389+0000 7f80e57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4558003190 con 0x7f45680ba350 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f4566ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f4566ffd640 1 -- 10.20.193.45:0/1287227828 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4558003700 con 0x7f45680ba350 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f4566ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f4566ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f4566ffd640 10 monclient: dump: 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.444 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f456e493640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f456e493640 4 set_mon_vals no callback set 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2733058470 0 0) 0x7f2520002910 con 0x7f25340b9f80 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f2532ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f2532ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f2532ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f2532ffd640 10 monclient(hunting): my global_id is 4410 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2518003610 con 0x7f25340b9f80 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f456e493640 10 monclient: shutdown 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f456e493640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f456e493640 1 -- 10.20.193.45:0/1287227828 >> v1:10.20.193.45:6789/0 conn(0x7f45680ba350 legacy=0x7f4568057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f456e493640 1 -- 10.20.193.45:0/1287227828 shutdown_connections 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f456e493640 1 -- 10.20.193.45:0/1287227828 >> 10.20.193.45:0/1287227828 conn(0x7f45680b7990 msgr2=0x7f45680b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f456e493640 1 -- 10.20.193.45:0/1287227828 shutdown_connections 2026-02-24T19:17:53.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7f456e493640 1 -- 10.20.193.45:0/1287227828 wait complete. 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7fe053fff640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fe0540b9f80 0x7fe054163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35820/0 (socket says 10.20.193.45:35820) 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.390+0000 7fe053fff640 1 -- 10.20.193.45:0/1183399115 learned_addr learned my addr 10.20.193.45:0/1183399115 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f456e493640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f2c81573640 1 -- 10.20.193.45:0/4163643061 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c74003380 con 0x7f2c840585e0 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f2c81573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f2c81573640 1 -- 10.20.193.45:0/4163643061 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2c740037c0 con 0x7f2c840585e0 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f2c81573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f2c81573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f2c81573640 10 monclient: dump: 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f2c88b8a640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f2c88b8a640 4 set_mon_vals no callback set 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f456e493640 10 monclient: monmap: 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.446 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f456e493640 1 librados: starting msgr at 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f456e493640 1 librados: starting objecter 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f5b16d76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f5b181fd430 0x7f5b180b17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43936/0 (socket says 10.20.193.45:43936) 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f5b16d76640 1 -- 10.20.193.45:0/3468810575 learned_addr learned my addr 10.20.193.45:0/3468810575 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f456e493640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.391+0000 7f456e493640 1 Processor -- start 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 1 -- start start 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 10 monclient: shutdown 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 1 -- 10.20.193.45:0/4163643061 >> v1:10.20.193.114:6789/0 conn(0x7f2c840585e0 legacy=0x7f2c84166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 1 librados: setting wanted keys 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f67adc57640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f67a8159e40 0x7f67a8161c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35832/0 (socket says 10.20.193.45:35832) 2026-02-24T19:17:53.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f67adc57640 1 -- 10.20.193.45:0/970369541 learned_addr learned my addr 10.20.193.45:0/970369541 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 1 librados: calling monclient init 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 10 monclient: init 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f5afeffd640 10 client.?.objecter ms_handle_connect 0x7f5b181fd430 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f5afeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 1 -- 10.20.193.45:0/4163643061 shutdown_connections 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 1 -- 10.20.193.45:0/4163643061 >> 10.20.193.45:0/4163643061 conn(0x7f2c840b7990 msgr2=0x7f2c840b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 1 -- 10.20.193.45:0/4163643061 shutdown_connections 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 1 -- 10.20.193.45:0/4163643061 wait complete. 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 10 monclient(hunting): picked mon.noname-a con 0x7f45680585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 10 monclient(hunting): picked mon.noname-b con 0x7f45680b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 10 monclient(hunting): picked mon.noname-c con 0x7f45680ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45680b2bf0 con 0x7f45680585e0 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45680b3b00 con 0x7f45680b9f80 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45680b3de0 con 0x7f45680ba350 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f456e493640 10 monclient(hunting): authenticate will time out at 3645.030662s 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 10 monclient: monmap: 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 1 librados: starting msgr at 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.392+0000 7f2c88b8a640 1 librados: starting objecter 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 1 Processor -- start 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 1 -- start start 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 1 librados: setting wanted keys 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 1 librados: calling monclient init 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 10 monclient: init 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f80e57fa640 10 client.?.objecter ms_handle_connect 0x7f80f00ba350 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f80e57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 10 monclient(hunting): picked mon.noname-c con 0x7f2c840585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 10 monclient(hunting): picked mon.noname-b con 0x7f2c840b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 10 monclient(hunting): picked mon.noname-a con 0x7f2c840ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c84160df0 con 0x7f2c840ba350 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c84203560 con 0x7f2c840b9f80 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c84160b10 con 0x7f2c840585e0 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.393+0000 7f2c88b8a640 10 monclient(hunting): authenticate will time out at 3645.031641s 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fdeeffff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fdef8155b20 0x7fdef80afd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43952/0 (socket says 10.20.193.45:43952) 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fdeeffff640 1 -- 10.20.193.45:0/3055974161 learned_addr learned my addr 10.20.193.45:0/3055974161 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1421506519 0 0) 0x7fa4c0002910 con 0x7fa4d00b9f80 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 10 monclient(hunting): my global_id is 4419 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4b8003610 con 0x7fa4d00b9f80 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843811709 0 0) 0x7fa4d0163e90 con 0x7fa4d00585e0 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 10 monclient(hunting): my global_id is 4418 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c0002910 con 0x7fa4d00585e0 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7f6795ffb640 10 client.?.objecter ms_handle_connect 0x7f67a8159e40 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7f6795ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991677770 0 0) 0x7f2534163bb0 con 0x7f25340585e0 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7f2532ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7f2532ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7f2532ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7f2532ffd640 10 monclient(hunting): my global_id is 4402 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.394+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2520002910 con 0x7f25340585e0 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4012993431 0 0) 0x7f5ab8058e00 con 0x7f5ab805a180 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 >> v1:10.20.193.114:6789/0 conn(0x7f5ab80b7910 legacy=0x7f5ab80b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 >> v1:10.20.193.45:6789/0 conn(0x7f5ab80b5d20 legacy=0x7f5ab815e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab80596a0 con 0x7f5ab805a180 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5aac002df0 con 0x7f5ab805a180 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5aa7fff640 10 monclient: dump: 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5abf888640 5 monclient: authenticate success, global_id 4400 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f5abf888640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f6e427fc640 1 -- 10.20.193.45:0/1724428259 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026811690 0 0) 0x7f6e440b1dc0 con 0x7f6e44161800 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f6e427fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f6e427fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f6e427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f6e427fc640 10 monclient(hunting): my global_id is 4427 2026-02-24T19:17:53.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7f6e427fc640 1 -- 10.20.193.45:0/1724428259 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e28003610 con 0x7f6e44161800 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7fdeed7fa640 10 client.?.objecter ms_handle_connect 0x7fdef8155b20 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.395+0000 7fdeed7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 399438910 0 0) 0x7ff8f0003610 con 0x7ff9040b0ca0 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 >> v1:10.20.193.114:6789/0 conn(0x7ff9040b28b0 legacy=0x7ff9040b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7f6795ffb640 10 client.?.objecter ms_handle_connect 0x7f67a8058070 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7f6795ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 >> v1:10.20.193.45:6789/0 conn(0x7ff90415d0c0 legacy=0x7ff9040b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff904163e10 con 0x7ff9040b0ca0 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8ec002df0 con 0x7ff9040b0ca0 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff90909f640 5 monclient: authenticate success, global_id 4403 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff90909f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff901d74640 10 monclient: dump: 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.452 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7ff90909f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7f5afeffd640 10 client.?.objecter ms_handle_connect 0x7f5b1815b0a0 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7f5afeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7fdeed7fa640 10 client.?.objecter ms_handle_connect 0x7fdef8162f10 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.396+0000 7fdeed7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1717700297 0 0) 0x7f6cfc163e90 con 0x7f6cfc0b9f80 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 10 monclient(hunting): my global_id is 4412 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ce0003610 con 0x7f6cfc0b9f80 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215119768 0 0) 0x7f2534163e90 con 0x7f25340ba350 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f2532ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f2532ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f2532ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f2532ffd640 10 monclient(hunting): my global_id is 4415 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 775916518 0 0) 0x7f6cfc163bb0 con 0x7f6cfc0ba350 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 10 monclient(hunting): my global_id is 4405 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2534163bb0 con 0x7f25340ba350 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cfc163e90 con 0x7f6cfc0ba350 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662206860 0 0) 0x7f04b4163e90 con 0x7f04b40585e0 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f04b9177640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f04b9177640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f04b9177640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f04b9177640 10 monclient(hunting): my global_id is 4421 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04a8002910 con 0x7f04b40585e0 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214363122 0 0) 0x7f80f015fa40 con 0x7f80f00585e0 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f80e57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f80e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f80e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f80e57fa640 10 monclient(hunting): my global_id is 4424 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80c0003610 con 0x7f80f00585e0 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7fe8c6ffd640 1 -- 10.20.193.45:0/1167807855 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8bc003380 con 0x7fe8c80585e0 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7fe8c6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7fe8c6ffd640 1 -- 10.20.193.45:0/1167807855 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8bc003780 con 0x7fe8c80585e0 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7fe8c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7fe8c6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.397+0000 7fe8c6ffd640 10 monclient: dump: 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.454 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7fe8ce2e8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7fe8ce2e8640 4 set_mon_vals no callback set 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583588334 0 0) 0x7f13e8163ed0 con 0x7f13e8159e40 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f13e67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f13e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f13e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f13e67fc640 10 monclient(hunting): my global_id is 4430 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13cc003610 con 0x7f13e8159e40 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7fe8ce2e8640 10 monclient: shutdown 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7fe8ce2e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1167807855 >> v1:10.20.193.114:6789/0 conn(0x7fe8c80585e0 legacy=0x7fe8c8166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594707351 0 0) 0x7f5b18154a60 con 0x7f5b181fd430 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f5afeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f5afeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f5afeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f5afeffd640 10 monclient(hunting): my global_id is 4428 2026-02-24T19:17:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ae4003610 con 0x7f5b181fd430 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1167807855 shutdown_connections 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1167807855 >> 10.20.193.45:0/1167807855 conn(0x7fe8c80b7990 msgr2=0x7fe8c80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1167807855 shutdown_connections 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1167807855 wait complete. 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1621264875 0 0) 0x7f2518003610 con 0x7f25340b9f80 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 >> v1:10.20.193.179:6789/0 conn(0x7f25340ba350 legacy=0x7f2534057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 >> v1:10.20.193.114:6789/0 conn(0x7f25340585e0 legacy=0x7f2534166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25340573f0 con 0x7f25340b9f80 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 10 monclient: monmap: 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.456 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2520002fc0 con 0x7f25340b9f80 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f2532ffd640 10 monclient: dump: 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f253a867640 5 monclient: authenticate success, global_id 4410 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.398+0000 7f253a867640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 1 librados: starting msgr at 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 1 librados: starting objecter 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 1 Processor -- start 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578444654 0 0) 0x7f04b4163bb0 con 0x7f04b40b9f80 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009068997 0 0) 0x7f67a81fafe0 con 0x7f67a8159e40 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f6795ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f6795ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f6795ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f6795ffb640 10 monclient(hunting): my global_id is 4436 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6778003610 con 0x7f67a8159e40 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 1 -- start start 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 1 librados: setting wanted keys 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 1 librados: calling monclient init 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7fe8ce2e8640 10 monclient: init 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f04b9177640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f04b9177640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f04b9177640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f04b9177640 10 monclient(hunting): my global_id is 4411 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04b4163e90 con 0x7f04b40b9f80 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f5afeffd640 10 client.?.objecter ms_handle_connect 0x7f5b180b5da0 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f5afeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970012961 0 0) 0x7f13e8163bf0 con 0x7f13e8159a70 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f13e67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f13e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f13e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.399+0000 7f13e67fc640 10 monclient(hunting): my global_id is 4417 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e8163ed0 con 0x7f13e8159a70 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 10 monclient(hunting): picked mon.noname-b con 0x7fe8c80585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 10 monclient(hunting): picked mon.noname-c con 0x7fe8c80b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 10 monclient(hunting): picked mon.noname-a con 0x7fe8c80ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c81fee00 con 0x7fe8c80ba350 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c8160320 con 0x7fe8c80585e0 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c8160600 con 0x7fe8c80b9f80 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7fe8ce2e8640 10 monclient(hunting): authenticate will time out at 3645.038292s 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517475853 0 0) 0x7f67a81ff040 con 0x7f67a8058070 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7f6795ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7f6795ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7f6795ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7f6795ffb640 10 monclient(hunting): my global_id is 4423 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.400+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67a81fafe0 con 0x7f67a8058070 2026-02-24T19:17:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.401+0000 7f456ca09640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f45680ba350 0x7f45680b1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35852/0 (socket says 10.20.193.45:35852) 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.401+0000 7f456ca09640 1 -- 10.20.193.45:0/3907462996 learned_addr learned my addr 10.20.193.45:0/3907462996 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.402+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362547709 0 0) 0x7f80f015f760 con 0x7f80f00b9f80 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.402+0000 7f80e57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.402+0000 7f80e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.402+0000 7f80e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.402+0000 7f80e57fa640 10 monclient(hunting): my global_id is 4408 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.402+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80f015fa40 con 0x7f80f00b9f80 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.403+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469385782 0 0) 0x7fe054163bb0 con 0x7fe0540585e0 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.403+0000 7fe052ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.403+0000 7fe052ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.403+0000 7fe052ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.403+0000 7fe052ffd640 10 monclient(hunting): my global_id is 4420 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.403+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe038003610 con 0x7fe0540585e0 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117066825 0 0) 0x7f5b18160590 con 0x7f5b1815b0a0 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7f5afeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7f5afeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7f5afeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7f5afeffd640 10 monclient(hunting): my global_id is 4426 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b18154a60 con 0x7f5b1815b0a0 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7fdeed7fa640 10 client.?.objecter ms_handle_connect 0x7fdef805b740 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7fdeed7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7f4564ff9640 10 client.?.objecter ms_handle_connect 0x7f45680ba350 2026-02-24T19:17:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.404+0000 7f4564ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.405+0000 7f6795ffb640 10 client.?.objecter ms_handle_connect 0x7f67a8159a70 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.405+0000 7f6795ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.405+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 431606465 0 0) 0x7f13e8163930 con 0x7f13e8058070 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.405+0000 7f13e67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.405+0000 7f13e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.405+0000 7f13e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.405+0000 7f13e67fc640 10 monclient(hunting): my global_id is 4425 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.405+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e8163bf0 con 0x7f13e8058070 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.406+0000 7f4564ff9640 10 client.?.objecter ms_handle_connect 0x7f45680585e0 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.406+0000 7f4564ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.406+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188697573 0 0) 0x7fe044002910 con 0x7fe0540ba350 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.406+0000 7fe052ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.406+0000 7fe052ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.406+0000 7fe052ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.406+0000 7fe052ffd640 10 monclient(hunting): my global_id is 4431 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.406+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe054163bb0 con 0x7fe0540ba350 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.406+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973631300 0 0) 0x7fe054163e90 con 0x7fe0540b9f80 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fe052ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fe052ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fe052ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fe052ffd640 10 monclient(hunting): my global_id is 4433 2026-02-24T19:17:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe044002910 con 0x7fe0540b9f80 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285470453 0 0) 0x7fdef80aefc0 con 0x7fdef8155b20 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fdeed7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fdeed7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fdeed7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fdeed7fa640 10 monclient(hunting): my global_id is 4440 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdec8003610 con 0x7fdef8155b20 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7f2c82d76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f2c840ba350 0x7f2c8415daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43964/0 (socket says 10.20.193.45:43964) 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7f2c82d76640 1 -- 10.20.193.45:0/3365486576 learned_addr learned my addr 10.20.193.45:0/3365486576 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.407+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1630690163 0 0) 0x7f049c003610 con 0x7f04b40ba350 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 >> v1:10.20.193.179:6789/0 conn(0x7f04b40585e0 legacy=0x7f04b4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 >> v1:10.20.193.114:6789/0 conn(0x7f04b40b9f80 legacy=0x7f04b4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b40573f0 con 0x7f04b40ba350 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f04a8002fc0 con 0x7f04b40ba350 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04b9177640 10 monclient: dump: 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04bc404640 5 monclient: authenticate success, global_id 4413 2026-02-24T19:17:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f04bc404640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2039323280 0 0) 0x7fa4c0002910 con 0x7fa4d00585e0 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 >> v1:10.20.193.114:6789/0 conn(0x7fa4d00ba350 legacy=0x7fa4d0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 >> v1:10.20.193.45:6789/0 conn(0x7fa4d00b9f80 legacy=0x7fa4d0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d00573f0 con 0x7fa4d00585e0 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa4cc003170 con 0x7fa4d00585e0 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d4c2b640 10 monclient: dump: 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d7eb8640 5 monclient: authenticate success, global_id 4418 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7fa4d7eb8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f2c6affd640 10 client.?.objecter ms_handle_connect 0x7f2c840ba350 2026-02-24T19:17:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.408+0000 7f2c6affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f4564ff9640 10 client.?.objecter ms_handle_connect 0x7f45680b9f80 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f4564ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498420614 0 0) 0x7f6cf0002c90 con 0x7f6cfc0585e0 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6cfaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6cfaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6cfaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6cfaffd640 10 monclient(hunting): my global_id is 4422 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cfc163bb0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 1 -- 10.20.193.45:0/1724428259 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3514642218 0 0) 0x7f6e28003610 con 0x7f6e44161800 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 1 -- 10.20.193.45:0/1724428259 >> v1:10.20.193.114:6789/0 conn(0x7f6e4416ad30 legacy=0x7f6e4416b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 1 -- 10.20.193.45:0/1724428259 >> v1:10.20.193.45:6789/0 conn(0x7f6e44161430 legacy=0x7f6e440b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 1 -- 10.20.193.45:0/1724428259 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e440b20a0 con 0x7f6e44161800 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 1 -- 10.20.193.45:0/1724428259 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e30002df0 con 0x7f6e44161800 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e427fc640 10 monclient: dump: 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.464 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e49f0a640 5 monclient: authenticate success, global_id 4427 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.409+0000 7f6e49f0a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.410+0000 7fe8c7fff640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fe8c80585e0 0x7fe8c815daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48840/0 (socket says 10.20.193.45:48840) 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.410+0000 7fe8c7fff640 1 -- 10.20.193.45:0/1586384284 learned_addr learned my addr 10.20.193.45:0/1586384284 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7fe8c4ff9640 10 client.?.objecter ms_handle_connect 0x7fe8c80585e0 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7fe8c4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546350035 0 0) 0x7f80f0161500 con 0x7f80f00ba350 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f80e57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f80e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f80e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f80e57fa640 10 monclient(hunting): my global_id is 4434 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80f015f760 con 0x7f80f00ba350 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3113640238 0 0) 0x7f5ae4003610 con 0x7f5b181fd430 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b18160590 con 0x7f5b181fd430 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5b08003490 con 0x7f5b181fd430 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f5afeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f5afeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f5afeffd640 10 monclient(hunting): dump: 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.465 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.411+0000 7f5afeffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2520003190 con 0x7f25340b9f80 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f2532ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f2532ffd640 1 -- 10.20.193.45:0/653728461 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2520004990 con 0x7f25340b9f80 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f2532ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f2532ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f2532ffd640 10 monclient: dump: 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f253a867640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f253a867640 4 set_mon_vals no callback set 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2229439986 0 0) 0x7f45680b2bf0 con 0x7f45680585e0 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f4564ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f4564ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f4564ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f4564ff9640 10 monclient(hunting): my global_id is 4446 2026-02-24T19:17:53.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4538003610 con 0x7f45680585e0 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f253a867640 10 monclient: shutdown 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f253a867640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f253a867640 1 -- 10.20.193.45:0/653728461 >> v1:10.20.193.45:6789/0 conn(0x7f25340b9f80 legacy=0x7f2534163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f253a867640 1 -- 10.20.193.45:0/653728461 shutdown_connections 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f253a867640 1 -- 10.20.193.45:0/653728461 >> 10.20.193.45:0/653728461 conn(0x7f25340b7990 msgr2=0x7f25340b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f253a867640 1 -- 10.20.193.45:0/653728461 shutdown_connections 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.412+0000 7f253a867640 1 -- 10.20.193.45:0/653728461 wait complete. 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3733093548 0 0) 0x7f67a81557f0 con 0x7f67a8159a70 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f6795ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f6795ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f6795ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f6795ffb640 10 monclient(hunting): my global_id is 4443 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67a81ff040 con 0x7f67a8159a70 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 807273907 0 0) 0x7f13e8163bf0 con 0x7f13e8058070 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 >> v1:10.20.193.179:6789/0 conn(0x7f13e8159e40 legacy=0x7f13e8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 >> v1:10.20.193.114:6789/0 conn(0x7f13e8159a70 legacy=0x7f13e80b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e8057590 con 0x7f13e8058070 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13dc003150 con 0x7f13e8058070 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13e67fc640 10 monclient: dump: 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13ede13640 5 monclient: authenticate success, global_id 4425 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f13ede13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 10 monclient: monmap: 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.468 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 1 librados: starting msgr at 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 1 librados: starting objecter 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 1 Processor -- start 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 1 -- start start 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 1 librados: setting wanted keys 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 1 librados: calling monclient init 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.413+0000 7f253a867640 10 monclient: init 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 10 monclient(hunting): picked mon.noname-b con 0x7f25340585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 10 monclient(hunting): picked mon.noname-c con 0x7f25340b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 10 monclient(hunting): picked mon.noname-a con 0x7f25340ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25340b4ea0 con 0x7f25340ba350 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25340b23b0 con 0x7f25340585e0 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25340b2690 con 0x7f25340b9f80 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f253a867640 10 monclient(hunting): authenticate will time out at 3645.052497s 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f2c6affd640 10 client.?.objecter ms_handle_connect 0x7f2c840585e0 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.414+0000 7f2c6affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283694297 0 0) 0x7f2c84160df0 con 0x7f2c840ba350 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f2c6affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f2c6affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f2c6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f2c6affd640 10 monclient(hunting): my global_id is 4449 2026-02-24T19:17:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c50003610 con 0x7f2c840ba350 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5aac003000 con 0x7f5ab805a180 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f5aa7fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f5aa7fff640 1 -- 10.20.193.45:0/746433002 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5aac003400 con 0x7f5ab805a180 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f5aa7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f5aa7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f5aa7fff640 10 monclient: dump: 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f5abf888640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f5abf888640 4 set_mon_vals no callback set 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1873598457 0 0) 0x7f6cfc163e90 con 0x7f6cfc0ba350 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 >> v1:10.20.193.179:6789/0 conn(0x7f6cfc0b9f80 legacy=0x7f6cfc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 >> v1:10.20.193.45:6789/0 conn(0x7f6cfc0585e0 legacy=0x7f6cfc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc0573f0 con 0x7f6cfc0ba350 2026-02-24T19:17:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6cec002df0 con 0x7f6cfc0ba350 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6d028d7640 5 monclient: authenticate success, global_id 4405 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.415+0000 7f6d028d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f6cfaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f6cfaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f6cfaffd640 10 monclient: dump: 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f6d028d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f5abf888640 10 monclient: shutdown 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f5abf888640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f5abf888640 1 -- 10.20.193.45:0/746433002 >> v1:10.20.193.179:6789/0 conn(0x7f5ab805a180 legacy=0x7f5ab80b7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f5abf888640 1 -- 10.20.193.45:0/746433002 shutdown_connections 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f5abf888640 1 -- 10.20.193.45:0/746433002 >> 10.20.193.45:0/746433002 conn(0x7f5ab80b5210 msgr2=0x7f5ab80b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f5abf888640 1 -- 10.20.193.45:0/746433002 shutdown_connections 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.416+0000 7f5abf888640 1 -- 10.20.193.45:0/746433002 wait complete. 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 10 monclient: monmap: 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 1 librados: starting msgr at 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 1 librados: starting objecter 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 1 Processor -- start 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 1 -- start start 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 1 librados: setting wanted keys 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 1 librados: calling monclient init 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 10 monclient: init 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7fe8c4ff9640 10 client.?.objecter ms_handle_connect 0x7fe8c80ba350 2026-02-24T19:17:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7fe8c4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 10 monclient(hunting): picked mon.noname-a con 0x7f5ab805a180 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 10 monclient(hunting): picked mon.noname-c con 0x7f5ab80b5d20 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 10 monclient(hunting): picked mon.noname-b con 0x7f5ab80b7910 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab811e5b0 con 0x7f5ab805a180 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.417+0000 7f5abf888640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab813b130 con 0x7f5ab80b7910 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f5abf888640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab813d780 con 0x7f5ab80b5d20 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f5abf888640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f5abf888640 10 monclient(hunting): authenticate will time out at 3645.056062s 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 926619265 0 0) 0x7f5b18160870 con 0x7f5b180b5da0 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f5afeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f5afeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f5afeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f5afeffd640 10 monclient(hunting): my global_id is 4439 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ae4003610 con 0x7f5b180b5da0 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546578294 0 0) 0x7fdef80ad070 con 0x7fdef8162f10 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 10 monclient(hunting): my global_id is 4429 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdef80aefc0 con 0x7fdef8162f10 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417035240 0 0) 0x7fdef80a9850 con 0x7fdef805b740 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 10 monclient(hunting): my global_id is 4442 2026-02-24T19:17:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdef80ad070 con 0x7fdef805b740 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35865481 0 0) 0x7f45680b3b00 con 0x7f45680b9f80 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f4564ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f4564ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f4564ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f4564ff9640 10 monclient(hunting): my global_id is 4432 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.418+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45680b2bf0 con 0x7f45680b9f80 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8ec002fc0 con 0x7ff9040b0ca0 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff901d74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 4 set_mon_vals no callback set 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff901d74640 1 -- 10.20.193.45:0/4002673041 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8ec003400 con 0x7ff9040b0ca0 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff901d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff901d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff901d74640 10 monclient: dump: 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.474 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 10 monclient: shutdown 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 1 -- 10.20.193.45:0/4002673041 >> v1:10.20.193.179:6789/0 conn(0x7ff9040b0ca0 legacy=0x7ff9040b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 1 -- 10.20.193.45:0/4002673041 shutdown_connections 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 1 -- 10.20.193.45:0/4002673041 >> 10.20.193.45:0/4002673041 conn(0x7ff9040b5290 msgr2=0x7ff9040b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 1 -- 10.20.193.45:0/4002673041 shutdown_connections 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 1 -- 10.20.193.45:0/4002673041 wait complete. 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972270850 0 0) 0x7f45680b3de0 con 0x7f45680ba350 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7f4564ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7f4564ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7f4564ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7f4564ff9640 10 monclient(hunting): my global_id is 4445 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45680b3b00 con 0x7f45680ba350 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.419+0000 7ff90909f640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7ff90909f640 10 monclient: monmap: 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f25337fe640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f25340b9f80 0x7f25341fc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35872/0 (socket says 10.20.193.45:35872) 2026-02-24T19:17:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f25337fe640 1 -- 10.20.193.45:0/255860948 learned_addr learned my addr 10.20.193.45:0/255860948 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3842639366 0 0) 0x7f80c0003610 con 0x7f80f00585e0 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80f0161500 con 0x7f80f00585e0 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f80e0003190 con 0x7f80f00585e0 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f80e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f80e57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f80e57fa640 10 monclient(hunting): dump: 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f80e57fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7ff90909f640 1 librados: starting msgr at 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7ff90909f640 1 librados: starting objecter 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7ff90909f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7ff90909f640 1 Processor -- start 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7ff90909f640 1 -- start start 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7ff90909f640 1 librados: setting wanted keys 2026-02-24T19:17:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7ff90909f640 1 librados: calling monclient init 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7ff90909f640 10 monclient: init 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f2530ff9640 10 client.?.objecter ms_handle_connect 0x7f25340b9f80 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.420+0000 7f2530ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2326248051 0 0) 0x7f80f015fa40 con 0x7f80f00b9f80 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80c0003610 con 0x7f80f00b9f80 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f80d8003350 con 0x7f80f00b9f80 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f80e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f80e57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f80e57fa640 10 monclient(hunting): dump: 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 10 monclient(hunting): picked mon.noname-c con 0x7ff9040b0ca0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 10 monclient(hunting): picked mon.noname-a con 0x7ff9040b28b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04a8003190 con 0x7f04b40ba350 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04b9177640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04b9177640 1 -- 10.20.193.45:0/87126030 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f04a8004990 con 0x7f04b40ba350 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04b9177640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04b9177640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04b9177640 10 monclient: dump: 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04bc404640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04bc404640 4 set_mon_vals no callback set 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 10 monclient(hunting): picked mon.noname-b con 0x7ff90415d0c0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9041fc3e0 con 0x7ff9040b28b0 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9041fc6c0 con 0x7ff90415d0c0 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9041340c0 con 0x7ff9040b0ca0 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7ff90909f640 10 monclient(hunting): authenticate will time out at 3645.059430s 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7fe8c4ff9640 10 client.?.objecter ms_handle_connect 0x7fe8c80b9f80 2026-02-24T19:17:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7fe8c4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04bc404640 10 monclient: shutdown 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04bc404640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04bc404640 1 -- 10.20.193.45:0/87126030 >> v1:10.20.193.45:6789/0 conn(0x7f04b40ba350 legacy=0x7f04b4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04bc404640 1 -- 10.20.193.45:0/87126030 shutdown_connections 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04bc404640 1 -- 10.20.193.45:0/87126030 >> 10.20.193.45:0/87126030 conn(0x7f04b40b7990 msgr2=0x7f04b40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04bc404640 1 -- 10.20.193.45:0/87126030 shutdown_connections 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.421+0000 7f04bc404640 1 -- 10.20.193.45:0/87126030 wait complete. 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 10 monclient: monmap: 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f2c6affd640 10 client.?.objecter ms_handle_connect 0x7f2c840b9f80 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f2c6affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 1 librados: starting msgr at 2026-02-24T19:17:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 1 librados: starting objecter 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 1 Processor -- start 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 1 -- start start 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 1 librados: setting wanted keys 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 1 librados: calling monclient init 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.422+0000 7f04bc404640 10 monclient: init 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1185501049 0 0) 0x7fe054163bb0 con 0x7fe0540ba350 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 >> v1:10.20.193.179:6789/0 conn(0x7fe0540b9f80 legacy=0x7fe054163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 >> v1:10.20.193.114:6789/0 conn(0x7fe0540585e0 legacy=0x7fe054166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0540573f0 con 0x7fe0540ba350 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe044002fc0 con 0x7fe0540ba350 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe05aa24640 5 monclient: authenticate success, global_id 4431 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe05aa24640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe052ffd640 10 monclient: dump: 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7fe05aa24640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 10 monclient(hunting): picked mon.noname-a con 0x7f04b40585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 10 monclient(hunting): picked mon.noname-b con 0x7f04b40b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 10 monclient(hunting): picked mon.noname-c con 0x7f04b40ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b40b2bf0 con 0x7f04b40585e0 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b40b3b00 con 0x7f04b40b9f80 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b40b3de0 con 0x7f04b40ba350 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f04bc404640 10 monclient(hunting): authenticate will time out at 3645.061453s 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3148056382 0 0) 0x7f5b18160590 con 0x7f5b181fd430 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 >> v1:10.20.193.179:6789/0 conn(0x7f5b180b5da0 legacy=0x7f5b18151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 >> v1:10.20.193.114:6789/0 conn(0x7f5b1815b0a0 legacy=0x7f5b181fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 1 monclient: found mon.a 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b18160b50 con 0x7f5b181fd430 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5afeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5b1ce13640 5 monclient: authenticate success, global_id 4428 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5b1ce13640 10 monclient: _renew_subs 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5b1ce13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.423+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b18160e30 con 0x7f5b181fd430 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 10 client.4428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 10 monclient: _renew_subs 2026-02-24T19:17:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b180b20d0 con 0x7f5b181fd430 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 1 librados: init done 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2722061031 0 0) 0x7fdec8003610 con 0x7fdef8155b20 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdef80a9850 con 0x7fdef8155b20 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdee0003170 con 0x7fdef8155b20 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fdeed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fdeed7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fdeed7fa640 10 monclient(hunting): dump: 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fdeed7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4cc003380 con 0x7fa4d00585e0 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d4c2b640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d4c2b640 1 -- 10.20.193.45:0/1159456984 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa4cc0037c0 con 0x7fa4d00585e0 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d4c2b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d4c2b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d4c2b640 10 monclient: dump: 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.482 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d7eb8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d7eb8640 4 set_mon_vals no callback set 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 10 client.4428.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 15 client.4428.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 20 client.4428.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 10 client.4428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5b18160280 con 0x7f5b181fd430 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d7eb8640 10 monclient: shutdown 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d7eb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/1159456984 >> v1:10.20.193.179:6789/0 conn(0x7fa4d00585e0 legacy=0x7fa4d0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/1159456984 shutdown_connections 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.424+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/1159456984 >> 10.20.193.45:0/1159456984 conn(0x7fa4d00b7990 msgr2=0x7fa4d00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/1159456984 shutdown_connections 2026-02-24T19:17:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/1159456984 wait complete. 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 10 monclient: monmap: 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 1 librados: starting msgr at 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 1 librados: starting objecter 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 1 Processor -- start 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 1 -- start start 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 1 librados: setting wanted keys 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 1 librados: calling monclient init 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.425+0000 7fa4d7eb8640 10 monclient: init 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 10 monclient(hunting): picked mon.noname-a con 0x7fa4d00585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 10 monclient(hunting): picked mon.noname-c con 0x7fa4d00b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 10 monclient(hunting): picked mon.noname-b con 0x7fa4d00ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d01fee00 con 0x7fa4d00585e0 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d0160320 con 0x7fa4d00ba350 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d0160600 con 0x7fa4d00b9f80 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7fa4d7eb8640 10 monclient(hunting): authenticate will time out at 3645.064478s 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1137730358 0 0) 0x7f4538003610 con 0x7f45680585e0 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45680b3de0 con 0x7f45680585e0 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4554003060 con 0x7f45680585e0 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f4564ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f4564ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f4564ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f4564ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13dc003320 con 0x7f13e8058070 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f13e67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f13e67fc640 1 -- 10.20.193.45:0/742994675 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13dc003760 con 0x7f13e8058070 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f13ede13640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f13ede13640 4 set_mon_vals no callback set 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f13e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f13e67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.426+0000 7f13e67fc640 10 monclient: dump: 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7f13ede13640 10 monclient: shutdown 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7f13ede13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7f13ede13640 1 -- 10.20.193.45:0/742994675 >> v1:10.20.193.45:6789/0 conn(0x7f13e8058070 legacy=0x7f13e8058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7f13ede13640 1 -- 10.20.193.45:0/742994675 shutdown_connections 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7f13ede13640 1 -- 10.20.193.45:0/742994675 >> 10.20.193.45:0/742994675 conn(0x7f13e80b7780 msgr2=0x7f13e80b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7f13ede13640 1 -- 10.20.193.45:0/742994675 shutdown_connections 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7f13ede13640 1 -- 10.20.193.45:0/742994675 wait complete. 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546527434 0 0) 0x7fe8c8160320 con 0x7fe8c80585e0 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7fe8c4ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7fe8c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7fe8c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7fe8c4ff9640 10 monclient(hunting): my global_id is 4438 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.427+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe898003610 con 0x7fe8c80585e0 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient: monmap: 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.486 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 1 librados: starting msgr at 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 1 librados: starting objecter 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 1 Processor -- start 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 1 -- start start 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 1 librados: setting wanted keys 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 1 librados: calling monclient init 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient: init 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient(hunting): picked mon.noname-c con 0x7f13e8058070 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient(hunting): picked mon.noname-b con 0x7f13e8159a70 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient(hunting): picked mon.noname-a con 0x7f13e8159e40 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e80b51b0 con 0x7f13e8159e40 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e81fca80 con 0x7f13e8159a70 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e81fcd60 con 0x7f13e8058070 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1767528817 0 0) 0x7f2c50003610 con 0x7f2c840ba350 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.428+0000 7f13ede13640 10 monclient(hunting): authenticate will time out at 3645.066994s 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c84160df0 con 0x7f2c840ba350 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2c74003530 con 0x7f2c840ba350 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f2c6affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f2c6affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f2c6affd640 10 monclient(hunting): dump: 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.487 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f2c6affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f2530ff9640 10 client.?.objecter ms_handle_connect 0x7f25340ba350 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f2530ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 622244655 0 0) 0x7f67a81fafe0 con 0x7f67a8058070 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67a81557f0 con 0x7f67a8058070 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6798002ff0 con 0x7f67a8058070 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f6795ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f6795ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f6795ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.429+0000 7f6795ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.430+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3943771847 0 0) 0x7f6778003610 con 0x7f67a8159e40 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.430+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67a81fafe0 con 0x7f67a8159e40 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.430+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f67a4003290 con 0x7f67a8159e40 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.430+0000 7f6795ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.430+0000 7f6795ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.430+0000 7f6795ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.488 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776400337 0 0) 0x7f2c84160b10 con 0x7f2c840585e0 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f2c6affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f2c6affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f2c6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f2c6affd640 10 monclient(hunting): my global_id is 4448 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c50003610 con 0x7f2c840585e0 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6cec003000 con 0x7f6cfc0ba350 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f6cfaffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f6cfaffd640 1 -- 10.20.193.45:0/969880186 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6cec003400 con 0x7f6cfc0ba350 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f6cfaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f6cfaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f6cfaffd640 10 monclient: dump: 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f6d028d7640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7f6d028d7640 4 set_mon_vals no callback set 2026-02-24T19:17:53.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7ff902d76640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7ff9040b0ca0 0x7ff9041fce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35894/0 (socket says 10.20.193.45:35894) 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.431+0000 7ff902d76640 1 -- 10.20.193.45:0/3262806083 learned_addr learned my addr 10.20.193.45:0/3262806083 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f6d028d7640 10 monclient: shutdown 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f6d028d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f6d028d7640 1 -- 10.20.193.45:0/969880186 >> v1:10.20.193.114:6789/0 conn(0x7f6cfc0ba350 legacy=0x7f6cfc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f6d028d7640 1 -- 10.20.193.45:0/969880186 shutdown_connections 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f6d028d7640 1 -- 10.20.193.45:0/969880186 >> 10.20.193.45:0/969880186 conn(0x7f6cfc0b7990 msgr2=0x7f6cfc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f6d028d7640 1 -- 10.20.193.45:0/969880186 shutdown_connections 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f6d028d7640 1 -- 10.20.193.45:0/969880186 wait complete. 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7ff8e37fe640 10 client.?.objecter ms_handle_connect 0x7ff9040b0ca0 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7ff8e37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2242074960 0 0) 0x7f45680b2bf0 con 0x7f45680b9f80 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4538003610 con 0x7f45680b9f80 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f45580034e0 con 0x7f45680b9f80 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f6d028d7640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f6d028d7640 10 monclient: monmap: 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.490 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f4564ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f4564ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.432+0000 7f4564ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 1 librados: starting msgr at 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 1 librados: starting objecter 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 1 Processor -- start 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 1 -- start start 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 1 librados: setting wanted keys 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 1 librados: calling monclient init 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 10 monclient: init 2026-02-24T19:17:53.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 10 monclient(hunting): picked mon.noname-a con 0x7f6cfc0585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 10 monclient(hunting): picked mon.noname-b con 0x7f6cfc0b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 10 monclient(hunting): picked mon.noname-c con 0x7f6cfc0ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc0b2bf0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc0b3b00 con 0x7f6cfc0b9f80 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cfc0b3de0 con 0x7f6cfc0ba350 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.433+0000 7f6d028d7640 10 monclient(hunting): authenticate will time out at 3645.071844s 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.435+0000 7f6e427fc640 1 -- 10.20.193.45:0/1724428259 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e30003000 con 0x7f6e44161800 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.435+0000 7f6e427fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.435+0000 7f6e427fc640 1 -- 10.20.193.45:0/1724428259 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e30003440 con 0x7f6e44161800 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.435+0000 7f6e427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.435+0000 7f6e427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.435+0000 7f6e427fc640 10 monclient: dump: 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.435+0000 7f6e49f0a640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f6e49f0a640 4 set_mon_vals no callback set 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f6e49f0a640 10 monclient: shutdown 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f6e49f0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1724428259 >> v1:10.20.193.179:6789/0 conn(0x7f6e44161800 legacy=0x7f6e44168c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1393706298 0 0) 0x7f80c0003610 con 0x7f80f00b9f80 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 >> v1:10.20.193.179:6789/0 conn(0x7f80f00585e0 legacy=0x7f80f0160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 >> v1:10.20.193.45:6789/0 conn(0x7f80f00ba350 legacy=0x7f80f0162ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 1 monclient: found mon.b 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1724428259 shutdown_connections 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1724428259 >> 10.20.193.45:0/1724428259 conn(0x7f6e440b2ef0 msgr2=0x7f6e440b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f015fd20 con 0x7f80f00b9f80 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80f7055640 5 monclient: authenticate success, global_id 4408 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80f7055640 10 monclient: _renew_subs 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80f7055640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f80f0160000 con 0x7f80f00b9f80 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1724428259 shutdown_connections 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80f7055640 10 client.4408.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80f7055640 10 monclient: _renew_subs 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80f7055640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f80f01605c0 con 0x7f80f00b9f80 2026-02-24T19:17:53.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f80f7055640 1 librados: init done 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1724428259 wait complete. 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f13e6ffd640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f13e8159a70 0x7f13e81f87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48898/0 (socket says 10.20.193.45:48898) 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.436+0000 7f13e6ffd640 1 -- 10.20.193.45:0/2655397413 learned_addr learned my addr 10.20.193.45:0/2655397413 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f80f7055640 10 client.4408.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f80f7055640 15 client.4408.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f80f7055640 20 client.4408.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f80f7055640 10 client.4408.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f80f7055640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f80f0056500 con 0x7f80f00b9f80 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 10 monclient: monmap: 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 1 librados: starting msgr at 2026-02-24T19:17:53.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 1 librados: starting objecter 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 1 Processor -- start 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 1 -- start start 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 1 librados: setting wanted keys 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 1 librados: calling monclient init 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.437+0000 7f6e49f0a640 10 monclient: init 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467513241 0 0) 0x7f2c84203560 con 0x7f2c840b9f80 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f2c6affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f2c6affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f2c6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f2c6affd640 10 monclient(hunting): my global_id is 4441 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c84160b10 con 0x7f2c840b9f80 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 10 monclient(hunting): picked mon.noname-c con 0x7f6e44161430 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 10 monclient(hunting): picked mon.noname-b con 0x7f6e44161800 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 10 monclient(hunting): picked mon.noname-a con 0x7f6e4416ad30 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4412b090 con 0x7f6e4416ad30 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4405c9f0 con 0x7f6e44161800 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e440a8280 con 0x7f6e44161430 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f6e49f0a640 10 monclient(hunting): authenticate will time out at 3645.076282s 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f13c3fff640 10 client.?.objecter ms_handle_connect 0x7f13e8159a70 2026-02-24T19:17:53.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.438+0000 7f13c3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7f2530ff9640 10 client.?.objecter ms_handle_connect 0x7f25340585e0 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7f2530ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7ff8e37fe640 10 client.?.objecter ms_handle_connect 0x7ff90415d0c0 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7ff8e37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2422884542 0 0) 0x7fe8c8160600 con 0x7fe8c80b9f80 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7fe8c4ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7fe8c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7fe8c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7fe8c4ff9640 10 monclient(hunting): my global_id is 4454 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.439+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8c8160320 con 0x7fe8c80b9f80 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.440+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149573903 0 0) 0x7fe8c81fee00 con 0x7fe8c80ba350 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.440+0000 7fe8c4ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.440+0000 7fe8c4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.440+0000 7fe8c4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.440+0000 7fe8c4ff9640 10 monclient(hunting): my global_id is 4452 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.440+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8c8160600 con 0x7fe8c80ba350 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.440+0000 7f5abd5fd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f5ab805a180 0x7f5ab8147910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43990/0 (socket says 10.20.193.45:43990) 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.440+0000 7f5abd5fd640 1 -- 10.20.193.45:0/1838342536 learned_addr learned my addr 10.20.193.45:0/1838342536 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.441+0000 7f04ba179640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f04b40585e0 0x7f04b41629d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:43998/0 (socket says 10.20.193.45:43998) 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.441+0000 7f04ba179640 1 -- 10.20.193.45:0/3083984518 learned_addr learned my addr 10.20.193.45:0/3083984518 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.441+0000 7f5aa5ffb640 10 client.?.objecter ms_handle_connect 0x7f5ab80b7910 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.441+0000 7f5aa5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.441+0000 7f5aa5ffb640 10 client.?.objecter ms_handle_connect 0x7f5ab805a180 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.441+0000 7f5aa5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2348520047 0 0) 0x7fdef80ad070 con 0x7fdef805b740 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdec8003610 con 0x7fdef805b740 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7ff8e37fe640 10 client.?.objecter ms_handle_connect 0x7ff9040b28b0 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7ff8e37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdee8003350 con 0x7fdef805b740 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7fdeed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7fdeed7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7fdeed7fa640 10 monclient(hunting): dump: 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540928500 0 0) 0x7f25340b2690 con 0x7f25340b9f80 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7f2530ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7f2530ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7f2530ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7f2530ff9640 10 monclient(hunting): my global_id is 4451 2026-02-24T19:17:53.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.442+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2504003610 con 0x7f25340b9f80 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f5aa5ffb640 10 client.?.objecter ms_handle_connect 0x7f5ab80b5d20 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f5aa5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f049affd640 10 client.?.objecter ms_handle_connect 0x7f04b40585e0 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f049affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 89167315 0 0) 0x7f45680b3b00 con 0x7f45680ba350 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45680b2bf0 con 0x7f45680ba350 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f455c003430 con 0x7f45680ba350 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f4564ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f4564ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.443+0000 7f4564ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7fa4d642e640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fa4d00ba350 0x7fa4d0164c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48884/0 (socket says 10.20.193.45:48884) 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7fa4d642e640 1 -- 10.20.193.45:0/3505813563 learned_addr learned my addr 10.20.193.45:0/3505813563 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7fa4b67fc640 10 client.?.objecter ms_handle_connect 0x7fa4d00ba350 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7fa4b67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555143711 0 0) 0x7f13e81fca80 con 0x7f13e8159a70 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7f13c3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7f13c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7f13c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7f13c3fff640 10 monclient(hunting): my global_id is 4444 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.444+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13b8003610 con 0x7f13e8159a70 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.445+0000 7f049affd640 10 client.?.objecter ms_handle_connect 0x7f04b40ba350 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.445+0000 7f049affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3369287586 0 0) 0x7f4538003610 con 0x7f45680b9f80 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 >> v1:10.20.193.179:6789/0 conn(0x7f45680ba350 legacy=0x7f45680b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 >> v1:10.20.193.45:6789/0 conn(0x7f45680585e0 legacy=0x7f45681629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 1 monclient: found mon.b 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45680b40c0 con 0x7f45680b9f80 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f4564ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f456e493640 5 monclient: authenticate success, global_id 4432 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f456e493640 10 monclient: _renew_subs 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f456e493640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f45680b43a0 con 0x7f45680b9f80 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f456e493640 10 client.4432.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f456e493640 10 monclient: _renew_subs 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f456e493640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f45681630e0 con 0x7f45680b9f80 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.449+0000 7f456e493640 1 librados: init done 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7f456e493640 10 client.4432.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7f456e493640 15 client.4432.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7f456e493640 20 client.4432.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7f456e493640 10 client.4432.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7f456e493640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f45680b64c0 con 0x7f45680b9f80 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 633465916 0 0) 0x7fe898003610 con 0x7fe8c80585e0 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8c81fee00 con 0x7fe8c80585e0 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8b4003100 con 0x7fe8c80585e0 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7fe8c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7fe8c4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7fe8c4ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7fe8c4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7f049affd640 10 client.?.objecter ms_handle_connect 0x7f04b40b9f80 2026-02-24T19:17:53.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.450+0000 7f049affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2157294859 0 0) 0x7f67a81557f0 con 0x7f67a8058070 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 >> v1:10.20.193.179:6789/0 conn(0x7f67a8159e40 legacy=0x7f67a8161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 >> v1:10.20.193.45:6789/0 conn(0x7f67a8159a70 legacy=0x7f67a81fc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 1 monclient: found mon.b 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a81fb2c0 con 0x7f67a8058070 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f6795ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f67af6e1640 5 monclient: authenticate success, global_id 4423 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f67af6e1640 10 monclient: _renew_subs 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f67af6e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67a81fb5a0 con 0x7f67a8058070 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f67af6e1640 10 client.4423.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f67af6e1640 10 monclient: _renew_subs 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f67af6e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f67a8155c00 con 0x7f67a8058070 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.452+0000 7f67af6e1640 1 librados: init done 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f13c3fff640 10 client.?.objecter ms_handle_connect 0x7f13e8058070 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f13c3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7fa4b67fc640 10 client.?.objecter ms_handle_connect 0x7fa4d00b9f80 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7fa4b67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f67af6e1640 10 client.4423.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f67af6e1640 15 client.4423.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f67af6e1640 20 client.4423.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f67af6e1640 10 client.4423.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f67af6e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f67a80570d0 con 0x7f67a8058070 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3761803174 0 0) 0x7f2504003610 con 0x7f25340b9f80 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f25340b2690 con 0x7f25340b9f80 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f25240030c0 con 0x7f25340b9f80 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f2530ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f2530ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.453+0000 7f2530ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.454+0000 7f2530ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.454+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b18160280 con 0x7f5b181fd430 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.454+0000 7f5afeffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.454+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5b08003d30 con 0x7f5b181fd430 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.454+0000 7f5afeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.454+0000 7f5afeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.454+0000 7f5b14d72640 4 set_mon_vals no callback set 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.454+0000 7f5afeffd640 10 monclient: dump: 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.455+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f5b08003f40 con 0x7f5b181fd430 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.455+0000 7f5b16575640 10 monclient: get_auth_request con 0x7f5ae4077d90 auth_method 0 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.455+0000 7f5afeffd640 10 client.4428.objecter ms_handle_connect 0x7f5ae4077d90 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 950873361 0 0) 0x7ff9041340c0 con 0x7ff9040b0ca0 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7ff8e37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7ff8e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7ff8e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7ff8e37fe640 10 monclient(hunting): my global_id is 4457 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8d0003610 con 0x7ff9040b0ca0 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7fa4b67fc640 10 client.?.objecter ms_handle_connect 0x7fa4d00585e0 2026-02-24T19:17:53.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7fa4b67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f5b080935c0 con 0x7f5b181fd430 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 10 client.4428.objecter ms_dispatch2 0x7f5b18000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 3 client.4428.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 3 client.4428.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 10 client.4428.objecter checking command 1 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 20 client.4428.objecter _get_session s=0x7f5ae40a0c10 osd=0 3 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 20 client.4428.objecter put_session s=0x7f5ae40a0c10 osd=0 3 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 15 client.4428.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 20 client.4428.objecter _get_session s=0x7f5ae40a0c10 osd=0 3 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 20 client.4428.objecter get_session s=0x7f5ae40a0c10 osd=0 3 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 15 client.4428.objecter _session_command_op_assign 0 1 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 20 client.4428.objecter put_session s=0x7f5ae40a0c10 osd=0 4 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 10 client.4428.objecter _send_command 1 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.45:6805/3544790624 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ae40c2ec0 con 0x7f5ae40a12c0 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 20 client.4428.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f5b0805d6c0 con 0x7f5b181fd430 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.456+0000 7f5afeffd640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7f5b15d74640 10 monclient: get_auth_request con 0x7f5ae40a12c0 auth_method 0 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe044003190 con 0x7fe0540ba350 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fe052ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fe052ffd640 1 -- 10.20.193.45:0/1183399115 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe044003700 con 0x7fe0540ba350 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fe052ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fe052ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fe052ffd640 10 monclient: dump: 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fe05aa24640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fe05aa24640 4 set_mon_vals no callback set 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368344943 0 0) 0x7f25340b4ea0 con 0x7f25340ba350 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7f2530ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7f2530ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7f2530ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7f2530ff9640 10 monclient(hunting): my global_id is 4455 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2504003610 con 0x7f25340ba350 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1806357297 0 0) 0x7fdef80a9850 con 0x7fdef8155b20 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 >> v1:10.20.193.179:6789/0 conn(0x7fdef805b740 legacy=0x7fdef80ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 >> v1:10.20.193.114:6789/0 conn(0x7fdef8162f10 legacy=0x7fdef80ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 1 monclient: found mon.a 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef80a9b30 con 0x7fdef8155b20 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdeed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdefee24640 5 monclient: authenticate success, global_id 4440 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdefee24640 10 monclient: _renew_subs 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdefee24640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdef80af280 con 0x7fdef8155b20 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdefee24640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdefee24640 10 monclient: _renew_subs 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdefee24640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdef80af840 con 0x7fdef8155b20 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.457+0000 7fdefee24640 1 librados: init done 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fe05aa24640 10 monclient: shutdown 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fe05aa24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fe05aa24640 1 -- 10.20.193.45:0/1183399115 >> v1:10.20.193.45:6789/0 conn(0x7fe0540ba350 legacy=0x7fe054057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fe05aa24640 1 -- 10.20.193.45:0/1183399115 shutdown_connections 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fe05aa24640 1 -- 10.20.193.45:0/1183399115 >> 10.20.193.45:0/1183399115 conn(0x7fe0540b7990 msgr2=0x7fe0540b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fe05aa24640 1 -- 10.20.193.45:0/1183399115 shutdown_connections 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fe05aa24640 1 -- 10.20.193.45:0/1183399115 wait complete. 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fdefee24640 10 client.4440.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fdefee24640 15 client.4440.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fdefee24640 20 client.4440.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fdefee24640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fdefee24640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdef8059d90 con 0x7fdef8155b20 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3471985096 0 0) 0x7ff9041fc3e0 con 0x7ff9040b28b0 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7ff8e37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7ff8e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547270441 0 0) 0x7f04b40b2bf0 con 0x7f04b40585e0 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f049affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f049affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f049affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f049affd640 10 monclient(hunting): my global_id is 4464 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0484003610 con 0x7f04b40585e0 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7ff8e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7ff8e37fe640 10 monclient(hunting): my global_id is 4461 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9041340c0 con 0x7ff9040b28b0 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 986536818 0 0) 0x7f25340b2690 con 0x7f25340b9f80 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 >> v1:10.20.193.114:6789/0 conn(0x7f25340585e0 legacy=0x7f25340b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 >> v1:10.20.193.45:6789/0 conn(0x7f25340ba350 legacy=0x7f25341fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 1 monclient: found mon.c 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25340b2970 con 0x7f25340b9f80 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f2530ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f5afeffd640 10 client.4428.objecter ms_handle_connect 0x7f5ae40a12c0 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f253a867640 5 monclient: authenticate success, global_id 4451 2026-02-24T19:17:53.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f253a867640 10 monclient: _renew_subs 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f253a867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f25340b2c50 con 0x7f25340b9f80 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fe05aa24640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7fe05aa24640 10 monclient: monmap: 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f6d00e4d640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f6cfc0ba350 0x7f6cfc0b1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35932/0 (socket says 10.20.193.45:35932) 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f6d00e4d640 1 -- 10.20.193.45:0/1979761118 learned_addr learned my addr 10.20.193.45:0/1979761118 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f253a867640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f253a867640 10 monclient: _renew_subs 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f253a867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f25340b3210 con 0x7f25340b9f80 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.458+0000 7f253a867640 1 librados: init done 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 1 librados: starting msgr at 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 1 librados: starting objecter 2026-02-24T19:17:53.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 1 Processor -- start 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 1 -- start start 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 1 librados: setting wanted keys 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 1 librados: calling monclient init 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 10 monclient: init 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f253a867640 10 client.4451.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f253a867640 15 client.4451.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f253a867640 20 client.4451.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f253a867640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f253a867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f25340b64c0 con 0x7f25340b9f80 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3374700377 0 0) 0x7f2c84160df0 con 0x7f2c840ba350 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 >> v1:10.20.193.179:6789/0 conn(0x7f2c840585e0 legacy=0x7f2c84160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 >> v1:10.20.193.114:6789/0 conn(0x7f2c840b9f80 legacy=0x7f2c84202e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 1 monclient: found mon.a 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c841646b0 con 0x7f2c840ba350 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c88b8a640 5 monclient: authenticate success, global_id 4449 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c88b8a640 10 monclient: _renew_subs 2026-02-24T19:17:53.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c88b8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2c84164990 con 0x7f2c840ba350 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c88b8a640 10 client.4449.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c88b8a640 10 monclient: _renew_subs 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c88b8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2c8415e1b0 con 0x7f2c840ba350 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7f2c88b8a640 1 librados: init done 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 10 monclient(hunting): picked mon.noname-c con 0x7fe0540585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 10 monclient(hunting): picked mon.noname-a con 0x7fe0540b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 10 monclient(hunting): picked mon.noname-b con 0x7fe0540ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe054200980 con 0x7fe0540b9f80 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe054200c60 con 0x7fe0540ba350 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe054200f40 con 0x7fe0540585e0 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.459+0000 7fe05aa24640 10 monclient(hunting): authenticate will time out at 3645.097847s 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f2c88b8a640 10 client.4449.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f2c88b8a640 15 client.4449.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f2c88b8a640 20 client.4449.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f2c88b8a640 10 client.4449.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f2c88b8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2c8415a860 con 0x7f2c840ba350 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f13c3fff640 10 client.?.objecter ms_handle_connect 0x7f13e8159e40 2026-02-24T19:17:53.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f13c3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f6cf8ff9640 10 client.?.objecter ms_handle_connect 0x7f6cfc0585e0 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.460+0000 7f6cf8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999921126 0 0) 0x7ff9041fc6c0 con 0x7ff90415d0c0 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7ff8e37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7ff8e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7ff8e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7ff8e37fe640 10 monclient(hunting): my global_id is 4450 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9041fc3e0 con 0x7ff90415d0c0 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7f6e43fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6e4416ad30 0x7f6e441641c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44032/0 (socket says 10.20.193.45:44032) 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7f6e43fff640 1 -- 10.20.193.45:0/1477172374 learned_addr learned my addr 10.20.193.45:0/1477172374 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7f6cf8ff9640 10 client.?.objecter ms_handle_connect 0x7f6cfc0ba350 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.461+0000 7f6cf8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.462+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275332612 0 0) 0x7f5ab813d780 con 0x7f5ab80b5d20 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.462+0000 7f5aa5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.462+0000 7f5aa5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.462+0000 7f5aa5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.462+0000 7f5aa5ffb640 10 monclient(hunting): my global_id is 4460 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.462+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a88003610 con 0x7f5ab80b5d20 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875288342 0 0) 0x7f5ab811e5b0 con 0x7f5ab805a180 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f5aa5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f5aa5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80f0056500 con 0x7f80f00b9f80 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f80e57fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f5aa5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f5aa5ffb640 10 monclient(hunting): my global_id is 4458 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ab813d780 con 0x7f5ab805a180 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f80d80037a0 con 0x7f80f00b9f80 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f80e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f80e57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f80e57fa640 10 monclient: dump: 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.464+0000 7f80e6ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.465+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f80d80039b0 con 0x7f80f00b9f80 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.465+0000 7f80f4dca640 10 monclient: get_auth_request con 0x7f80c0077d90 auth_method 0 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.466+0000 7f80e57fa640 10 client.4408.objecter ms_handle_connect 0x7f80c0077d90 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.466+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228947352 0 0) 0x7f04b40b3de0 con 0x7f04b40ba350 2026-02-24T19:17:53.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.466+0000 7f049affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.466+0000 7f049affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.466+0000 7f049affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.466+0000 7f049affd640 10 monclient(hunting): my global_id is 4463 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.466+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04b40b2bf0 con 0x7f04b40ba350 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f80d8091d40 con 0x7f80f00b9f80 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 10 client.4408.objecter ms_dispatch2 0x7f80f0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 3 client.4408.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3226626933 0 0) 0x7fa4d0160320 con 0x7fa4d00ba350 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fa4b67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fa4b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 3 client.4408.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fa4b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fa4b67fc640 10 monclient(hunting): my global_id is 4456 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4a0003610 con 0x7fa4d00ba350 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 10 client.4408.objecter checking command 1 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 20 client.4408.objecter _get_session s=0x7f80c00a0c10 osd=4 3 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 20 client.4408.objecter put_session s=0x7f80c00a0c10 osd=4 3 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 15 client.4408.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 20 client.4408.objecter _get_session s=0x7f80c00a0c10 osd=4 3 2026-02-24T19:17:53.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 20 client.4408.objecter get_session s=0x7f80c00a0c10 osd=4 3 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 15 client.4408.objecter _session_command_op_assign 4 1 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 20 client.4408.objecter put_session s=0x7f80c00a0c10 osd=4 4 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 10 client.4408.objecter _send_command 1 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.45:6801/1236941460 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80c00c2f60 con 0x7f80c00a12c0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 20 client.4408.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f80d80583e0 con 0x7f80f00b9f80 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80e57fa640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7f80f55cb640 10 monclient: get_auth_request con 0x7f80c00a12c0 auth_method 0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1544923715 0 0) 0x7fe8c81fee00 con 0x7fe8c80585e0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 >> v1:10.20.193.179:6789/0 conn(0x7fe8c80b9f80 legacy=0x7fe8c81fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 >> v1:10.20.193.45:6789/0 conn(0x7fe8c80ba350 legacy=0x7fe8c8164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 1 monclient: found mon.b 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c81608e0 con 0x7fe8c80585e0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8ce2e8640 5 monclient: authenticate success, global_id 4438 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8ce2e8640 10 monclient: _renew_subs 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8ce2e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c8160bc0 con 0x7fe8c80585e0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8ce2e8640 10 client.4438.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8ce2e8640 10 monclient: _renew_subs 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8ce2e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8c81ff110 con 0x7fe8c80585e0 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.467+0000 7fe8ce2e8640 1 librados: init done 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.468+0000 7fe8ce2e8640 10 client.4438.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.468+0000 7fe8ce2e8640 15 client.4438.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.468+0000 7fe8ce2e8640 20 client.4438.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.468+0000 7fe8ce2e8640 10 client.4438.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.468+0000 7fe8ce2e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.468+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe8c81600d0 con 0x7fe8c80585e0 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.469+0000 7f80e57fa640 10 client.4408.objecter ms_handle_connect 0x7f80c00a12c0 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.469+0000 7f6e1ffff640 10 client.?.objecter ms_handle_connect 0x7f6e4416ad30 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.469+0000 7f6e1ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f25340b64c0 con 0x7f25340b9f80 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f2530ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f25240039b0 con 0x7f25340b9f80 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f2530ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f2530ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f2530ff9640 10 monclient: dump: 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f25327fc640 4 set_mon_vals no callback set 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3286767074 0 0) 0x7f13b8003610 con 0x7f13e8159a70 2026-02-24T19:17:53.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13e81fca80 con 0x7f13e8159a70 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13d80030d0 con 0x7f13e8159a70 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f13c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f13c3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f13c3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f13c3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.470+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f2524003bc0 con 0x7f25340b9f80 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.471+0000 7f2533fff640 10 monclient: get_auth_request con 0x7f2504077d00 auth_method 0 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.471+0000 7f2530ff9640 10 client.4451.objecter ms_handle_connect 0x7f2504077d00 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f25240931e0 con 0x7f25340b9f80 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 10 client.4451.objecter ms_dispatch2 0x7f2534000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 3 client.4451.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 3 client.4451.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206573289 0 0) 0x7f13e81fcd60 con 0x7f13e8058070 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f13c3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f13c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f13c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f13c3fff640 10 monclient(hunting): my global_id is 4466 2026-02-24T19:17:53.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13b8003610 con 0x7f13e8058070 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 10 client.4451.objecter checking command 1 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 20 client.4451.objecter _get_session s=0x7f25040a0b80 osd=11 3 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 20 client.4451.objecter put_session s=0x7f25040a0b80 osd=11 3 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 15 client.4451.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 20 client.4451.objecter _get_session s=0x7f25040a0b80 osd=11 3 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 20 client.4451.objecter get_session s=0x7f25040a0b80 osd=11 3 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 15 client.4451.objecter _session_command_op_assign 11 1 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 20 client.4451.objecter put_session s=0x7f25040a0b80 osd=11 4 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 10 client.4451.objecter _send_command 1 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 --> v1:10.20.193.194:6812/1154629099 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25040c2e30 con 0x7f25040a1230 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 20 client.4451.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f2524059880 con 0x7f25340b9f80 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2530ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.472+0000 7f2538ddd640 10 monclient: get_auth_request con 0x7f25040a1230 auth_method 0 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.473+0000 7f6e1ffff640 10 client.?.objecter ms_handle_connect 0x7f6e44161800 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.473+0000 7f6e1ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.473+0000 7fe053fff640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fe0540585e0 0x7fe054158180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35952/0 (socket says 10.20.193.45:35952) 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.473+0000 7fe053fff640 1 -- 10.20.193.45:0/1759405135 learned_addr learned my addr 10.20.193.45:0/1759405135 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.474+0000 7fe050ff9640 10 client.?.objecter ms_handle_connect 0x7fe0540585e0 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.474+0000 7fe050ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.474+0000 7f6e1ffff640 10 client.?.objecter ms_handle_connect 0x7f6e44161430 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.474+0000 7f6e1ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.474+0000 7f2530ff9640 10 client.4451.objecter ms_handle_connect 0x7f25040a1230 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.474+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1249032913 0 0) 0x7ff9041340c0 con 0x7ff9040b28b0 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.475+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9041fc6c0 con 0x7ff9040b28b0 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.475+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8ec003310 con 0x7ff9040b28b0 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.475+0000 7ff8e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.475+0000 7ff8e37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.475+0000 7ff8e37fe640 10 monclient(hunting): dump: 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.475+0000 7ff8e37fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.477+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f45680b64c0 con 0x7f45680b9f80 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.477+0000 7f4564ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.477+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4558003930 con 0x7f45680b9f80 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.477+0000 7f4564ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.477+0000 7f4564ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.477+0000 7f45667fc640 4 set_mon_vals no callback set 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.477+0000 7f4564ff9640 10 monclient: dump: 2026-02-24T19:17:53.518 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.478+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f4558003b40 con 0x7f45680b9f80 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.478+0000 7f4567fff640 10 monclient: get_auth_request con 0x7f4538077f50 auth_method 0 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.478+0000 7f4564ff9640 10 client.4432.objecter ms_handle_connect 0x7f4538077f50 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f4558003930 con 0x7f45680b9f80 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 10 client.4432.objecter ms_dispatch2 0x7f4568000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 3 client.4432.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 3 client.4432.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 10 client.4432.objecter checking command 1 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 20 client.4432.objecter _get_session s=0x7f45380a0dd0 osd=2 3 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 20 client.4432.objecter put_session s=0x7f45380a0dd0 osd=2 3 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 15 client.4432.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 20 client.4432.objecter _get_session s=0x7f45380a0dd0 osd=2 3 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 20 client.4432.objecter get_session s=0x7f45380a0dd0 osd=2 3 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 15 client.4432.objecter _session_command_op_assign 2 1 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 20 client.4432.objecter put_session s=0x7f45380a0dd0 osd=2 4 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 10 client.4432.objecter _send_command 1 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.179:6800/3913807646 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45380c3080 con 0x7f45380a1480 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 20 client.4432.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f4558058410 con 0x7f45680b9f80 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.479+0000 7f4564ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876989760 0 0) 0x7fe054200f40 con 0x7fe0540585e0 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7fe050ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7fe050ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7fe050ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7fe050ff9640 10 monclient(hunting): my global_id is 4475 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe024003610 con 0x7fe0540585e0 2026-02-24T19:17:53.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7f456ca09640 10 monclient: get_auth_request con 0x7f45380a1480 auth_method 0 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== osd.0 v1:10.20.193.45:6805/3544790624 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f5ae40c2ec0 con 0x7f5ae40a12c0 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7f5afeffd640 10 client.4428.objecter ms_dispatch2 0x7f5b18000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7f5afeffd640 10 client.4428.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7f5afeffd640 20 client.4428.objecter put_session s=0x7f5ae40a0c10 osd=0 4 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7f5afeffd640 15 client.4428.objecter _session_command_op_remove 0 1 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7f6cf8ff9640 10 client.?.objecter ms_handle_connect 0x7f6cfc0b9f80 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.480+0000 7f6cf8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.481+0000 7f4564ff9640 10 client.4432.objecter ms_handle_connect 0x7f45380a1480 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.481+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069241964 0 0) 0x7f5ab813b130 con 0x7f5ab80b7910 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.481+0000 7f5aa5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.481+0000 7f5aa5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.481+0000 7f5aa5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.481+0000 7f5aa5ffb640 10 monclient(hunting): my global_id is 4453 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.481+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ab811e5b0 con 0x7f5ab80b7910 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.482+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2137643048 0 0) 0x7f04b40b3b00 con 0x7f04b40b9f80 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.482+0000 7f049affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.482+0000 7f049affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.482+0000 7f049affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.482+0000 7f049affd640 10 monclient(hunting): my global_id is 4459 2026-02-24T19:17:53.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.482+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04b40b3de0 con 0x7f04b40b9f80 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c8415a860 con 0x7f2c840ba350 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f2c6affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2c74003330 con 0x7f2c840ba350 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f2c6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f2c6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f2c80d72640 4 set_mon_vals no callback set 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f2c6affd640 10 monclient: dump: 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2827492622 0 0) 0x7f5a88003610 con 0x7f5ab80b5d20 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ab813b130 con 0x7f5ab80b5d20 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5aac003350 con 0x7f5ab80b5d20 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f5aa5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f5aa5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f5aa5ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.485+0000 7f5aa5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.486+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f2c7401dd30 con 0x7f2c840ba350 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.486+0000 7f2c82575640 10 monclient: get_auth_request con 0x7f2c50077e60 auth_method 0 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.486+0000 7f2c6affd640 10 client.4449.objecter ms_handle_connect 0x7f2c50077e60 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 10 client.4428.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 15 client.4428.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 20 client.4428.objecter _get_session s=0x7f5ae40a0c10 osd=0 3 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 20 client.4428.objecter put_session s=0x7f5ae40a0c10 osd=0 3 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 20 client.4428.objecter _get_session s=0x7f5ae40a0c10 osd=0 3 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 15 client.4428.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 20 client.4428.objecter get_session s=0x7f5ae40a0c10 osd=0 3 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 15 client.4428.objecter _session_command_op_assign 0 2 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 20 client.4428.objecter put_session s=0x7f5ae40a0c10 osd=0 4 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 10 client.4428.objecter _send_command 2 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 --> v1:10.20.193.45:6805/3544790624 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b181fc660 con 0x7f5ae40a12c0 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3010006903 0 0) 0x7fe024003610 con 0x7fe0540585e0 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe054200f40 con 0x7fe0540585e0 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe040003060 con 0x7fe0540585e0 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7fe050ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7fe050ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7fe050ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.522 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7fe050ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2989370203 0 0) 0x7f04b40b2bf0 con 0x7f04b40ba350 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04b40b3b00 con 0x7f04b40ba350 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f04b0003400 con 0x7f04b40ba350 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f049affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f049affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f049affd640 10 monclient(hunting): dump: 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.488+0000 7f049affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== osd.4 v1:10.20.193.45:6801/1236941460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f80c00c2f60 con 0x7f80c00a12c0 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f80e57fa640 10 client.4408.objecter ms_dispatch2 0x7f80f0000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f80e57fa640 10 client.4408.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f80e57fa640 20 client.4408.objecter put_session s=0x7f80c00a0c10 osd=4 4 2026-02-24T19:17:53.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f80e57fa640 15 client.4408.objecter _session_command_op_remove 4 1 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1848850080 0 0) 0x7fa4d01fee00 con 0x7fa4d00585e0 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 10 monclient(hunting): my global_id is 4467 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4d0160320 con 0x7fa4d00585e0 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797509633 0 0) 0x7fa4d0160600 con 0x7fa4d00b9f80 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 10 monclient(hunting): my global_id is 4469 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4d01fee00 con 0x7fa4d00b9f80 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f2c74093430 con 0x7f2c840ba350 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 10 client.4449.objecter ms_dispatch2 0x7f2c84000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 3 client.4449.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 3 client.4449.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 10 client.4449.objecter checking command 1 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 20 client.4449.objecter _get_session s=0x7f2c500a0ce0 osd=7 3 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 20 client.4449.objecter put_session s=0x7f2c500a0ce0 osd=7 3 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 15 client.4449.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 20 client.4449.objecter _get_session s=0x7f2c500a0ce0 osd=7 3 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 20 client.4449.objecter get_session s=0x7f2c500a0ce0 osd=7 3 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 15 client.4449.objecter _session_command_op_assign 7 1 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 20 client.4449.objecter put_session s=0x7f2c500a0ce0 osd=7 4 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 10 client.4449.objecter _send_command 1 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.194:6800/598300563 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c500c2f90 con 0x7f2c500a1390 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 20 client.4449.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f2c74059ad0 con 0x7f2c840ba350 2026-02-24T19:17:53.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c6affd640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257144831 0 0) 0x7f6cfc0b3de0 con 0x7f6cfc0ba350 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f6cf8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f6cf8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f6cf8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f6cf8ff9640 10 monclient(hunting): my global_id is 4472 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ccc003610 con 0x7f6cfc0ba350 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.489+0000 7f2c81d74640 10 monclient: get_auth_request con 0x7f2c500a1390 auth_method 0 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.490+0000 7f2c6affd640 10 client.4449.objecter ms_handle_connect 0x7f2c500a1390 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.491+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375910886 0 0) 0x7f13e80b51b0 con 0x7f13e8159e40 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.491+0000 7f13c3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.491+0000 7f13c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.491+0000 7f13c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.491+0000 7f13c3fff640 10 monclient(hunting): my global_id is 4473 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.491+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e81fcd60 con 0x7f13e8159e40 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854613507 0 0) 0x7f6cfc0b2bf0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6cf8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6cf8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6cf8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6cf8ff9640 10 monclient(hunting): my global_id is 4470 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cfc0b3de0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7fe050ff9640 10 client.?.objecter ms_handle_connect 0x7fe0540ba350 2026-02-24T19:17:53.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7fe050ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1542093753 0 0) 0x7f5ab813d780 con 0x7f5ab805a180 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a88003610 con 0x7f5ab805a180 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5aa80030c0 con 0x7f5ab805a180 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f5aa5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f5aa5ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f5aa5ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2762243258 0 0) 0x7f6e440a8280 con 0x7f6e44161430 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6e1ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6e1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6e1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6e1ffff640 10 monclient(hunting): my global_id is 4478 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.492+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e14003610 con 0x7f6e44161430 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5afeffd640 1 -- 10.20.193.45:0/3468810575 <== osd.0 v1:10.20.193.45:6805/3544790624 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f5b181fc660 con 0x7f5ae40a12c0 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5afeffd640 10 client.4428.objecter ms_dispatch2 0x7f5b18000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5afeffd640 10 client.4428.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5afeffd640 20 client.4428.objecter put_session s=0x7f5ae40a0c10 osd=0 4 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5afeffd640 15 client.4428.objecter _session_command_op_remove 0 2 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 10 librados: watch_flush enter 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 10 librados: watch_flush exit 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 10 client.4428.objecter close_session for osd.0 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 >> v1:10.20.193.45:6805/3544790624 conn(0x7f5ae40a12c0 legacy=0x7f5ae40c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2669048281 0 0) 0x7ff8d0003610 con 0x7ff9040b0ca0 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9041340c0 con 0x7ff9040b0ca0 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8f80030f0 con 0x7ff9040b0ca0 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7ff8e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7ff8e37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7ff8e37fe640 10 monclient(hunting): dump: 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 20 client.4428.objecter put_session s=0x7f5ae40a0c10 osd=0 1 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 20 client.4428.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 10 client.4428.objecter successfully canceled tick 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 >> v1:10.20.193.45:6800/1599977652 conn(0x7f5ae4077d90 legacy=0x7f5ae4098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 10 monclient: shutdown 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 >> v1:10.20.193.45:6789/0 conn(0x7f5b181fd430 legacy=0x7f5b180b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b16d76640 1 -- 10.20.193.45:0/3468810575 reap_dead start 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 shutdown_connections 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 >> 10.20.193.45:0/3468810575 conn(0x7f5b180b5290 msgr2=0x7f5b18159620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 shutdown_connections 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.493+0000 7f5b1ce13640 1 -- 10.20.193.45:0/3468810575 wait complete. 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f5b1ce13640 1 librados: shutdown 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== osd.11 v1:10.20.193.194:6812/1154629099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f25040c2e30 con 0x7f25040a1230 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f2530ff9640 10 client.4451.objecter ms_dispatch2 0x7f2534000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f2530ff9640 10 client.4451.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f2530ff9640 20 client.4451.objecter put_session s=0x7f25040a0b80 osd=11 4 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f2530ff9640 15 client.4451.objecter _session_command_op_remove 11 1 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1183729660 0 0) 0x7f13b8003610 con 0x7f13e8058070 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13e80b51b0 con 0x7f13e8058070 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13d4002fc0 con 0x7f13e8058070 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f13c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f13c3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f13c3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.528 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3154793376 0 0) 0x7ff9041fc6c0 con 0x7ff9040b28b0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 >> v1:10.20.193.179:6789/0 conn(0x7ff9040b0ca0 legacy=0x7ff9041fce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 >> v1:10.20.193.114:6789/0 conn(0x7ff90415d0c0 legacy=0x7ff904158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 1 monclient: found mon.a 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9041343a0 con 0x7ff9040b28b0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff8e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 5 monclient: authenticate success, global_id 4461 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 10 monclient: _renew_subs 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff904134680 con 0x7ff9040b28b0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 593435655 0 0) 0x7fe054200f40 con 0x7fe0540585e0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 >> v1:10.20.193.114:6789/0 conn(0x7fe0540ba350 legacy=0x7fe0540b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 >> v1:10.20.193.45:6789/0 conn(0x7fe0540b9f80 legacy=0x7fe0541656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 1 monclient: found mon.c 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe054201220 con 0x7fe0540585e0 2026-02-24T19:17:53.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe050ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 5 monclient: authenticate success, global_id 4475 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 10 monclient: _renew_subs 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe054201500 con 0x7fe0540585e0 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 10 client.4461.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 10 monclient: _renew_subs 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9041fc0a0 con 0x7ff9040b28b0 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 1 librados: init done 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 10 client.4475.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 10 monclient: _renew_subs 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe054165dc0 con 0x7fe0540585e0 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 1 librados: init done 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 349580561 0 0) 0x7f6e440b1ae0 con 0x7f6e4416ad30 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f6e1ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f6e1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f6e1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f6e1ffff640 10 monclient(hunting): my global_id is 4476 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e440a8280 con 0x7f6e4416ad30 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 10 client.4475.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 15 client.4475.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 20 client.4475.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 10 client.4475.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 10 client.4461.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 15 client.4461.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 20 client.4461.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 10 client.4461.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff90405e210 con 0x7ff9040b28b0 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.494+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe0541660a0 con 0x7fe0540585e0 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2656837379 0 0) 0x7f5ab813b130 con 0x7f5ab80b5d20 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 >> v1:10.20.193.114:6789/0 conn(0x7f5ab80b7910 legacy=0x7f5ab813e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 >> v1:10.20.193.45:6789/0 conn(0x7f5ab805a180 legacy=0x7f5ab8147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 1 monclient: found mon.c 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab813da60 con 0x7f5ab80b5d20 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5aa5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5abf888640 5 monclient: authenticate success, global_id 4460 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5abf888640 10 monclient: _renew_subs 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5abf888640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab813dd40 con 0x7f5ab80b5d20 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5abf888640 10 client.4460.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5abf888640 10 monclient: _renew_subs 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5abf888640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5ab813ef30 con 0x7f5ab80b5d20 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.495+0000 7f5abf888640 1 librados: init done 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67a80570d0 con 0x7f67a8058070 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f6795ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6798003700 con 0x7f67a8058070 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f6795ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f6795ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f67977fe640 4 set_mon_vals no callback set 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f6795ffb640 10 monclient: dump: 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f5abf888640 10 client.4460.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f5abf888640 15 client.4460.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f5abf888640 20 client.4460.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f5abf888640 10 client.4460.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f5abf888640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5ab813f210 con 0x7f5ab80b5d20 2026-02-24T19:17:53.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.496+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f6798003910 con 0x7f67a8058070 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 10 client.4408.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 15 client.4408.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 20 client.4408.objecter _get_session s=0x7f80c00a0c10 osd=4 3 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 20 client.4408.objecter put_session s=0x7f80c00a0c10 osd=4 3 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 20 client.4408.objecter _get_session s=0x7f80c00a0c10 osd=4 3 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 15 client.4408.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 20 client.4408.objecter get_session s=0x7f80c00a0c10 osd=4 3 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 15 client.4408.objecter _session_command_op_assign 4 2 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 20 client.4408.objecter put_session s=0x7f80c00a0c10 osd=4 4 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 10 client.4408.objecter _send_command 2 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 --> v1:10.20.193.45:6801/1236941460 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80f00b64c0 con 0x7f80c00a12c0 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f67acc55640 10 monclient: get_auth_request con 0x7f6778077ed0 auth_method 0 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.497+0000 7f6795ffb640 10 client.4423.objecter ms_handle_connect 0x7f6778077ed0 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.498+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdef8059d90 con 0x7fdef8155b20 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.498+0000 7fdeed7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.498+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdee00039b0 con 0x7fdef8155b20 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.498+0000 7fdeed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.498+0000 7fdeed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.498+0000 7fdeed7fa640 10 monclient: dump: 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.498+0000 7fdeeeffd640 4 set_mon_vals no callback set 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.499+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fdee0003bc0 con 0x7fdef8155b20 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7fdefcb99640 10 monclient: get_auth_request con 0x7fdec8078080 auth_method 0 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7fdeed7fa640 10 client.4440.objecter ms_handle_connect 0x7fdec8078080 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f6798091f70 con 0x7f67a8058070 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 10 client.4423.objecter ms_dispatch2 0x7f67a8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 3 client.4423.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 3 client.4423.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 10 client.4423.objecter checking command 1 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 20 client.4423.objecter _get_session s=0x7f67780a0d50 osd=6 3 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 20 client.4423.objecter put_session s=0x7f67780a0d50 osd=6 3 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 15 client.4423.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 20 client.4423.objecter _get_session s=0x7f67780a0d50 osd=6 3 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 20 client.4423.objecter get_session s=0x7f67780a0d50 osd=6 3 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 15 client.4423.objecter _session_command_op_assign 6 1 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 20 client.4423.objecter put_session s=0x7f67780a0d50 osd=6 4 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 10 client.4423.objecter _send_command 1 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.179:6804/1928709825 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6798003190 con 0x7f67780a1400 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f6795ffb640 20 client.4423.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.500+0000 7f67adc57640 10 monclient: get_auth_request con 0x7f67780a1400 auth_method 0 2026-02-24T19:17:53.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.501+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f6798058610 con 0x7f67a8058070 2026-02-24T19:17:53.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.501+0000 7f6795ffb640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.501+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== osd.2 v1:10.20.193.179:6800/3913807646 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f45380c3080 con 0x7f45380a1480 2026-02-24T19:17:53.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.501+0000 7f4564ff9640 10 client.4432.objecter ms_dispatch2 0x7f4568000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.501+0000 7f4564ff9640 10 client.4432.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.501+0000 7f4564ff9640 20 client.4432.objecter put_session s=0x7f45380a0dd0 osd=2 4 2026-02-24T19:17:53.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.501+0000 7f4564ff9640 15 client.4432.objecter _session_command_op_remove 2 1 2026-02-24T19:17:53.535 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:53.535 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-24T19:17:53.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 10 client.4451.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 15 client.4451.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 20 client.4451.objecter _get_session s=0x7f25040a0b80 osd=11 3 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 20 client.4451.objecter put_session s=0x7f25040a0b80 osd=11 3 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 20 client.4451.objecter _get_session s=0x7f25040a0b80 osd=11 3 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 15 client.4451.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 20 client.4451.objecter get_session s=0x7f25040a0b80 osd=11 3 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 15 client.4451.objecter _session_command_op_assign 11 2 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 20 client.4451.objecter put_session s=0x7f25040a0b80 osd=11 4 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 10 client.4451.objecter _send_command 2 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 --> v1:10.20.193.194:6812/1154629099 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25340b94f0 con 0x7f25040a1230 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.502+0000 7f6795ffb640 10 client.4423.objecter ms_handle_connect 0x7f67780a1400 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f2530ff9640 1 -- 10.20.193.45:0/255860948 <== osd.11 v1:10.20.193.194:6812/1154629099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7f25340b94f0 con 0x7f25040a1230 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f2530ff9640 10 client.4451.objecter ms_dispatch2 0x7f2534000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f2530ff9640 10 client.4451.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f2530ff9640 20 client.4451.objecter put_session s=0x7f25040a0b80 osd=11 4 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f2530ff9640 15 client.4451.objecter _session_command_op_remove 11 2 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 10 librados: watch_flush enter 2026-02-24T19:17:53.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 10 librados: watch_flush exit 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 10 client.4451.objecter close_session for osd.11 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 >> v1:10.20.193.194:6812/1154629099 conn(0x7f25040a1230 legacy=0x7f25040c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 20 client.4451.objecter put_session s=0x7f25040a0b80 osd=11 1 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 20 client.4451.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 10 client.4451.objecter successfully canceled tick 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 >> v1:10.20.193.45:6800/1599977652 conn(0x7f2504077d00 legacy=0x7f25040981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 10 monclient: shutdown 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 >> v1:10.20.193.179:6789/0 conn(0x7f25340b9f80 legacy=0x7f25341fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f2538ddd640 1 -- 10.20.193.45:0/255860948 reap_dead start 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 shutdown_connections 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 >> 10.20.193.45:0/255860948 conn(0x7f25340b7990 msgr2=0x7f25340b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.504+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 shutdown_connections 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7f253a867640 1 -- 10.20.193.45:0/255860948 wait complete. 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7f253a867640 1 librados: shutdown 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fdee00931b0 con 0x7fdef8155b20 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 10 client.4440.objecter ms_dispatch2 0x7fdef8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 3 client.4440.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 3 client.4440.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 10 client.4440.objecter checking command 1 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 20 client.4440.objecter _get_session s=0x7fdec80a0f00 osd=1 3 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 20 client.4440.objecter put_session s=0x7fdec80a0f00 osd=1 3 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 15 client.4440.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 20 client.4440.objecter _get_session s=0x7fdec80a0f00 osd=1 3 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 20 client.4440.objecter get_session s=0x7fdec80a0f00 osd=1 3 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 15 client.4440.objecter _session_command_op_assign 1 1 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 20 client.4440.objecter put_session s=0x7fdec80a0f00 osd=1 4 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 10 client.4440.objecter _send_command 1 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.114:6808/1876170727 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdec80c31b0 con 0x7fdec80a15b0 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 20 client.4440.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7fdee005d2b0 con 0x7fdef8155b20 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.505+0000 7fdeed7fa640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7fdefd39a640 10 monclient: get_auth_request con 0x7fdec80a15b0 auth_method 0 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f80e57fa640 1 -- 10.20.193.45:0/442495374 <== osd.4 v1:10.20.193.45:6801/1236941460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f80f00b64c0 con 0x7f80c00a12c0 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f80e57fa640 10 client.4408.objecter ms_dispatch2 0x7f80f0000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f80e57fa640 10 client.4408.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f80e57fa640 20 client.4408.objecter put_session s=0x7f80c00a0c10 osd=4 4 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f80e57fa640 15 client.4408.objecter _session_command_op_remove 4 2 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3055186837 0 0) 0x7f6e4405c9f0 con 0x7f6e44161800 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f6e1ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f6e1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f6e1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f6e1ffff640 10 monclient(hunting): my global_id is 4462 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.506+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e440b1ae0 con 0x7f6e44161800 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 10 librados: watch_flush enter 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 10 librados: watch_flush exit 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 10 client.4408.objecter close_session for osd.4 2026-02-24T19:17:53.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 >> v1:10.20.193.45:6801/1236941460 conn(0x7f80c00a12c0 legacy=0x7f80c00c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 20 client.4408.objecter put_session s=0x7f80c00a0c10 osd=4 1 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 20 client.4408.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 10 client.4408.objecter successfully canceled tick 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 >> v1:10.20.193.45:6800/1599977652 conn(0x7f80c0077d90 legacy=0x7f80c0098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 10 monclient: shutdown 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 >> v1:10.20.193.114:6789/0 conn(0x7f80f00b9f80 legacy=0x7f80f01564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f55cb640 1 -- 10.20.193.45:0/442495374 reap_dead start 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 shutdown_connections 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 >> 10.20.193.45:0/442495374 conn(0x7f80f00b7990 msgr2=0x7f80f0056830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 shutdown_connections 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 1 -- 10.20.193.45:0/442495374 wait complete. 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7fdeed7fa640 10 client.4440.objecter ms_handle_connect 0x7fdec80a15b0 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f80f7055640 1 librados: shutdown 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908555756 0 0) 0x7f6cfc0b3b00 con 0x7f6cfc0b9f80 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f6cf8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f6cf8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f6cf8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f6cf8ff9640 10 monclient(hunting): my global_id is 4465 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cfc0b2bf0 con 0x7f6cfc0b9f80 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 151256423 0 0) 0x7f04b40b3de0 con 0x7f04b40b9f80 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04b40b2bf0 con 0x7f04b40b9f80 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f04a8002ed0 con 0x7f04b40b9f80 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f049affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f049affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.507+0000 7f049affd640 10 monclient(hunting): dump: 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.539 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 873925730 0 0) 0x7f13e81fca80 con 0x7f13e8159a70 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 >> v1:10.20.193.179:6789/0 conn(0x7f13e8058070 legacy=0x7f13e80b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 >> v1:10.20.193.45:6789/0 conn(0x7f13e8159e40 legacy=0x7f13e81582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 1 monclient: found mon.b 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e81fd040 con 0x7f13e8159a70 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 5 monclient: authenticate success, global_id 4444 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 10 monclient: _renew_subs 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13e81fd320 con 0x7f13e8159a70 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 10 client.4444.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 10 monclient: _renew_subs 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f13e81f8ee0 con 0x7f13e8159a70 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 1 librados: init done 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1881918124 0 0) 0x7fa4a0003610 con 0x7fa4d00ba350 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4d0160600 con 0x7fa4d00ba350 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa4cc0036d0 con 0x7fa4d00ba350 2026-02-24T19:17:53.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7fa4b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7fa4b67fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7fa4b67fc640 10 monclient(hunting): dump: 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7fa4b67fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 10 client.4444.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 15 client.4444.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 20 client.4444.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 10 client.4444.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.508+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f13e81f91c0 con 0x7f13e8159a70 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 932017469 0 0) 0x7f04b40b3b00 con 0x7f04b40ba350 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 >> v1:10.20.193.114:6789/0 conn(0x7f04b40b9f80 legacy=0x7f04b4165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 >> v1:10.20.193.45:6789/0 conn(0x7f04b40585e0 legacy=0x7f04b41629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 1 monclient: found mon.c 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b40b40c0 con 0x7f04b40ba350 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f049affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f04bc404640 5 monclient: authenticate success, global_id 4463 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f04bc404640 10 monclient: _renew_subs 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f04bc404640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f04b40b43a0 con 0x7f04b40ba350 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f04bc404640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f04bc404640 10 monclient: _renew_subs 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f04bc404640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f04b41630e0 con 0x7f04b40ba350 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f04bc404640 1 librados: init done 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== osd.7 v1:10.20.193.194:6800/598300563 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f2c500c2f90 con 0x7f2c500a1390 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f2c6affd640 10 client.4449.objecter ms_dispatch2 0x7f2c84000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f2c6affd640 10 client.4449.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f2c6affd640 20 client.4449.objecter put_session s=0x7f2c500a0ce0 osd=7 4 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.509+0000 7f2c6affd640 15 client.4449.objecter _session_command_op_remove 7 1 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 10 client.4432.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 15 client.4432.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 20 client.4432.objecter _get_session s=0x7f45380a0dd0 osd=2 3 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 20 client.4432.objecter put_session s=0x7f45380a0dd0 osd=2 3 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 20 client.4432.objecter _get_session s=0x7f45380a0dd0 osd=2 3 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 15 client.4432.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 20 client.4432.objecter get_session s=0x7f45380a0dd0 osd=2 3 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 15 client.4432.objecter _session_command_op_assign 2 2 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 20 client.4432.objecter put_session s=0x7f45380a0dd0 osd=2 4 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 10 client.4432.objecter _send_command 2 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 --> v1:10.20.193.179:6800/3913807646 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45680b94f0 con 0x7f45380a1480 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f04bc404640 10 client.4463.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f04bc404640 15 client.4463.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f04bc404640 20 client.4463.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f04bc404640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f04bc404640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.510+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f04b40b64c0 con 0x7f04b40ba350 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.512+0000 7f4564ff9640 1 -- 10.20.193.45:0/3907462996 <== osd.2 v1:10.20.193.179:6800/3913807646 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f45680b94f0 con 0x7f45380a1480 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.512+0000 7f4564ff9640 10 client.4432.objecter ms_dispatch2 0x7f4568000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.512+0000 7f4564ff9640 10 client.4432.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.512+0000 7f4564ff9640 20 client.4432.objecter put_session s=0x7f45380a0dd0 osd=2 4 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.512+0000 7f4564ff9640 15 client.4432.objecter _session_command_op_remove 2 2 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 10 librados: watch_flush enter 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 10 librados: watch_flush exit 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 10 client.4432.objecter close_session for osd.2 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 >> v1:10.20.193.179:6800/3913807646 conn(0x7f45380a1480 legacy=0x7f45380c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 20 client.4432.objecter put_session s=0x7f45380a0dd0 osd=2 1 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 20 client.4432.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 10 client.4432.objecter successfully canceled tick 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 >> v1:10.20.193.45:6800/1599977652 conn(0x7f4538077f50 legacy=0x7f4538098400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stdout:94489280517 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 10 monclient: shutdown 2026-02-24T19:17:53.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 >> v1:10.20.193.114:6789/0 conn(0x7f45680b9f80 legacy=0x7f4568165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.544 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-24T19:17:53.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.513+0000 7f456ca09640 1 -- 10.20.193.45:0/3907462996 reap_dead start 2026-02-24T19:17:53.544 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:53.544 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-24T19:17:53.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 shutdown_connections 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 >> 10.20.193.45:0/3907462996 conn(0x7f45680b7990 msgr2=0x7f456815acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 shutdown_connections 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7f456e493640 1 -- 10.20.193.45:0/3907462996 wait complete. 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7f456e493640 1 librados: shutdown 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe040004910 con 0x7fe0540585e0 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7fe050ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe040004b40 con 0x7fe0540585e0 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7fe050ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7fe050ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7fe0527fc640 4 set_mon_vals no callback set 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.515+0000 7fe050ff9640 10 monclient: dump: 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.516+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fe040004d50 con 0x7fe0540585e0 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.517+0000 7fe0537fe640 10 monclient: get_auth_request con 0x7fe024077c60 auth_method 0 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.517+0000 7fe050ff9640 10 client.4475.objecter ms_handle_connect 0x7fe024077c60 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fe0400934e0 con 0x7fe0540585e0 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 10 client.4475.objecter ms_dispatch2 0x7fe054000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 3 client.4475.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 3 client.4475.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 10 client.4449.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 15 client.4449.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 20 client.4449.objecter _get_session s=0x7f2c500a0ce0 osd=7 3 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 20 client.4449.objecter put_session s=0x7f2c500a0ce0 osd=7 3 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 20 client.4449.objecter _get_session s=0x7f2c500a0ce0 osd=7 3 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 15 client.4449.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 20 client.4449.objecter get_session s=0x7f2c500a0ce0 osd=7 3 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 15 client.4449.objecter _session_command_op_assign 7 2 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 20 client.4449.objecter put_session s=0x7f2c500a0ce0 osd=7 4 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 10 client.4449.objecter _send_command 2 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 --> v1:10.20.193.194:6800/598300563 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2c84159f60 con 0x7f2c500a1390 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 10 client.4475.objecter checking command 1 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 20 client.4475.objecter _get_session s=0x7fe0240a0ae0 osd=13 3 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 20 client.4475.objecter put_session s=0x7fe0240a0ae0 osd=13 3 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 15 client.4475.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 20 client.4475.objecter _get_session s=0x7fe0240a0ae0 osd=13 3 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 20 client.4475.objecter get_session s=0x7fe0240a0ae0 osd=13 3 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 15 client.4475.objecter _session_command_op_assign 13 1 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 20 client.4475.objecter put_session s=0x7fe0240a0ae0 osd=13 4 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 10 client.4475.objecter _send_command 1 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 --> v1:10.20.193.114:6812/3533295890 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0240c2d90 con 0x7fe0240a1190 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 20 client.4475.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7fe04005d5e0 con 0x7fe0540585e0 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe050ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff90405e210 con 0x7ff9040b28b0 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7ff8e37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8ec002f70 con 0x7ff9040b28b0 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7ff8e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7ff8e37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7ff8e37fe640 10 monclient: dump: 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7ff901573640 4 set_mon_vals no callback set 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.518+0000 7fe058f9a640 10 monclient: get_auth_request con 0x7fe0240a1190 auth_method 0 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.519+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7ff8ec01d850 con 0x7ff9040b28b0 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.519+0000 7ff902d76640 10 monclient: get_auth_request con 0x7ff8d0077d30 auth_method 0 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.519+0000 7ff8e37fe640 10 client.4461.objecter ms_handle_connect 0x7ff8d0077d30 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7fe050ff9640 10 client.4475.objecter ms_handle_connect 0x7fe0240a1190 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1898795108 0 0) 0x7f6cfc0b2bf0 con 0x7f6cfc0b9f80 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6cfc0b3b00 con 0x7f6cfc0b9f80 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6cec003350 con 0x7f6cfc0b9f80 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f6cf8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f6cf8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f6cf8ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.547 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f6cf8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c6affd640 1 -- 10.20.193.45:0/3365486576 <== osd.7 v1:10.20.193.194:6800/598300563 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f2c84159f60 con 0x7f2c500a1390 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c6affd640 10 client.4449.objecter ms_dispatch2 0x7f2c84000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c6affd640 10 client.4449.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c6affd640 20 client.4449.objecter put_session s=0x7f2c500a0ce0 osd=7 4 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c6affd640 15 client.4449.objecter _session_command_op_remove 7 2 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 10 librados: watch_flush enter 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 10 librados: watch_flush exit 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 10 client.4449.objecter close_session for osd.7 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 >> v1:10.20.193.194:6800/598300563 conn(0x7f2c500a1390 legacy=0x7f2c500c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 20 client.4449.objecter put_session s=0x7f2c500a0ce0 osd=7 1 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 20 client.4449.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 10 client.4449.objecter successfully canceled tick 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 >> v1:10.20.193.45:6800/1599977652 conn(0x7f2c50077e60 legacy=0x7f2c50098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 10 monclient: shutdown 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 >> v1:10.20.193.45:6789/0 conn(0x7f2c840ba350 legacy=0x7f2c8415daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c82d76640 1 -- 10.20.193.45:0/3365486576 reap_dead start 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 shutdown_connections 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.520+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 >> 10.20.193.45:0/3365486576 conn(0x7f2c840b7990 msgr2=0x7f2c840b9250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 shutdown_connections 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f2c88b8a640 1 -- 10.20.193.45:0/3365486576 wait complete. 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f2c88b8a640 1 librados: shutdown 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ab813f210 con 0x7f5ab80b5d20 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f5aa5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5aac0037a0 con 0x7f5ab80b5d20 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f5aa5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f5aa5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f5aa77fe640 4 set_mon_vals no callback set 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.521+0000 7f5aa5ffb640 10 monclient: dump: 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f5aac003980 con 0x7f5ab80b5d20 2026-02-24T19:17:53.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7ff8ec093010 con 0x7ff9040b28b0 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 10 client.4461.objecter ms_dispatch2 0x7ff904000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 3 client.4461.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 3 client.4461.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 10 client.4461.objecter checking command 1 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 20 client.4461.objecter _get_session s=0x7ff8d00a0bb0 osd=14 3 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 20 client.4461.objecter put_session s=0x7ff8d00a0bb0 osd=14 3 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 15 client.4461.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 20 client.4461.objecter _get_session s=0x7ff8d00a0bb0 osd=14 3 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 20 client.4461.objecter get_session s=0x7ff8d00a0bb0 osd=14 3 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 15 client.4461.objecter _session_command_op_assign 14 1 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 20 client.4461.objecter put_session s=0x7ff8d00a0bb0 osd=14 4 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 10 client.4461.objecter _send_command 1 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.179:6812/1196591242 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8d00c2e60 con 0x7ff8d00a1260 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 20 client.4461.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7ff8ec05d110 con 0x7ff9040b28b0 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.522+0000 7ff8e37fe640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5abd5fd640 10 monclient: get_auth_request con 0x7f5a88077d30 auth_method 0 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 10 client.4460.objecter ms_handle_connect 0x7f5a88077d30 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7ff903577640 10 monclient: get_auth_request con 0x7ff8d00a1260 auth_method 0 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== osd.6 v1:10.20.193.179:6804/1928709825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6798003190 con 0x7f67780a1400 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f6795ffb640 10 client.4423.objecter ms_dispatch2 0x7f67a8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f6795ffb640 10 client.4423.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f6795ffb640 20 client.4423.objecter put_session s=0x7f67780a0d50 osd=6 4 2026-02-24T19:17:53.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f6795ffb640 15 client.4423.objecter _session_command_op_remove 6 1 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f5aac091e90 con 0x7f5ab80b5d20 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 10 client.4460.objecter ms_dispatch2 0x7f5ab8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 3 client.4460.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 3 client.4460.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 10 client.4460.objecter checking command 1 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 20 client.4460.objecter _get_session s=0x7f5a880a0bb0 osd=10 3 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 20 client.4460.objecter put_session s=0x7f5a880a0bb0 osd=10 3 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 15 client.4460.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 20 client.4460.objecter _get_session s=0x7f5a880a0bb0 osd=10 3 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 20 client.4460.objecter get_session s=0x7f5a880a0bb0 osd=10 3 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 15 client.4460.objecter _session_command_op_assign 10 1 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 20 client.4460.objecter put_session s=0x7f5a880a0bb0 osd=10 4 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 10 client.4460.objecter _send_command 1 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.179:6808/2982984950 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a880c2e60 con 0x7f5a880a1260 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.523+0000 7f5aa5ffb640 20 client.4460.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:53.551 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-24T19:17:53.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.524+0000 7f5abddfe640 10 monclient: get_auth_request con 0x7f5a880a1260 auth_method 0 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.524+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1426915369 0 0) 0x7fa4d0160320 con 0x7fa4d00585e0 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.524+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4a0003610 con 0x7fa4d00585e0 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.524+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa4c0003200 con 0x7fa4d00585e0 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.524+0000 7fa4b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.524+0000 7fa4b67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.524+0000 7fa4b67fc640 10 monclient(hunting): dump: 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.524+0000 7ff8e37fe640 10 client.4461.objecter ms_handle_connect 0x7ff8d00a1260 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.525+0000 7f5aa5ffb640 10 client.4460.objecter ms_handle_connect 0x7f5a880a1260 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.526+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f5aac058530 con 0x7f5ab80b5d20 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.526+0000 7f5aa5ffb640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.527+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13e81f91c0 con 0x7f13e8159a70 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.527+0000 7f13c3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.527+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13d80039b0 con 0x7f13e8159a70 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.527+0000 7f13c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.527+0000 7f13c3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.527+0000 7f13c3fff640 10 monclient: dump: 2026-02-24T19:17:53.552 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.527+0000 7f13e5ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.527+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f13d8003bc0 con 0x7f13e8159a70 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3436628015 0 0) 0x7f6cfc0b3de0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6cfc0b2bf0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6ce80030b0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7f6cf8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7f6cf8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7f6cf8ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7f13e77fe640 10 monclient: get_auth_request con 0x7f13b8077e60 auth_method 0 2026-02-24T19:17:53.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7f13c3fff640 10 client.4444.objecter ms_handle_connect 0x7f13b8077e60 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:53.554 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 511382619 0 0) 0x7fa4d01fee00 con 0x7fa4d00b9f80 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4d0160320 con 0x7fa4d00b9f80 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa4c4002f70 con 0x7fa4d00b9f80 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7fa4b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7fa4b67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.528+0000 7fa4b67fc640 10 monclient(hunting): dump: 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== osd.1 v1:10.20.193.114:6808/1876170727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fdec80c31b0 con 0x7fdec80a15b0 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fdeed7fa640 10 client.4440.objecter ms_dispatch2 0x7fdef8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fdeed7fa640 10 client.4440.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fdeed7fa640 20 client.4440.objecter put_session s=0x7fdec80a0f00 osd=1 4 2026-02-24T19:17:53.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fdeed7fa640 15 client.4440.objecter _session_command_op_remove 1 1 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1935487708 0 0) 0x7f6e440a8280 con 0x7f6e4416ad30 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e4405c9f0 con 0x7f6e4416ad30 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e38003400 con 0x7f6e4416ad30 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7f6e1ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7f6e1ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7f6e1ffff640 10 monclient(hunting): dump: 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7f6e1ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2642747406 0 0) 0x7fa4a0003610 con 0x7fa4d00585e0 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 >> v1:10.20.193.179:6789/0 conn(0x7fa4d00b9f80 legacy=0x7fa4d01fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 >> v1:10.20.193.114:6789/0 conn(0x7fa4d00ba350 legacy=0x7fa4d0164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 1 monclient: found mon.a 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d01608e0 con 0x7fa4d00585e0 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4d7eb8640 5 monclient: authenticate success, global_id 4467 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4d7eb8640 10 monclient: _renew_subs 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.530+0000 7fa4d7eb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d0160bc0 con 0x7fa4d00585e0 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 10 client.4467.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 10 monclient: _renew_subs 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4d01ff110 con 0x7fa4d00585e0 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 1 librados: init done 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f13d80931f0 con 0x7f13e8159a70 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 10 client.4444.objecter ms_dispatch2 0x7f13e8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 3 client.4444.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 3 client.4444.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 10 client.4444.objecter checking command 1 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 20 client.4444.objecter _get_session s=0x7f13b80a0d40 osd=15 3 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 20 client.4444.objecter put_session s=0x7f13b80a0d40 osd=15 3 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 15 client.4444.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 20 client.4444.objecter _get_session s=0x7f13b80a0d40 osd=15 3 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 20 client.4444.objecter get_session s=0x7f13b80a0d40 osd=15 3 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 15 client.4444.objecter _session_command_op_assign 15 1 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 20 client.4444.objecter put_session s=0x7f13b80a0d40 osd=15 4 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 10 client.4444.objecter _send_command 1 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.194:6808/4057136445 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13b80c2ff0 con 0x7f13b80a13f0 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13c3fff640 20 client.4444.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 10 client.4423.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 15 client.4423.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 20 client.4423.objecter _get_session s=0x7f67780a0d50 osd=6 3 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 20 client.4423.objecter put_session s=0x7f67780a0d50 osd=6 3 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 20 client.4423.objecter _get_session s=0x7f67780a0d50 osd=6 3 2026-02-24T19:17:53.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 10 client.4467.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 15 client.4467.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 20 client.4467.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 10 client.4467.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 15 client.4423.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 20 client.4423.objecter get_session s=0x7f67780a0d50 osd=6 3 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 15 client.4423.objecter _session_command_op_assign 6 2 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 20 client.4423.objecter put_session s=0x7f67780a0d50 osd=6 4 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 10 client.4423.objecter _send_command 2 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 --> v1:10.20.193.179:6804/1928709825 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f67a8158900 con 0x7f67780a1400 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa4d01600d0 con 0x7fa4d00585e0 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.531+0000 7f13e7fff640 10 monclient: get_auth_request con 0x7f13b80a13f0 auth_method 0 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.532+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4216662325 0 0) 0x7f6ccc003610 con 0x7f6cfc0ba350 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.532+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6cfc0b3de0 con 0x7f6cfc0ba350 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.532+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6cf0003440 con 0x7f6cfc0ba350 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.532+0000 7f6cf8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.532+0000 7f6cf8ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.532+0000 7f6cf8ff9640 10 monclient(hunting): dump: 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.557 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.533+0000 7f13c3fff640 10 client.4444.objecter ms_handle_connect 0x7f13b80a13f0 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.533+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1936597559 0 0) 0x7f6e14003610 con 0x7f6e44161430 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.533+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e440a8280 con 0x7f6e44161430 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.533+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e34002ff0 con 0x7f6e44161430 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.533+0000 7f6e1ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.533+0000 7f6e1ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.533+0000 7f6e1ffff640 10 monclient(hunting): dump: 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.535+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8c81600d0 con 0x7fe8c80585e0 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.536+0000 7fe8c4ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.536+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8b40039b0 con 0x7fe8c80585e0 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.536+0000 7fe8c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.536+0000 7fe8c4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.536+0000 7fe8c4ff9640 10 monclient: dump: 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.558 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.536+0000 7fe8c67fc640 4 set_mon_vals no callback set 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.536+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f13d8059890 con 0x7f13e8159a70 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.536+0000 7f13c3fff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.536+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fe8b4003bc0 con 0x7fe8c80585e0 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04b40b64c0 con 0x7f04b40ba350 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7f049affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f04b0003b00 con 0x7f04b40ba350 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7f049affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7f049affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7f049affd640 10 monclient: dump: 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7f04b8976640 4 set_mon_vals no callback set 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fe8c77fe640 10 monclient: get_auth_request con 0x7fe898077d90 auth_method 0 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fe8c4ff9640 10 client.4438.objecter ms_handle_connect 0x7fe898077d90 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 10 client.4440.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 15 client.4440.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 20 client.4440.objecter _get_session s=0x7fdec80a0f00 osd=1 3 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 20 client.4440.objecter put_session s=0x7fdec80a0f00 osd=1 3 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 20 client.4440.objecter _get_session s=0x7fdec80a0f00 osd=1 3 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 15 client.4440.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 20 client.4440.objecter get_session s=0x7fdec80a0f00 osd=1 3 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 15 client.4440.objecter _session_command_op_assign 1 2 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 20 client.4440.objecter put_session s=0x7fdec80a0f00 osd=1 4 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 10 client.4440.objecter _send_command 2 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 --> v1:10.20.193.114:6808/1876170727 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdef8059ab0 con 0x7fdec80a15b0 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.537+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f04b001c970 con 0x7f04b40ba350 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fe8b40931f0 con 0x7fe8c80585e0 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 10 client.4438.objecter ms_dispatch2 0x7fe8c8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 3 client.4438.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 3 client.4438.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 10 client.4438.objecter checking command 1 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 20 client.4438.objecter _get_session s=0x7fe8980a0c10 osd=3 3 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 20 client.4438.objecter put_session s=0x7fe8980a0c10 osd=3 3 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 15 client.4438.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 20 client.4438.objecter _get_session s=0x7fe8980a0c10 osd=3 3 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 20 client.4438.objecter get_session s=0x7fe8980a0c10 osd=3 3 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 15 client.4438.objecter _session_command_op_assign 3 1 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 20 client.4438.objecter put_session s=0x7fe8980a0c10 osd=3 4 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 10 client.4438.objecter _send_command 1 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.194:6804/3920278128 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8980c2ec0 con 0x7fe8980a12c0 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 20 client.4438.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7fe8b4059890 con 0x7fe8c80585e0 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8c4ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7f04ba179640 10 monclient: get_auth_request con 0x7f0484077d90 auth_method 0 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7f049affd640 10 client.4463.objecter ms_handle_connect 0x7f0484077d90 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1105730784 0 0) 0x7f6e440b1ae0 con 0x7f6e44161800 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7fe8cc85e640 10 monclient: get_auth_request con 0x7fe8980a12c0 auth_method 0 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e14003610 con 0x7f6e44161800 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e30003350 con 0x7f6e44161800 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7f6e1ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7f6e1ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.538+0000 7f6e1ffff640 10 monclient(hunting): dump: 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.561 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f04b00921d0 con 0x7f04b40ba350 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 10 client.4463.objecter ms_dispatch2 0x7f04b4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 3 client.4463.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 3 client.4463.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 10 client.4463.objecter checking command 1 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 20 client.4463.objecter _get_session s=0x7f04840a0bf0 osd=8 3 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 20 client.4463.objecter put_session s=0x7f04840a0bf0 osd=8 3 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 15 client.4463.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 20 client.4463.objecter _get_session s=0x7f04840a0bf0 osd=8 3 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 20 client.4463.objecter get_session s=0x7f04840a0bf0 osd=8 3 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 15 client.4463.objecter _session_command_op_assign 8 1 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 20 client.4463.objecter put_session s=0x7f04840a0bf0 osd=8 4 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 10 client.4463.objecter _send_command 1 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.45:6809/1756229077 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04840c2ea0 con 0x7f04840a12a0 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 20 client.4463.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f04b0058870 con 0x7f04b40ba350 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f049affd640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.539+0000 7f04b9978640 10 monclient: get_auth_request con 0x7f04840a12a0 auth_method 0 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fe8c4ff9640 10 client.4438.objecter ms_handle_connect 0x7fe8980a12c0 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== osd.13 v1:10.20.193.114:6812/3533295890 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe0240c2d90 con 0x7fe0240a1190 2026-02-24T19:17:53.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fe050ff9640 10 client.4475.objecter ms_dispatch2 0x7fe054000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fe050ff9640 10 client.4475.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fe050ff9640 20 client.4475.objecter put_session s=0x7fe0240a0ae0 osd=13 4 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fe050ff9640 15 client.4475.objecter _session_command_op_remove 13 1 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdeed7fa640 1 -- 10.20.193.45:0/3055974161 <== osd.1 v1:10.20.193.114:6808/1876170727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fdef8059ab0 con 0x7fdec80a15b0 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdeed7fa640 10 client.4440.objecter ms_dispatch2 0x7fdef8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdeed7fa640 10 client.4440.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdeed7fa640 20 client.4440.objecter put_session s=0x7fdec80a0f00 osd=1 4 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdeed7fa640 15 client.4440.objecter _session_command_op_remove 1 2 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 10 librados: watch_flush enter 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 10 librados: watch_flush exit 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 10 client.4440.objecter close_session for osd.1 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 >> v1:10.20.193.114:6808/1876170727 conn(0x7fdec80a15b0 legacy=0x7fdec80c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 20 client.4440.objecter put_session s=0x7fdec80a0f00 osd=1 1 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 20 client.4440.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 10 client.4440.objecter successfully canceled tick 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 >> v1:10.20.193.45:6800/1599977652 conn(0x7fdec8078080 legacy=0x7fdec8098530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 10 monclient: shutdown 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 >> v1:10.20.193.45:6789/0 conn(0x7fdef8155b20 legacy=0x7fdef80afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefd39a640 1 -- 10.20.193.45:0/3055974161 reap_dead start 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 shutdown_connections 2026-02-24T19:17:53.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 >> 10.20.193.45:0/3055974161 conn(0x7fdef80b2ef0 msgr2=0x7fdef80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1697357661 0 0) 0x7f6cfc0b2bf0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 >> v1:10.20.193.179:6789/0 conn(0x7f6cfc0ba350 legacy=0x7f6cfc0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 >> v1:10.20.193.114:6789/0 conn(0x7f6cfc0b9f80 legacy=0x7f6cfc165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 shutdown_connections 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 1 monclient: found mon.a 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc0b40c0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6cf8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7fdefee24640 1 -- 10.20.193.45:0/3055974161 wait complete. 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6d028d7640 5 monclient: authenticate success, global_id 4470 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6d028d7640 10 monclient: _renew_subs 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6d028d7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.540+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc0b43a0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7fdefee24640 1 librados: shutdown 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 10 client.4470.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 10 monclient: _renew_subs 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6cfc1630e0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 1 librados: init done 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f049affd640 10 client.4463.objecter ms_handle_connect 0x7f04840a12a0 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 10 client.4470.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 15 client.4470.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 20 client.4470.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 10 client.4470.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6cfc0b48c0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6795ffb640 1 -- 10.20.193.45:0/970369541 <== osd.6 v1:10.20.193.179:6804/1928709825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f67a8158900 con 0x7f67780a1400 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6795ffb640 10 client.4423.objecter ms_dispatch2 0x7f67a8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6795ffb640 10 client.4423.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6795ffb640 20 client.4423.objecter put_session s=0x7f67780a0d50 osd=6 4 2026-02-24T19:17:53.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.541+0000 7f6795ffb640 15 client.4423.objecter _session_command_op_remove 6 2 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 10 librados: watch_flush enter 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 10 librados: watch_flush exit 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 10 client.4423.objecter close_session for osd.6 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 >> v1:10.20.193.179:6804/1928709825 conn(0x7f67780a1400 legacy=0x7f67780c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 20 client.4423.objecter put_session s=0x7f67780a0d50 osd=6 1 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 20 client.4423.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 10 client.4423.objecter successfully canceled tick 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6778077ed0 legacy=0x7f6778098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 10 monclient: shutdown 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 >> v1:10.20.193.114:6789/0 conn(0x7f67a8058070 legacy=0x7f67a80b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67adc57640 1 -- 10.20.193.45:0/970369541 reap_dead start 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 shutdown_connections 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.542+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 >> 10.20.193.45:0/970369541 conn(0x7f67a80b7780 msgr2=0x7f67a8162ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 shutdown_connections 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f67af6e1640 1 -- 10.20.193.45:0/970369541 wait complete. 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f67af6e1640 1 librados: shutdown 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2810592686 0 0) 0x7f6e440a8280 con 0x7f6e44161430 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 >> v1:10.20.193.114:6789/0 conn(0x7f6e44161800 legacy=0x7f6e440a9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 >> v1:10.20.193.45:6789/0 conn(0x7f6e4416ad30 legacy=0x7f6e441641c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 1 monclient: found mon.c 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e440a8560 con 0x7f6e44161430 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e49f0a640 5 monclient: authenticate success, global_id 4478 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e49f0a640 10 monclient: _renew_subs 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e49f0a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e440a8840 con 0x7f6e44161430 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e49f0a640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e49f0a640 10 monclient: _renew_subs 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e49f0a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e440a8e00 con 0x7f6e44161430 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.543+0000 7f6e49f0a640 1 librados: init done 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.544+0000 7f6e49f0a640 10 client.4478.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.544+0000 7f6e49f0a640 15 client.4478.objecter _session_command_op_assign -1 1 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.544+0000 7f6e49f0a640 20 client.4478.objecter _get_session osd=-1 returning homeless 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.544+0000 7f6e49f0a640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.544+0000 7f6e49f0a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.544+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6e440b0ac0 con 0x7f6e44161430 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== osd.14 v1:10.20.193.179:6812/1196591242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ff8d00c2e60 con 0x7ff8d00a1260 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7ff8e37fe640 10 client.4461.objecter ms_dispatch2 0x7ff904000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7ff8e37fe640 10 client.4461.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7ff8e37fe640 20 client.4461.objecter put_session s=0x7ff8d00a0bb0 osd=14 4 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7ff8e37fe640 15 client.4461.objecter _session_command_op_remove 14 1 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4d01600d0 con 0x7fa4d00585e0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7fa4b67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa4c0004a70 con 0x7fa4d00585e0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7fa4b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7fa4b67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7fa4b67fc640 10 monclient: dump: 2026-02-24T19:17:53.567 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.545+0000 7fa4b7fff640 4 set_mon_vals no callback set 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.546+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fa4c0004c50 con 0x7fa4d00585e0 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.546+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== osd.10 v1:10.20.193.179:6808/2982984950 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f5a880c2e60 con 0x7f5a880a1260 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.546+0000 7f5aa5ffb640 10 client.4460.objecter ms_dispatch2 0x7f5ab8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.546+0000 7f5aa5ffb640 10 client.4460.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.546+0000 7f5aa5ffb640 20 client.4460.objecter put_session s=0x7f5a880a0bb0 osd=10 4 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.546+0000 7f5aa5ffb640 15 client.4460.objecter _session_command_op_remove 10 1 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.546+0000 7fa4d542c640 10 monclient: get_auth_request con 0x7fa4a0077f60 auth_method 0 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.546+0000 7fa4b67fc640 10 client.4467.objecter ms_handle_connect 0x7fa4a0077f60 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 10 client.4475.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 15 client.4475.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 20 client.4475.objecter _get_session s=0x7fe0240a0ae0 osd=13 3 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 20 client.4475.objecter put_session s=0x7fe0240a0ae0 osd=13 3 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 20 client.4475.objecter _get_session s=0x7fe0240a0ae0 osd=13 3 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 15 client.4475.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 20 client.4475.objecter get_session s=0x7fe0240a0ae0 osd=13 3 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 15 client.4475.objecter _session_command_op_assign 13 2 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 20 client.4475.objecter put_session s=0x7fe0240a0ae0 osd=13 4 2026-02-24T19:17:53.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 10 client.4475.objecter _send_command 2 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.548+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 --> v1:10.20.193.114:6812/3533295890 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe0540b64c0 con 0x7fe0240a1190 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fa4c0092f80 con 0x7fa4d00585e0 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 10 client.4467.objecter ms_dispatch2 0x7fa4d0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 3 client.4467.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 3 client.4467.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 10 client.4467.objecter checking command 1 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 20 client.4467.objecter _get_session s=0x7fa4a00a0de0 osd=9 3 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 20 client.4467.objecter put_session s=0x7fa4a00a0de0 osd=9 3 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 15 client.4467.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 20 client.4467.objecter _get_session s=0x7fa4a00a0de0 osd=9 3 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 20 client.4467.objecter get_session s=0x7fa4a00a0de0 osd=9 3 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 15 client.4467.objecter _session_command_op_assign 9 1 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 20 client.4467.objecter put_session s=0x7fa4a00a0de0 osd=9 4 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 10 client.4467.objecter _send_command 1 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.114:6800/2864194603 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4a00c3090 con 0x7fa4a00a1490 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 20 client.4467.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7fa4c005d080 con 0x7fa4d00585e0 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4b67fc640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.549+0000 7fa4d642e640 10 monclient: get_auth_request con 0x7fa4a00a1490 auth_method 0 2026-02-24T19:17:53.569 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:53.570 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-24T19:17:53.570 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:53.570 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-24T19:17:53.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.550+0000 7fa4b67fc640 10 client.4467.objecter ms_handle_connect 0x7fa4a00a1490 2026-02-24T19:17:53.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe050ff9640 1 -- 10.20.193.45:0/1759405135 <== osd.13 v1:10.20.193.114:6812/3533295890 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fe0540b64c0 con 0x7fe0240a1190 2026-02-24T19:17:53.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe050ff9640 10 client.4475.objecter ms_dispatch2 0x7fe054000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe050ff9640 10 client.4475.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe050ff9640 20 client.4475.objecter put_session s=0x7fe0240a0ae0 osd=13 4 2026-02-24T19:17:53.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe050ff9640 15 client.4475.objecter _session_command_op_remove 13 2 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 10 librados: watch_flush enter 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 10 librados: watch_flush exit 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 10 client.4475.objecter close_session for osd.13 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 >> v1:10.20.193.114:6812/3533295890 conn(0x7fe0240a1190 legacy=0x7fe0240c15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 20 client.4475.objecter put_session s=0x7fe0240a0ae0 osd=13 1 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 20 client.4475.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 10 client.4475.objecter successfully canceled tick 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 >> v1:10.20.193.45:6800/1599977652 conn(0x7fe024077c60 legacy=0x7fe024098110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 10 monclient: shutdown 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 >> v1:10.20.193.179:6789/0 conn(0x7fe0540585e0 legacy=0x7fe054158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe058f9a640 1 -- 10.20.193.45:0/1759405135 reap_dead start 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 shutdown_connections 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 >> 10.20.193.45:0/1759405135 conn(0x7fe0540b7990 msgr2=0x7fe054158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 shutdown_connections 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 1 -- 10.20.193.45:0/1759405135 wait complete. 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.551+0000 7fe05aa24640 1 librados: shutdown 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.552+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== osd.15 v1:10.20.193.194:6808/4057136445 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f13b80c2ff0 con 0x7f13b80a13f0 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.552+0000 7f13c3fff640 10 client.4444.objecter ms_dispatch2 0x7f13e8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.552+0000 7f13c3fff640 10 client.4444.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.552+0000 7f13c3fff640 20 client.4444.objecter put_session s=0x7f13b80a0d40 osd=15 4 2026-02-24T19:17:53.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.552+0000 7f13c3fff640 15 client.4444.objecter _session_command_op_remove 15 1 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 10 client.4461.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 15 client.4461.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 20 client.4461.objecter _get_session s=0x7ff8d00a0bb0 osd=14 3 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 20 client.4461.objecter put_session s=0x7ff8d00a0bb0 osd=14 3 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 20 client.4461.objecter _get_session s=0x7ff8d00a0bb0 osd=14 3 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 15 client.4461.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 20 client.4461.objecter get_session s=0x7ff8d00a0bb0 osd=14 3 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 15 client.4461.objecter _session_command_op_assign 14 2 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 20 client.4461.objecter put_session s=0x7ff8d00a0bb0 osd=14 4 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 10 client.4461.objecter _send_command 2 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.553+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 --> v1:10.20.193.179:6812/1196591242 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff90405bc20 con 0x7ff8d00a1260 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 10 client.4460.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 15 client.4460.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 20 client.4460.objecter _get_session s=0x7f5a880a0bb0 osd=10 3 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 20 client.4460.objecter put_session s=0x7f5a880a0bb0 osd=10 3 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 20 client.4460.objecter _get_session s=0x7f5a880a0bb0 osd=10 3 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 15 client.4460.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 20 client.4460.objecter get_session s=0x7f5a880a0bb0 osd=10 3 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 15 client.4460.objecter _session_command_op_assign 10 2 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 20 client.4460.objecter put_session s=0x7f5a880a0bb0 osd=10 4 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 10 client.4460.objecter _send_command 2 2026-02-24T19:17:53.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.554+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 --> v1:10.20.193.179:6808/2982984950 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ab8056530 con 0x7f5a880a1260 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff8e37fe640 1 -- 10.20.193.45:0/3262806083 <== osd.14 v1:10.20.193.179:6812/1196591242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7ff90405bc20 con 0x7ff8d00a1260 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff8e37fe640 10 client.4461.objecter ms_dispatch2 0x7ff904000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff8e37fe640 10 client.4461.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff8e37fe640 20 client.4461.objecter put_session s=0x7ff8d00a0bb0 osd=14 4 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff8e37fe640 15 client.4461.objecter _session_command_op_remove 14 2 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 10 librados: watch_flush enter 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 10 librados: watch_flush exit 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 10 client.4461.objecter close_session for osd.14 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 >> v1:10.20.193.179:6812/1196591242 conn(0x7ff8d00a1260 legacy=0x7ff8d00c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 20 client.4461.objecter put_session s=0x7ff8d00a0bb0 osd=14 1 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 20 client.4461.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 10 client.4461.objecter successfully canceled tick 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 >> v1:10.20.193.45:6800/1599977652 conn(0x7ff8d0077d30 legacy=0x7ff8d00981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 10 monclient: shutdown 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 >> v1:10.20.193.45:6789/0 conn(0x7ff9040b28b0 legacy=0x7ff9041fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff903577640 1 -- 10.20.193.45:0/3262806083 reap_dead start 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 shutdown_connections 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 >> 10.20.193.45:0/3262806083 conn(0x7ff9040b5290 msgr2=0x7ff904135840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 shutdown_connections 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.558+0000 7ff90909f640 1 -- 10.20.193.45:0/3262806083 wait complete. 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7ff90909f640 1 librados: shutdown 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:53.574 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e440b0ac0 con 0x7f6e44161430 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6e1ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6e34003720 con 0x7f6e44161430 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6e1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6e1ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6e1ffff640 10 monclient: dump: 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.574 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6e41ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ce8003520 con 0x7f6cfc0585e0 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6cf8ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6ce8004a70 con 0x7f6cfc0585e0 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6cf8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6cf8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6cf8ff9640 10 monclient: dump: 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.559+0000 7f6cfa7fc640 4 set_mon_vals no callback set 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5aa5ffb640 1 -- 10.20.193.45:0/1838342536 <== osd.10 v1:10.20.193.179:6808/2982984950 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7f5ab8056530 con 0x7f5a880a1260 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5aa5ffb640 10 client.4460.objecter ms_dispatch2 0x7f5ab8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5aa5ffb640 10 client.4460.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5aa5ffb640 20 client.4460.objecter put_session s=0x7f5a880a0bb0 osd=10 4 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5aa5ffb640 15 client.4460.objecter _session_command_op_remove 10 2 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f6ce801d8e0 con 0x7f6cfc0585e0 2026-02-24T19:17:53.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 10 client.4444.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 15 client.4444.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 20 client.4444.objecter _get_session s=0x7f13b80a0d40 osd=15 3 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 20 client.4444.objecter put_session s=0x7f13b80a0d40 osd=15 3 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 20 client.4444.objecter _get_session s=0x7f13b80a0d40 osd=15 3 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 15 client.4444.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 20 client.4444.objecter get_session s=0x7f13b80a0d40 osd=15 3 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 15 client.4444.objecter _session_command_op_assign 15 2 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 20 client.4444.objecter put_session s=0x7f13b80a0d40 osd=15 4 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 10 client.4444.objecter _send_command 2 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 --> v1:10.20.193.194:6808/4057136445 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f13e8058690 con 0x7f13b80a13f0 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 10 librados: watch_flush enter 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 10 librados: watch_flush exit 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 10 client.4460.objecter close_session for osd.10 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 >> v1:10.20.193.179:6808/2982984950 conn(0x7f5a880a1260 legacy=0x7f5a880c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 20 client.4460.objecter put_session s=0x7f5a880a0bb0 osd=10 1 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 20 client.4460.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 10 client.4460.objecter successfully canceled tick 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 >> v1:10.20.193.45:6800/1599977652 conn(0x7f5a88077d30 legacy=0x7f5a880981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 10 monclient: shutdown 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 >> v1:10.20.193.179:6789/0 conn(0x7f5ab80b5d20 legacy=0x7f5ab811dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abddfe640 1 -- 10.20.193.45:0/1838342536 reap_dead start 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 shutdown_connections 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 >> 10.20.193.45:0/1838342536 conn(0x7f5ab80b5210 msgr2=0x7f5ab80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f6e34003930 con 0x7f6e44161430 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 shutdown_connections 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 1 -- 10.20.193.45:0/1838342536 wait complete. 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f5abf888640 1 librados: shutdown 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== osd.3 v1:10.20.193.194:6804/3920278128 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe8980c2ec0 con 0x7fe8980a12c0 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7fe8c4ff9640 10 client.4438.objecter ms_dispatch2 0x7fe8c8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7fe8c4ff9640 10 client.4438.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7fe8c4ff9640 20 client.4438.objecter put_session s=0x7fe8980a0c10 osd=3 4 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7fe8c4ff9640 15 client.4438.objecter _session_command_op_remove 3 1 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f6cfb7fe640 10 monclient: get_auth_request con 0x7f6ccc077f40 auth_method 0 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f6cf8ff9640 10 client.4470.objecter ms_handle_connect 0x7f6ccc077f40 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== osd.8 v1:10.20.193.45:6809/1756229077 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f04840c2ea0 con 0x7f04840a12a0 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f049affd640 10 client.4463.objecter ms_dispatch2 0x7f04b4000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f049affd640 10 client.4463.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f049affd640 20 client.4463.objecter put_session s=0x7f04840a0bf0 osd=8 4 2026-02-24T19:17:53.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.560+0000 7f049affd640 15 client.4463.objecter _session_command_op_remove 8 1 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e42ffd640 10 monclient: get_auth_request con 0x7f6e14077f60 auth_method 0 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 10 client.4478.objecter ms_handle_connect 0x7f6e14077f60 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f6e34003720 con 0x7f6e44161430 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 10 client.4478.objecter ms_dispatch2 0x7f6e44000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 3 client.4478.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 3 client.4478.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 10 client.4478.objecter checking command 1 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 20 client.4478.objecter _get_session s=0x7f6e140a0de0 osd=12 3 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 20 client.4478.objecter put_session s=0x7f6e140a0de0 osd=12 3 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 15 client.4478.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 20 client.4478.objecter _get_session s=0x7f6e140a0de0 osd=12 3 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 20 client.4478.objecter get_session s=0x7f6e140a0de0 osd=12 3 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 15 client.4478.objecter _session_command_op_assign 12 1 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 20 client.4478.objecter put_session s=0x7f6e140a0de0 osd=12 4 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 10 client.4478.objecter _send_command 1 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.45:6813/2990889504 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e140c3090 con 0x7f6e140a1490 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 20 client.4478.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f6e340583b0 con 0x7f6e44161430 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.561+0000 7f6e1ffff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.562+0000 7f6e43fff640 10 monclient: get_auth_request con 0x7f6e140a1490 auth_method 0 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13c3fff640 1 -- 10.20.193.45:0/2655397413 <== osd.15 v1:10.20.193.194:6808/4057136445 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f13e8058690 con 0x7f13b80a13f0 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13c3fff640 10 client.4444.objecter ms_dispatch2 0x7f13e8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13c3fff640 10 client.4444.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13c3fff640 20 client.4444.objecter put_session s=0x7f13b80a0d40 osd=15 4 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13c3fff640 15 client.4444.objecter _session_command_op_remove 15 2 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 10 librados: watch_flush enter 2026-02-24T19:17:53.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 10 librados: watch_flush exit 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 10 client.4444.objecter close_session for osd.15 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 >> v1:10.20.193.194:6808/4057136445 conn(0x7f13b80a13f0 legacy=0x7f13b80c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 20 client.4444.objecter put_session s=0x7f13b80a0d40 osd=15 1 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 20 client.4444.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 10 client.4444.objecter successfully canceled tick 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 >> v1:10.20.193.45:6800/1599977652 conn(0x7f13b8077e60 legacy=0x7f13b8098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 10 monclient: shutdown 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 >> v1:10.20.193.114:6789/0 conn(0x7f13e8159a70 legacy=0x7f13e81f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13e7fff640 1 -- 10.20.193.45:0/2655397413 reap_dead start 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 shutdown_connections 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 >> 10.20.193.45:0/2655397413 conn(0x7f13e80b7780 msgr2=0x7f13e8161890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f6ce8093030 con 0x7f6cfc0585e0 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 10 client.4470.objecter ms_dispatch2 0x7f6cfc000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 3 client.4470.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 3 client.4470.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 shutdown_connections 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6e1ffff640 10 client.4478.objecter ms_handle_connect 0x7f6e140a1490 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 1 -- 10.20.193.45:0/2655397413 wait complete. 2026-02-24T19:17:53.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f13ede13640 1 librados: shutdown 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 10 client.4470.objecter checking command 1 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 20 client.4470.objecter _get_session s=0x7f6ccc0a0dc0 osd=5 3 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 20 client.4470.objecter put_session s=0x7f6ccc0a0dc0 osd=5 3 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 15 client.4470.objecter _session_command_op_remove -1 1 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 20 client.4470.objecter _get_session s=0x7f6ccc0a0dc0 osd=5 3 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 20 client.4470.objecter get_session s=0x7f6ccc0a0dc0 osd=5 3 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 15 client.4470.objecter _session_command_op_assign 5 1 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 20 client.4470.objecter put_session s=0x7f6ccc0a0dc0 osd=5 4 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 10 client.4470.objecter _send_command 1 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.114:6804/3576632251 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ccc0c3070 con 0x7f6ccc0a1470 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 20 client.4470.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f6ce805d130 con 0x7f6cfc0585e0 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.563+0000 7f6cf8ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.564+0000 7f6d00e4d640 10 monclient: get_auth_request con 0x7f6ccc0a1470 auth_method 0 2026-02-24T19:17:53.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.565+0000 7f6cf8ff9640 10 client.4470.objecter ms_handle_connect 0x7f6ccc0a1470 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:53.581 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stdout:94489280517 2026-02-24T19:17:53.581 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 10 client.4463.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 15 client.4463.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 20 client.4463.objecter _get_session s=0x7f04840a0bf0 osd=8 3 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 20 client.4463.objecter put_session s=0x7f04840a0bf0 osd=8 3 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 20 client.4463.objecter _get_session s=0x7f04840a0bf0 osd=8 3 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 15 client.4463.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 20 client.4463.objecter get_session s=0x7f04840a0bf0 osd=8 3 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 15 client.4463.objecter _session_command_op_assign 8 2 2026-02-24T19:17:53.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 20 client.4463.objecter put_session s=0x7f04840a0bf0 osd=8 4 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 10 client.4463.objecter _send_command 2 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.568+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 --> v1:10.20.193.45:6809/1756229077 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04b40b94f0 con 0x7f04840a12a0 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 10 client.4438.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 15 client.4438.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 20 client.4438.objecter _get_session s=0x7fe8980a0c10 osd=3 3 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 20 client.4438.objecter put_session s=0x7fe8980a0c10 osd=3 3 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 20 client.4438.objecter _get_session s=0x7fe8980a0c10 osd=3 3 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 15 client.4438.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 20 client.4438.objecter get_session s=0x7fe8980a0c10 osd=3 3 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 15 client.4438.objecter _session_command_op_assign 3 2 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 20 client.4438.objecter put_session s=0x7fe8980a0c10 osd=3 4 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 10 client.4438.objecter _send_command 2 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.570+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 --> v1:10.20.193.194:6804/3920278128 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8c80b96f0 con 0x7fe8980a12c0 2026-02-24T19:17:53.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f049affd640 1 -- 10.20.193.45:0/3083984518 <== osd.8 v1:10.20.193.45:6809/1756229077 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f04b40b94f0 con 0x7f04840a12a0 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f049affd640 10 client.4463.objecter ms_dispatch2 0x7f04b4000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f049affd640 10 client.4463.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f049affd640 20 client.4463.objecter put_session s=0x7f04840a0bf0 osd=8 4 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f049affd640 15 client.4463.objecter _session_command_op_remove 8 2 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-24T19:17:53.583 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 10 librados: watch_flush enter 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 10 librados: watch_flush exit 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 10 client.4463.objecter close_session for osd.8 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 >> v1:10.20.193.45:6809/1756229077 conn(0x7f04840a12a0 legacy=0x7f04840c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 20 client.4463.objecter put_session s=0x7f04840a0bf0 osd=8 1 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 20 client.4463.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 10 client.4463.objecter successfully canceled tick 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 >> v1:10.20.193.45:6800/1599977652 conn(0x7f0484077d90 legacy=0x7f0484098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 10 monclient: shutdown 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 >> v1:10.20.193.179:6789/0 conn(0x7f04b40ba350 legacy=0x7f04b40b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.571+0000 7f04ba97a640 1 -- 10.20.193.45:0/3083984518 reap_dead start 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.572+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 shutdown_connections 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.572+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 >> 10.20.193.45:0/3083984518 conn(0x7f04b40b7990 msgr2=0x7f04b415acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.572+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 shutdown_connections 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.572+0000 7f04bc404640 1 -- 10.20.193.45:0/3083984518 wait complete. 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.572+0000 7f04bc404640 1 librados: shutdown 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== osd.9 v1:10.20.193.114:6800/2864194603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fa4a00c3090 con 0x7fa4a00a1490 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fa4b67fc640 10 client.4467.objecter ms_dispatch2 0x7fa4d0000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fa4b67fc640 10 client.4467.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fa4b67fc640 20 client.4467.objecter put_session s=0x7fa4a00a0de0 osd=9 4 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fa4b67fc640 15 client.4467.objecter _session_command_op_remove 9 1 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8c4ff9640 1 -- 10.20.193.45:0/1586384284 <== osd.3 v1:10.20.193.194:6804/3920278128 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7fe8c80b96f0 con 0x7fe8980a12c0 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8c4ff9640 10 client.4438.objecter ms_dispatch2 0x7fe8c8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8c4ff9640 10 client.4438.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8c4ff9640 20 client.4438.objecter put_session s=0x7fe8980a0c10 osd=3 4 2026-02-24T19:17:53.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8c4ff9640 15 client.4438.objecter _session_command_op_remove 3 2 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 10 librados: watch_flush enter 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 10 librados: watch_flush exit 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 10 client.4438.objecter close_session for osd.3 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 >> v1:10.20.193.194:6804/3920278128 conn(0x7fe8980a12c0 legacy=0x7fe8980c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 20 client.4438.objecter put_session s=0x7fe8980a0c10 osd=3 1 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 20 client.4438.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 10 client.4438.objecter successfully canceled tick 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 >> v1:10.20.193.45:6800/1599977652 conn(0x7fe898077d90 legacy=0x7fe898098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 10 monclient: shutdown 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 >> v1:10.20.193.114:6789/0 conn(0x7fe8c80585e0 legacy=0x7fe8c815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8cc85e640 1 -- 10.20.193.45:0/1586384284 reap_dead start 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 shutdown_connections 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 >> 10.20.193.45:0/1586384284 conn(0x7fe8c80b7990 msgr2=0x7fe8c815bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 shutdown_connections 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 1 -- 10.20.193.45:0/1586384284 wait complete. 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.573+0000 7fe8ce2e8640 1 librados: shutdown 2026-02-24T19:17:53.585 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:53.586 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 10 client.4467.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 15 client.4467.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 20 client.4467.objecter _get_session s=0x7fa4a00a0de0 osd=9 3 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 20 client.4467.objecter put_session s=0x7fa4a00a0de0 osd=9 3 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 20 client.4467.objecter _get_session s=0x7fa4a00a0de0 osd=9 3 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 15 client.4467.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 20 client.4467.objecter get_session s=0x7fa4a00a0de0 osd=9 3 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 15 client.4467.objecter _session_command_op_assign 9 2 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 20 client.4467.objecter put_session s=0x7fa4a00a0de0 osd=9 4 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 10 client.4467.objecter _send_command 2 2026-02-24T19:17:53.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.581+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 --> v1:10.20.193.114:6800/2864194603 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa4d01ff3a0 con 0x7fa4a00a1490 2026-02-24T19:17:53.587 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-24T19:17:53.587 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.586+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== osd.5 v1:10.20.193.114:6804/3576632251 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6ccc0c3070 con 0x7f6ccc0a1470 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.586+0000 7f6cf8ff9640 10 client.4470.objecter ms_dispatch2 0x7f6cfc000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.586+0000 7f6cf8ff9640 10 client.4470.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.586+0000 7f6cf8ff9640 20 client.4470.objecter put_session s=0x7f6ccc0a0dc0 osd=5 4 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.586+0000 7f6cf8ff9640 15 client.4470.objecter _session_command_op_remove 5 1 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.587+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== osd.12 v1:10.20.193.45:6813/2990889504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6e140c3090 con 0x7f6e140a1490 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.587+0000 7f6e1ffff640 10 client.4478.objecter ms_dispatch2 0x7f6e44000b90 command_reply(tid 1: 0 ) 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.587+0000 7f6e1ffff640 10 client.4478.objecter _finish_command 1 = system:0 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.587+0000 7f6e1ffff640 20 client.4478.objecter put_session s=0x7f6e140a0de0 osd=12 4 2026-02-24T19:17:53.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.587+0000 7f6e1ffff640 15 client.4478.objecter _session_command_op_remove 12 1 2026-02-24T19:17:53.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.590+0000 7fa4b67fc640 1 -- 10.20.193.45:0/3505813563 <== osd.9 v1:10.20.193.114:6800/2864194603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fa4cc005cb0 con 0x7fa4a00a1490 2026-02-24T19:17:53.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.590+0000 7fa4b67fc640 10 client.4467.objecter ms_dispatch2 0x7fa4d0000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.590+0000 7fa4b67fc640 10 client.4467.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.590+0000 7fa4b67fc640 20 client.4467.objecter put_session s=0x7fa4a00a0de0 osd=9 4 2026-02-24T19:17:53.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.590+0000 7fa4b67fc640 15 client.4467.objecter _session_command_op_remove 9 2 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 10 librados: watch_flush enter 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 10 librados: watch_flush exit 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 10 client.4467.objecter close_session for osd.9 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 >> v1:10.20.193.114:6800/2864194603 conn(0x7fa4a00a1490 legacy=0x7fa4a00c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 20 client.4467.objecter put_session s=0x7fa4a00a0de0 osd=9 1 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 20 client.4467.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 10 client.4467.objecter successfully canceled tick 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 >> v1:10.20.193.45:6800/1599977652 conn(0x7fa4a0077f60 legacy=0x7fa4a0098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 10 monclient: shutdown 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 >> v1:10.20.193.45:6789/0 conn(0x7fa4d00585e0 legacy=0x7fa4d015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d642e640 1 -- 10.20.193.45:0/3505813563 reap_dead start 2026-02-24T19:17:53.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 shutdown_connections 2026-02-24T19:17:53.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 >> 10.20.193.45:0/3505813563 conn(0x7fa4d00b7990 msgr2=0x7fa4d015bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 shutdown_connections 2026-02-24T19:17:53.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 1 -- 10.20.193.45:0/3505813563 wait complete. 2026-02-24T19:17:53.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.591+0000 7fa4d7eb8640 1 librados: shutdown 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 10 client.4470.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 15 client.4470.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 20 client.4470.objecter _get_session s=0x7f6ccc0a0dc0 osd=5 3 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 20 client.4470.objecter put_session s=0x7f6ccc0a0dc0 osd=5 3 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 20 client.4470.objecter _get_session s=0x7f6ccc0a0dc0 osd=5 3 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 15 client.4470.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 20 client.4470.objecter get_session s=0x7f6ccc0a0dc0 osd=5 3 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 15 client.4470.objecter _session_command_op_assign 5 2 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 20 client.4470.objecter put_session s=0x7f6ccc0a0dc0 osd=5 4 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 10 client.4470.objecter _send_command 2 2026-02-24T19:17:53.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 --> v1:10.20.193.114:6804/3576632251 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6cfc0b64c0 con 0x7f6ccc0a1470 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 10 client.4478.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 15 client.4478.objecter _session_command_op_assign -1 2 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 20 client.4478.objecter _get_session s=0x7f6e140a0de0 osd=12 3 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 20 client.4478.objecter put_session s=0x7f6e140a0de0 osd=12 3 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 20 client.4478.objecter _get_session s=0x7f6e140a0de0 osd=12 3 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 15 client.4478.objecter _session_command_op_remove -1 2 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 20 client.4478.objecter get_session s=0x7f6e140a0de0 osd=12 3 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 15 client.4478.objecter _session_command_op_assign 12 2 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 20 client.4478.objecter put_session s=0x7f6e140a0de0 osd=12 4 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 10 client.4478.objecter _send_command 2 2026-02-24T19:17:53.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.598+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 --> v1:10.20.193.45:6813/2990889504 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e4415fe60 con 0x7f6e140a1490 2026-02-24T19:17:53.604 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:53.604 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6cf8ff9640 1 -- 10.20.193.45:0/1979761118 <== osd.5 v1:10.20.193.114:6804/3576632251 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f6cfc0b64c0 con 0x7f6ccc0a1470 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6cf8ff9640 10 client.4470.objecter ms_dispatch2 0x7f6cfc000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6cf8ff9640 10 client.4470.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6cf8ff9640 20 client.4470.objecter put_session s=0x7f6ccc0a0dc0 osd=5 4 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6cf8ff9640 15 client.4470.objecter _session_command_op_remove 5 2 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6d028d7640 10 librados: watch_flush enter 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6d028d7640 10 librados: watch_flush exit 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6d028d7640 10 client.4470.objecter close_session for osd.5 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 >> v1:10.20.193.114:6804/3576632251 conn(0x7f6ccc0a1470 legacy=0x7f6ccc0c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6d028d7640 20 client.4470.objecter put_session s=0x7f6ccc0a0dc0 osd=5 1 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6d028d7640 20 client.4470.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.603+0000 7f6d028d7640 10 client.4470.objecter successfully canceled tick 2026-02-24T19:17:53.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6ccc077f40 legacy=0x7f6ccc0983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d028d7640 10 monclient: shutdown 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d028d7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 >> v1:10.20.193.45:6789/0 conn(0x7f6cfc0585e0 legacy=0x7f6cfc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d00e4d640 1 -- 10.20.193.45:0/1979761118 reap_dead start 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 shutdown_connections 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 >> 10.20.193.45:0/1979761118 conn(0x7f6cfc0b7990 msgr2=0x7f6cfc15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 shutdown_connections 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d028d7640 1 -- 10.20.193.45:0/1979761118 wait complete. 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.604+0000 7f6d028d7640 1 librados: shutdown 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.605+0000 7f6e1ffff640 1 -- 10.20.193.45:0/1477172374 <== osd.12 v1:10.20.193.45:6813/2990889504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f6e4415fe60 con 0x7f6e140a1490 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.605+0000 7f6e1ffff640 10 client.4478.objecter ms_dispatch2 0x7f6e44000b90 command_reply(tid 2: 0 ) 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.605+0000 7f6e1ffff640 10 client.4478.objecter _finish_command 2 = system:0 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.605+0000 7f6e1ffff640 20 client.4478.objecter put_session s=0x7f6e140a0de0 osd=12 4 2026-02-24T19:17:53.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.605+0000 7f6e1ffff640 15 client.4478.objecter _session_command_op_remove 12 2 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 10 librados: watch_flush enter 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 10 librados: watch_flush exit 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 10 client.4478.objecter close_session for osd.12 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 >> v1:10.20.193.45:6813/2990889504 conn(0x7f6e140a1490 legacy=0x7f6e140c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 20 client.4478.objecter put_session s=0x7f6e140a0de0 osd=12 1 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 20 client.4478.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 10 client.4478.objecter successfully canceled tick 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6e14077f60 legacy=0x7f6e14098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 10 monclient: shutdown 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 >> v1:10.20.193.179:6789/0 conn(0x7f6e44161430 legacy=0x7f6e4405c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e43fff640 1 -- 10.20.193.45:0/1477172374 reap_dead start 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 shutdown_connections 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 >> 10.20.193.45:0/1477172374 conn(0x7f6e440b2ef0 msgr2=0x7f6e44122800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 shutdown_connections 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 1 -- 10.20.193.45:0/1477172374 wait complete. 2026-02-24T19:17:53.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.606+0000 7f6e49f0a640 1 librados: shutdown 2026-02-24T19:17:53.616 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:53.616 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-24T19:17:53.620 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:53.620 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.640+0000 7f404f4cd640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.640+0000 7f404f4cd640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.640+0000 7f404f4cd640 10 monclient: monmap: 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.640799+0000 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.640799+0000 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.642 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.641+0000 7f404f4cd640 1 Processor -- start 2026-02-24T19:17:53.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.641+0000 7f404f4cd640 1 -- start start 2026-02-24T19:17:53.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.641+0000 7f404f4cd640 10 monclient: init 2026-02-24T19:17:53.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7fd006db1640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7fd006db1640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7fd006db1640 10 monclient: monmap: 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.642262+0000 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.642262+0000 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.645 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 10 monclient(hunting): picked mon.noname-c con 0x7f404815d0c0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f9c5377f640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f9c5377f640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f9c5377f640 10 monclient: monmap: 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.642513+0000 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.642513+0000 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.646 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.647 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.647 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.647 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 10 monclient(hunting): picked mon.noname-a con 0x7f40480b0ca0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 10 monclient(hunting): picked mon.noname-b con 0x7f40480b28b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40480b8540 con 0x7f40480b0ca0 2026-02-24T19:17:53.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7fd006db1640 1 Processor -- start 2026-02-24T19:17:53.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40480b5da0 con 0x7f40480b28b0 2026-02-24T19:17:53.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40480b6080 con 0x7f404815d0c0 2026-02-24T19:17:53.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404f4cd640 10 monclient(hunting): authenticate will time out at 3645.280804s 2026-02-24T19:17:53.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404d242640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f404815d0c0 0x7f40480b0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35968/0 (socket says 10.20.193.45:35968) 2026-02-24T19:17:53.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f404d242640 1 -- 10.20.193.45:0/2724903825 learned_addr learned my addr 10.20.193.45:0/2724903825 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7f9c5377f640 1 Processor -- start 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 1 -- start start 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 10 monclient: init 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 10 monclient(hunting): picked mon.noname-a con 0x7f9c4c0b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 10 monclient(hunting): picked mon.noname-b con 0x7f9c4c0ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 10 monclient(hunting): picked mon.noname-c con 0x7f9c4c0585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c163930 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c163bb0 con 0x7f9c4c0ba350 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c163e90 con 0x7f9c4c0585e0 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7f9c5377f640 10 monclient(hunting): authenticate will time out at 3645.281880s 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7fd006db1640 1 -- start start 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.642+0000 7fd006db1640 10 monclient: init 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 10 monclient(hunting): picked mon.noname-a con 0x7fd000159a70 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 10 monclient(hunting): picked mon.noname-b con 0x7fd000159e40 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 10 monclient(hunting): picked mon.noname-c con 0x7fd000058070 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd000163930 con 0x7fd000159a70 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd000163bf0 con 0x7fd000159e40 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd000163ed0 con 0x7fd000058070 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.643+0000 7fd006db1640 10 monclient(hunting): authenticate will time out at 3645.281452s 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290953315 0 0) 0x7f40480b6080 con 0x7f404815d0c0 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 10 monclient(hunting): my global_id is 4481 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4030003610 con 0x7f404815d0c0 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7fd004b26640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fd000159a70 0x7fd0000b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44066/0 (socket says 10.20.193.45:44066) 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7fd004b26640 1 -- 10.20.193.45:0/3053031772 learned_addr learned my addr 10.20.193.45:0/3053031772 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f9c514f4640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9c4c0b9f80 0x7f9c4c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44070/0 (socket says 10.20.193.45:44070) 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f9c514f4640 1 -- 10.20.193.45:0/365325458 learned_addr learned my addr 10.20.193.45:0/365325458 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f9c51cf5640 1 --1- 10.20.193.45:0/365325458 >> v1:10.20.193.179:6789/0 conn(0x7f9c4c0585e0 0x7f9c4c166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:35994/0 (socket says 10.20.193.45:35994) 2026-02-24T19:17:53.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3275030708 0 0) 0x7f40480b5da0 con 0x7f40480b28b0 2026-02-24T19:17:53.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 10 monclient(hunting): my global_id is 4468 2026-02-24T19:17:53.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.644+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40480b6080 con 0x7f40480b28b0 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.645+0000 7f0ab7a67640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.645+0000 7f0ab7a67640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.645+0000 7f0ab7a67640 10 monclient: monmap: 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.645610+0000 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.645610+0000 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.653 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 1 Processor -- start 2026-02-24T19:17:53.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 1 -- start start 2026-02-24T19:17:53.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 10 monclient: init 2026-02-24T19:17:53.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852485662 0 0) 0x7fd000163ed0 con 0x7fd000058070 2026-02-24T19:17:53.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7fcff77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7fcff77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7fcff77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7fcff77fe640 10 monclient(hunting): my global_id is 4484 2026-02-24T19:17:53.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfec003610 con 0x7fd000058070 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 10 monclient(hunting): picked mon.noname-c con 0x7f0ab00b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 10 monclient(hunting): picked mon.noname-a con 0x7f0ab00ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 10 monclient(hunting): picked mon.noname-b con 0x7f0ab00585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab0163930 con 0x7f0ab00ba350 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab0163bb0 con 0x7f0ab00585e0 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab0163e90 con 0x7f0ab00b9f80 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.646+0000 7f0ab7a67640 10 monclient(hunting): authenticate will time out at 3645.284692s 2026-02-24T19:17:53.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7fdce9404640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7fdce9404640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7fdce9404640 10 monclient: monmap: 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.647624+0000 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.647624+0000 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862543904 0 0) 0x7f9c4c163e90 con 0x7f9c4c0585e0 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7f9c3bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7f9c3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7f9c3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7f9c3bfff640 10 monclient(hunting): my global_id is 4487 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c34003610 con 0x7f9c4c0585e0 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773696932 0 0) 0x7fd000163930 con 0x7fd000159a70 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7fcff77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7fcff77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7fcff77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7fcff77fe640 10 monclient(hunting): my global_id is 4482 2026-02-24T19:17:53.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.647+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd000163ed0 con 0x7fd000159a70 2026-02-24T19:17:53.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914484115 0 0) 0x7f40480b8540 con 0x7f40480b0ca0 2026-02-24T19:17:53.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient(hunting): my global_id is 4479 2026-02-24T19:17:53.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40480b5da0 con 0x7f40480b0ca0 2026-02-24T19:17:53.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 1 Processor -- start 2026-02-24T19:17:53.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 1 -- start start 2026-02-24T19:17:53.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 10 monclient: init 2026-02-24T19:17:53.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387528254 0 0) 0x7fd000163bf0 con 0x7fd000159e40 2026-02-24T19:17:53.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fcff77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fcff77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fcff77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fcff77fe640 10 monclient(hunting): my global_id is 4471 2026-02-24T19:17:53.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd000163930 con 0x7fd000159e40 2026-02-24T19:17:53.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1366262397 0 0) 0x7f40480b6080 con 0x7f40480b28b0 2026-02-24T19:17:53.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 >> v1:10.20.193.179:6789/0 conn(0x7f404815d0c0 legacy=0x7f40480b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 >> v1:10.20.193.45:6789/0 conn(0x7f40480b0ca0 legacy=0x7f40480b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4048163e10 con 0x7f40480b28b0 2026-02-24T19:17:53.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4044003170 con 0x7f40480b28b0 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f4037fff640 10 monclient: dump: 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f404f4cd640 5 monclient: authenticate success, global_id 4468 2026-02-24T19:17:53.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f404f4cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f0ab57dc640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f0ab00b9f80 0x7f0ab0163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36010/0 (socket says 10.20.193.45:36010) 2026-02-24T19:17:53.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7f0ab57dc640 1 -- 10.20.193.45:0/2280142264 learned_addr learned my addr 10.20.193.45:0/2280142264 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:53.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 10 monclient(hunting): picked mon.noname-a con 0x7fdce40b9f30 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 10 monclient(hunting): picked mon.noname-b con 0x7fdce40b7110 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 10 monclient(hunting): picked mon.noname-c con 0x7fdce40ba300 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce41680a0 con 0x7fdce40b9f30 2026-02-24T19:17:53.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce4168380 con 0x7fdce40b7110 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce40b5610 con 0x7fdce40ba300 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.648+0000 7fdce9404640 10 monclient(hunting): authenticate will time out at 3645.286915s 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2998148806 0 0) 0x7fcfec003610 con 0x7fd000058070 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 >> v1:10.20.193.114:6789/0 conn(0x7fd000159e40 legacy=0x7fd000163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 >> v1:10.20.193.45:6789/0 conn(0x7fd000159a70 legacy=0x7fd0000b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd000057590 con 0x7fd000058070 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fcffc003170 con 0x7fd000058070 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fcff77fe640 10 monclient: dump: 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fd006db1640 5 monclient: authenticate success, global_id 4484 2026-02-24T19:17:53.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7fd006db1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777206444 0 0) 0x7f9c4c163bb0 con 0x7f9c4c0ba350 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7f9c3bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7f9c3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7f9c3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7f9c3bfff640 10 monclient(hunting): my global_id is 4474 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.650+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c4c163e90 con 0x7f9c4c0ba350 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 80573969 0 0) 0x7f9c34003610 con 0x7f9c4c0585e0 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 >> v1:10.20.193.114:6789/0 conn(0x7f9c4c0ba350 legacy=0x7f9c4c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 >> v1:10.20.193.45:6789/0 conn(0x7f9c4c0b9f80 legacy=0x7f9c4c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c0573f0 con 0x7f9c4c0585e0 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9c48003170 con 0x7f9c4c0585e0 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c3bfff640 10 monclient: dump: 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c5377f640 5 monclient: authenticate success, global_id 4487 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7f9c5377f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7fdce2ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fdce40b9f30 0x7fdce416b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44094/0 (socket says 10.20.193.45:44094) 2026-02-24T19:17:53.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.653+0000 7fdce2ffd640 1 -- 10.20.193.45:0/350800302 learned_addr learned my addr 10.20.193.45:0/350800302 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37189345 0 0) 0x7f0ab0163e90 con 0x7f0ab00b9f80 2026-02-24T19:17:53.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 10 monclient(hunting): my global_id is 4490 2026-02-24T19:17:53.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a98003610 con 0x7f0ab00b9f80 2026-02-24T19:17:53.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707441807 0 0) 0x7f0aa4002910 con 0x7f0ab00ba350 2026-02-24T19:17:53.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 10 monclient(hunting): my global_id is 4488 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.654+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab0163e90 con 0x7f0ab00ba350 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4044003340 con 0x7f40480b28b0 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f4037fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f4037fff640 1 -- 10.20.193.45:0/2724903825 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4044003780 con 0x7f40480b28b0 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f4037fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f4037fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f4037fff640 10 monclient: dump: 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f404f4cd640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f404f4cd640 4 set_mon_vals no callback set 2026-02-24T19:17:53.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2775535679 0 0) 0x7f0ab0163bb0 con 0x7f0ab00585e0 2026-02-24T19:17:53.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f0a9ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f0a9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f0a9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f0a9ffff640 10 monclient(hunting): my global_id is 4477 2026-02-24T19:17:53.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0aa4002910 con 0x7f0ab00585e0 2026-02-24T19:17:53.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f404f4cd640 10 monclient: shutdown 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f404f4cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.655+0000 7f404f4cd640 1 -- 10.20.193.45:0/2724903825 >> v1:10.20.193.114:6789/0 conn(0x7f40480b28b0 legacy=0x7f40480b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.656+0000 7f404f4cd640 1 -- 10.20.193.45:0/2724903825 shutdown_connections 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.656+0000 7f404f4cd640 1 -- 10.20.193.45:0/2724903825 >> 10.20.193.45:0/2724903825 conn(0x7f40480b5290 msgr2=0x7f40480b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.656+0000 7f404f4cd640 1 -- 10.20.193.45:0/2724903825 shutdown_connections 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7f404f4cd640 1 -- 10.20.193.45:0/2724903825 wait complete. 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcffc003340 con 0x7fd000058070 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7fcff77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7fcff77fe640 1 -- 10.20.193.45:0/3053031772 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fcffc003780 con 0x7fd000058070 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7fcff77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7fcff77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7fcff77fe640 10 monclient: dump: 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.670 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7fd006db1640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7fd006db1640 4 set_mon_vals no callback set 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7f404f4cd640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.657+0000 7f404f4cd640 10 monclient: monmap: 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 1 librados: starting msgr at 2026-02-24T19:17:53.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 1 librados: starting objecter 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2166979734 0 0) 0x7f0a98003610 con 0x7f0ab00b9f80 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 >> v1:10.20.193.114:6789/0 conn(0x7f0ab00585e0 legacy=0x7f0ab0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 1 Processor -- start 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 >> v1:10.20.193.45:6789/0 conn(0x7f0ab00ba350 legacy=0x7f0ab0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab00573f0 con 0x7f0ab00b9f80 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0ab7a67640 5 monclient: authenticate success, global_id 4490 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0ab7a67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7fd006db1640 10 monclient: shutdown 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7fd006db1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7fd006db1640 1 -- 10.20.193.45:0/3053031772 >> v1:10.20.193.179:6789/0 conn(0x7fd000058070 legacy=0x7fd000058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7fd006db1640 1 -- 10.20.193.45:0/3053031772 shutdown_connections 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7fd006db1640 1 -- 10.20.193.45:0/3053031772 >> 10.20.193.45:0/3053031772 conn(0x7fd0000b7780 msgr2=0x7fd0000b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f0aa0002df0 con 0x7f0ab00b9f80 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0a9ffff640 10 monclient: dump: 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.673 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f0ab7a67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7fd006db1640 1 -- 10.20.193.45:0/3053031772 shutdown_connections 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7fd006db1640 1 -- 10.20.193.45:0/3053031772 wait complete. 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 1 -- start start 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 1 librados: setting wanted keys 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 1 librados: calling monclient init 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 10 monclient: init 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 10 monclient(hunting): picked mon.noname-c con 0x7f40480b0ca0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 10 monclient(hunting): picked mon.noname-a con 0x7f40480b28b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 10 monclient(hunting): picked mon.noname-b con 0x7f404815d0c0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40481544b0 con 0x7f40480b28b0 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4048154790 con 0x7f404815d0c0 2026-02-24T19:17:53.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4048154a70 con 0x7f40480b0ca0 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.658+0000 7f404f4cd640 10 monclient(hunting): authenticate will time out at 3645.296787s 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fd006db1640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fd006db1640 10 monclient: monmap: 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 714142950 0 0) 0x7fdce40b5610 con 0x7fdce40ba300 2026-02-24T19:17:53.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 10 monclient(hunting): my global_id is 4493 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc8003610 con 0x7fdce40ba300 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677514870 0 0) 0x7fdce4168380 con 0x7fdce40b7110 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 10 monclient(hunting): my global_id is 4480 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce40b5610 con 0x7fdce40b7110 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fd006db1640 1 librados: starting msgr at 2026-02-24T19:17:53.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7fd006db1640 1 librados: starting objecter 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 1 Processor -- start 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 1 -- start start 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 1 librados: setting wanted keys 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 1 librados: calling monclient init 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 10 monclient: init 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c48003380 con 0x7f9c4c0585e0 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7f9c3bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7f9c3bfff640 1 -- 10.20.193.45:0/365325458 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9c480037c0 con 0x7f9c4c0585e0 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7f9c3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7f9c3bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7f9c3bfff640 10 monclient: dump: 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.677 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7f9c5377f640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.659+0000 7f9c5377f640 4 set_mon_vals no callback set 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7f9c5377f640 10 monclient: shutdown 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7f9c5377f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7f9c5377f640 1 -- 10.20.193.45:0/365325458 >> v1:10.20.193.179:6789/0 conn(0x7f9c4c0585e0 legacy=0x7f9c4c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7f9c5377f640 1 -- 10.20.193.45:0/365325458 shutdown_connections 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7f9c5377f640 1 -- 10.20.193.45:0/365325458 >> 10.20.193.45:0/365325458 conn(0x7f9c4c0b7990 msgr2=0x7f9c4c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 10 monclient(hunting): picked mon.noname-c con 0x7fd000058070 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 10 monclient(hunting): picked mon.noname-b con 0x7fd000159a70 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7f9c5377f640 1 -- 10.20.193.45:0/365325458 shutdown_connections 2026-02-24T19:17:53.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 1 -- 10.20.193.45:0/365325458 wait complete. 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088651480 0 0) 0x7fdce41680a0 con 0x7fdce40b9f30 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fdce1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fdce1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fdce1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fdce1ffb640 10 monclient(hunting): my global_id is 4491 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce4168380 con 0x7fdce40b9f30 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.660+0000 7fd006db1640 10 monclient(hunting): picked mon.noname-a con 0x7fd000159e40 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fd006db1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd00013c1c0 con 0x7fd000159e40 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fd006db1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0001566d0 con 0x7fd000159a70 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fd006db1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd00013b640 con 0x7fd000058070 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fd006db1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7fd006db1640 10 monclient(hunting): authenticate will time out at 3645.299141s 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 10 monclient: monmap: 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.679 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f404da43640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f404815d0c0 0x7f4048119d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:48994/0 (socket says 10.20.193.45:48994) 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f404da43640 1 -- 10.20.193.45:0/2278757026 learned_addr learned my addr 10.20.193.45:0/2278757026 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 1 librados: starting msgr at 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 1 librados: starting objecter 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 1 Processor -- start 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 1 -- start start 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 1 librados: setting wanted keys 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 1 librados: calling monclient init 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f9c5377f640 10 monclient: init 2026-02-24T19:17:53.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0aa0003040 con 0x7f0ab00b9f80 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f0a9ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f0a9ffff640 1 -- 10.20.193.45:0/2280142264 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f0aa0003440 con 0x7f0ab00b9f80 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f0a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f0a9ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f0a9ffff640 10 monclient: dump: 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f0ab7a67640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.661+0000 7f0ab7a67640 4 set_mon_vals no callback set 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4208225187 0 0) 0x7fdce40b5610 con 0x7fdce40b7110 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 >> v1:10.20.193.179:6789/0 conn(0x7fdce40ba300 legacy=0x7fdce40b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 >> v1:10.20.193.45:6789/0 conn(0x7fdce40b9f30 legacy=0x7fdce416b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce40b58f0 con 0x7fdce40b7110 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f4035ffb640 10 client.?.objecter ms_handle_connect 0x7f404815d0c0 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f4035ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce9404640 5 monclient: authenticate success, global_id 4480 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce9404640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdcd8002db0 con 0x7fdce40b7110 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce1ffb640 10 monclient: dump: 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.682 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fdce9404640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 10 monclient(hunting): picked mon.noname-b con 0x7f9c4c0585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 10 monclient(hunting): picked mon.noname-a con 0x7f9c4c0b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 10 monclient(hunting): picked mon.noname-c con 0x7f9c4c0ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c1fee00 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f0ab7a67640 10 monclient: shutdown 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f0ab7a67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f0ab7a67640 1 -- 10.20.193.45:0/2280142264 >> v1:10.20.193.179:6789/0 conn(0x7f0ab00b9f80 legacy=0x7f0ab0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c160320 con 0x7f9c4c0585e0 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c160600 con 0x7f9c4c0ba350 2026-02-24T19:17:53.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f9c5377f640 10 monclient(hunting): authenticate will time out at 3645.300599s 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f0ab7a67640 1 -- 10.20.193.45:0/2280142264 shutdown_connections 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f0ab7a67640 1 -- 10.20.193.45:0/2280142264 >> 10.20.193.45:0/2280142264 conn(0x7f0ab00b7990 msgr2=0x7f0ab00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f0ab7a67640 1 -- 10.20.193.45:0/2280142264 shutdown_connections 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fc3e95c8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fc3e95c8640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7fc3e95c8640 10 monclient: monmap: 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.663033+0000 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.663033+0000 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7f4035ffb640 10 client.?.objecter ms_handle_connect 0x7f40480b0ca0 2026-02-24T19:17:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7f4035ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7fefaa05b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7fefaa05b640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7fefaa05b640 10 monclient: monmap: 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.663489+0000 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.663489+0000 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7fc3e95c8640 1 Processor -- start 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.662+0000 7f0ab7a67640 1 -- 10.20.193.45:0/2280142264 wait complete. 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7fc3e95c8640 1 -- start start 2026-02-24T19:17:53.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7fc3e95c8640 10 monclient: init 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7f0ab7a67640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7f0ab7a67640 10 monclient: monmap: 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7f0ab7a67640 1 librados: starting msgr at 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.663+0000 7f0ab7a67640 1 librados: starting objecter 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 1 Processor -- start 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fcff7fff640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fd000159a70 0x7fd0001fc8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49006/0 (socket says 10.20.193.45:49006) 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fcff7fff640 1 -- 10.20.193.45:0/3193130503 learned_addr learned my addr 10.20.193.45:0/3193130503 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 1 -- start start 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 1 librados: setting wanted keys 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 1 librados: calling monclient init 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 10 monclient: init 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 10 monclient(hunting): picked mon.noname-a con 0x7fc3e41566e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 10 monclient(hunting): picked mon.noname-b con 0x7fc3e4160c00 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 10 monclient(hunting): picked mon.noname-c con 0x7fc3e4156ab0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e4058480 con 0x7fc3e41566e0 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982474559 0 0) 0x7f4048154790 con 0x7f404815d0c0 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f4035ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f4035ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f4035ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fefaa05b640 1 Processor -- start 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fefaa05b640 1 -- start start 2026-02-24T19:17:53.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fefaa05b640 10 monclient: init 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e4058760 con 0x7fc3e4160c00 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e40b0f90 con 0x7fc3e4156ab0 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fc3e95c8640 10 monclient(hunting): authenticate will time out at 3645.302315s 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f6a0884d640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f6a0884d640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f6a0884d640 10 monclient: monmap: 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.664589+0000 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.664589+0000 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f4035ffb640 10 monclient(hunting): my global_id is 4483 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4018003610 con 0x7f404815d0c0 2026-02-24T19:17:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f9c514f4640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f9c4c0585e0 0x7f9c4c15daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49012/0 (socket says 10.20.193.45:49012) 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f9c514f4640 1 -- 10.20.193.45:0/4052145813 learned_addr learned my addr 10.20.193.45:0/4052145813 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 10 monclient(hunting): picked mon.noname-b con 0x7f0ab00585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fcff57fa640 10 client.?.objecter ms_handle_connect 0x7fd000159a70 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7fcff57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 10 monclient(hunting): picked mon.noname-a con 0x7f0ab00b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 10 monclient(hunting): picked mon.noname-c con 0x7f0ab00ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab00b3290 con 0x7f0ab00b9f80 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab00b3570 con 0x7f0ab00585e0 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f9c39ffb640 10 client.?.objecter ms_handle_connect 0x7f9c4c0585e0 2026-02-24T19:17:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f9c39ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab00b3850 con 0x7f0ab00ba350 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.664+0000 7f0ab7a67640 10 monclient(hunting): authenticate will time out at 3645.302949s 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 1 Processor -- start 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 1 -- start start 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 10 monclient: init 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcd8003040 con 0x7fdce40b7110 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fdce1ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fdce1ffb640 1 -- 10.20.193.45:0/350800302 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdcd8003440 con 0x7fdce40b7110 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fdce1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fdce1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fdce1ffb640 10 monclient: dump: 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fdce9404640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fdce9404640 4 set_mon_vals no callback set 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fa33b89d640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fa33b89d640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fa33b89d640 10 monclient: monmap: 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.665383+0000 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.665383+0000 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 10 monclient(hunting): picked mon.noname-b con 0x7fefa4159a70 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 10 monclient(hunting): picked mon.noname-c con 0x7fefa4159e40 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 10 monclient(hunting): picked mon.noname-a con 0x7fefa4058070 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa4163930 con 0x7fefa4058070 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa4163bf0 con 0x7fefa4159a70 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa4163ed0 con 0x7fefa4159e40 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fefaa05b640 10 monclient(hunting): authenticate will time out at 3645.303423s 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f3b157f5640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f3b157f5640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f3b157f5640 10 monclient: monmap: 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.665500+0000 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.665500+0000 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f9c39ffb640 10 client.?.objecter ms_handle_connect 0x7f9c4c0ba350 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f9c39ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 10 monclient(hunting): picked mon.noname-b con 0x7f6a00159a70 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 10 monclient(hunting): picked mon.noname-a con 0x7f6a00159e40 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 10 monclient(hunting): picked mon.noname-c con 0x7f6a00058070 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fcff57fa640 10 client.?.objecter ms_handle_connect 0x7fd000058070 2026-02-24T19:17:53.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fcff57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a00163930 con 0x7f6a00159e40 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a00163bf0 con 0x7f6a00159a70 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a00163ed0 con 0x7f6a00058070 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f6a0884d640 10 monclient(hunting): authenticate will time out at 3645.303887s 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7fa33b89d640 1 Processor -- start 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f0ab5fdd640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f0ab00ba350 0x7f0ab0263c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36064/0 (socket says 10.20.193.45:36064) 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.665+0000 7f0ab5fdd640 1 -- 10.20.193.45:0/3139101406 learned_addr learned my addr 10.20.193.45:0/3139101406 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 1 -- start start 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 10 monclient: init 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 1 Processor -- start 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 1 -- start start 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 10 monclient: init 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fe8e2ba2640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fe8e2ba2640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fe8e2ba2640 10 monclient: monmap: 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.666523+0000 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.666523+0000 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fdce9404640 10 monclient: shutdown 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fdce9404640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fdce9404640 1 -- 10.20.193.45:0/350800302 >> v1:10.20.193.114:6789/0 conn(0x7fdce40b7110 legacy=0x7fdce41676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 349396126 0 0) 0x7fd0001566d0 con 0x7fd000159a70 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fcff57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fcff57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fcff57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fcff57fa640 10 monclient(hunting): my global_id is 4489 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfd0003610 con 0x7fd000159a70 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 10 monclient(hunting): picked mon.noname-a con 0x7f3b100b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 10 monclient(hunting): picked mon.noname-c con 0x7f3b100ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 10 monclient(hunting): picked mon.noname-b con 0x7f3b100585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b10163930 con 0x7f3b100b9f80 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b10163bb0 con 0x7f3b100585e0 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b10163e90 con 0x7f3b100ba350 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f3b157f5640 10 monclient(hunting): authenticate will time out at 3645.304817s 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fe8e2ba2640 1 Processor -- start 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f0a9dffb640 10 client.?.objecter ms_handle_connect 0x7f0ab00ba350 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7f0a9dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fe8e2ba2640 1 -- start start 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 10 monclient: init 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 10 monclient(hunting): picked mon.noname-a con 0x7fa3340b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 10 monclient(hunting): picked mon.noname-b con 0x7fa3340ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 10 monclient(hunting): picked mon.noname-c con 0x7fa3340585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa334163930 con 0x7fa3340b9f80 2026-02-24T19:17:53.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa334163bb0 con 0x7fa3340ba350 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa334163e90 con 0x7fa3340585e0 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.666+0000 7fa33b89d640 10 monclient(hunting): authenticate will time out at 3645.304725s 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fdce9404640 1 -- 10.20.193.45:0/350800302 shutdown_connections 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fdce9404640 1 -- 10.20.193.45:0/350800302 >> 10.20.193.45:0/350800302 conn(0x7fdce40b7990 msgr2=0x7fdce40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fdce9404640 1 -- 10.20.193.45:0/350800302 shutdown_connections 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fdce9404640 1 -- 10.20.193.45:0/350800302 wait complete. 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 10 monclient(hunting): picked mon.noname-b con 0x7fe8dc0b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299243517 0 0) 0x7f4048154a70 con 0x7f40480b0ca0 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7f4035ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7f4035ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7f4035ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7f4035ffb640 10 monclient(hunting): my global_id is 4496 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4048154790 con 0x7f40480b0ca0 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 10 monclient(hunting): picked mon.noname-c con 0x7fe8dc0ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fdce9404640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fdce9404640 10 monclient: monmap: 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 10 monclient(hunting): picked mon.noname-a con 0x7fe8dc0585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8dc163930 con 0x7fe8dc0585e0 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8dc163bb0 con 0x7fe8dc0b9f80 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8dc163e90 con 0x7fe8dc0ba350 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.667+0000 7fe8e2ba2640 10 monclient(hunting): authenticate will time out at 3645.305958s 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 1 librados: starting msgr at 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 1 librados: starting objecter 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 1 Processor -- start 2026-02-24T19:17:53.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 308832449 0 0) 0x7fd00013b640 con 0x7fd000058070 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fcff57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fc3e37fe640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fc3e4156ab0 0x7fc3e4055980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36048/0 (socket says 10.20.193.45:36048) 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 1 -- start start 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 1 librados: setting wanted keys 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fcff57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 1 librados: calling monclient init 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 10 monclient: init 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fcff57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fc3e37fe640 1 -- 10.20.193.45:0/3001764201 learned_addr learned my addr 10.20.193.45:0/3001764201 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fcff57fa640 10 monclient(hunting): my global_id is 4502 2026-02-24T19:17:53.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0001566d0 con 0x7fd000058070 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 10 monclient(hunting): picked mon.noname-c con 0x7fdce40b7110 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 10 monclient(hunting): picked mon.noname-b con 0x7fdce40b9f30 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 10 monclient(hunting): picked mon.noname-a con 0x7fdce40ba300 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce41592a0 con 0x7fdce40ba300 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce4159580 con 0x7fdce40b9f30 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce4144f90 con 0x7fdce40b7110 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.668+0000 7fdce9404640 10 monclient(hunting): authenticate will time out at 3645.306549s 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.669+0000 7f4035ffb640 10 client.?.objecter ms_handle_connect 0x7f40480b28b0 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.669+0000 7f4035ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.670+0000 7f717ae93640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.670+0000 7f717ae93640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.670+0000 7f717ae93640 10 monclient: monmap: 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.670985+0000 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.670985+0000 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.670+0000 7f2d43695640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.670+0000 7f2d43695640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.670+0000 7f2d43695640 10 monclient: monmap: 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.671044+0000 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.671044+0000 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.671+0000 7f717ae93640 1 Processor -- start 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.671+0000 7f717ae93640 1 -- start start 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.671+0000 7f717ae93640 10 monclient: init 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.671+0000 7f717ae93640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.671+0000 7f717ae93640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.671+0000 7f717ae93640 10 monclient(hunting): picked mon.noname-b con 0x7f71740b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.671+0000 7f717ae93640 10 monclient(hunting): picked mon.noname-a con 0x7f71740ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.671+0000 7f717ae93640 10 monclient(hunting): picked mon.noname-c con 0x7f71740585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.671+0000 7f717ae93640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7174163930 con 0x7f71740ba350 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f717ae93640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7174163bb0 con 0x7f71740b9f80 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f717ae93640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7174163e90 con 0x7f71740585e0 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f717ae93640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f717ae93640 10 monclient(hunting): authenticate will time out at 3645.310093s 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3174373597 0 0) 0x7fcfd0003610 con 0x7fd000159a70 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd00013b640 con 0x7fd000159a70 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fcfe8003120 con 0x7fd000159a70 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fcff57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fefa2ffd640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fefa4159e40 0x7fefa4163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36068/0 (socket says 10.20.193.45:36068) 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fefa2ffd640 1 -- 10.20.193.45:0/1398325203 learned_addr learned my addr 10.20.193.45:0/1398325203 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fcff57fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fcff57fa640 10 monclient(hunting): dump: 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fcff57fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 1 Processor -- start 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 1 -- start start 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 10 monclient: init 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 10 monclient(hunting): picked mon.noname-b con 0x7f2d3c15deb0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 10 monclient(hunting): picked mon.noname-c con 0x7f2d3c15e280 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 10 monclient(hunting): picked mon.noname-a con 0x7f2d3c0ba3b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3c0b5880 con 0x7f2d3c0ba3b0 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3c0b5b60 con 0x7f2d3c15deb0 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3c0b5e40 con 0x7f2d3c15e280 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7f2d43695640 10 monclient(hunting): authenticate will time out at 3645.310892s 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fcff57fa640 10 client.?.objecter ms_handle_connect 0x7fd000159e40 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.672+0000 7fcff57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7fa339e13640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fa3340585e0 0x7fa334166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36080/0 (socket says 10.20.193.45:36080) 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7fa339e13640 1 -- 10.20.193.45:0/3940832878 learned_addr learned my addr 10.20.193.45:0/3940832878 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938722174 0 0) 0x7f0ab00b3850 con 0x7f0ab00ba350 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7f0a9dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7f0a9dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7f0a9dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7f0a9dffb640 10 monclient(hunting): my global_id is 4505 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a80003610 con 0x7f0ab00ba350 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7f6a06dc3640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f6a00058070 0x7f6a00058460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36076/0 (socket says 10.20.193.45:36076) 2026-02-24T19:17:53.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.673+0000 7f6a06dc3640 1 -- 10.20.193.45:0/228866009 learned_addr learned my addr 10.20.193.45:0/228866009 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 client.?.objecter ms_handle_connect 0x7f9c4c0b9f80 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414791754 0 0) 0x7f9c4c160320 con 0x7f9c4c0585e0 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 monclient(hunting): my global_id is 4486 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f0a9dffb640 10 client.?.objecter ms_handle_connect 0x7f0ab00585e0 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f0a9dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c1c003610 con 0x7f9c4c0585e0 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154230188 0 0) 0x7f9c4c160600 con 0x7f9c4c0ba350 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 10 monclient(hunting): my global_id is 4499 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.675+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c4c160320 con 0x7f9c4c0ba350 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2051992317 0 0) 0x7f4018003610 con 0x7f404815d0c0 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4048154a70 con 0x7f404815d0c0 2026-02-24T19:17:53.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4044003690 con 0x7f404815d0c0 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7fe8d3fff640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fe8dc0ba350 0x7fe8dc057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36100/0 (socket says 10.20.193.45:36100) 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7fe8d3fff640 1 -- 10.20.193.45:0/176126312 learned_addr learned my addr 10.20.193.45:0/176126312 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777855093 0 0) 0x7f40481544b0 con 0x7f40480b28b0 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.676+0000 7f4035ffb640 10 monclient(hunting): my global_id is 4494 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.677+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4018003610 con 0x7f40480b28b0 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.677+0000 7f3b0f7fe640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f3b100585e0 0x7f3b10166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49058/0 (socket says 10.20.193.45:49058) 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.677+0000 7f3b0f7fe640 1 -- 10.20.193.45:0/1626581695 learned_addr learned my addr 10.20.193.45:0/1626581695 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.678+0000 7fdce2ffd640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fdce40b7110 0x7fdce4145a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36102/0 (socket says 10.20.193.45:36102) 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.678+0000 7fdce2ffd640 1 -- 10.20.193.45:0/3094090899 learned_addr learned my addr 10.20.193.45:0/3094090899 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.679+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797245565 0 0) 0x7f9c4c1fee00 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.679+0000 7f9c39ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.679+0000 7f9c39ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.679+0000 7f9c39ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.679+0000 7f9c39ffb640 10 monclient(hunting): my global_id is 4500 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.679+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c4c160600 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.680+0000 7f0a9dffb640 10 client.?.objecter ms_handle_connect 0x7f0ab00b9f80 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.680+0000 7f0a9dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606372541 0 0) 0x7fefa4163bf0 con 0x7fefa4159a70 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7fefa27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7fefa27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7fefa27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7fefa27fc640 10 monclient(hunting): my global_id is 4492 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef88003610 con 0x7fefa4159a70 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7fdcbf7fe640 10 client.?.objecter ms_handle_connect 0x7fdce40b7110 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7fdcbf7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7f7178c08640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f71740b9f80 0x7f7174163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49100/0 (socket says 10.20.193.45:49100) 2026-02-24T19:17:53.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.681+0000 7f7178c08640 1 -- 10.20.193.45:0/3505897597 learned_addr learned my addr 10.20.193.45:0/3505897597 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.682+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559481164 0 0) 0x7fd00013c1c0 con 0x7fd000159e40 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.682+0000 7fcff57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.682+0000 7fcff57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.682+0000 7fcff57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.682+0000 7fcff57fa640 10 monclient(hunting): my global_id is 4497 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.682+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfd0003610 con 0x7fd000159e40 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.682+0000 7f2d40c09640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f2d3c15e280 0x7f2d3c0ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36124/0 (socket says 10.20.193.45:36124) 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.682+0000 7f2d40c09640 1 -- 10.20.193.45:0/2264095183 learned_addr learned my addr 10.20.193.45:0/2264095183 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.683+0000 7fdcbf7fe640 10 client.?.objecter ms_handle_connect 0x7fdce40ba300 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.683+0000 7fdcbf7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.683+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1055070452 0 0) 0x7f4048154790 con 0x7f40480b0ca0 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.683+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40481544b0 con 0x7f40480b0ca0 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.683+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4038002ed0 con 0x7f40480b0ca0 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.683+0000 7f4035ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.683+0000 7f4035ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.683+0000 7f4035ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fdcbf7fe640 10 client.?.objecter ms_handle_connect 0x7fdce40b9f30 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fdcbf7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 903289256 0 0) 0x7fd00013b640 con 0x7fd000159a70 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 >> v1:10.20.193.179:6789/0 conn(0x7fd000058070 legacy=0x7fd000155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 >> v1:10.20.193.45:6789/0 conn(0x7fd000159e40 legacy=0x7fd0000b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 1 monclient: found mon.b 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00013b920 con 0x7fd000159a70 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fcff57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 5 monclient: authenticate success, global_id 4489 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 10 monclient: _renew_subs 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327433492 0 0) 0x7fa334163e90 con 0x7fa3340585e0 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fa323fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd00013bc00 con 0x7fd000159a70 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fa323fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fa323fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fa323fff640 10 monclient(hunting): my global_id is 4514 2026-02-24T19:17:53.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa31c003610 con 0x7fa3340585e0 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 10 client.4489.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 10 monclient: _renew_subs 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0001fcfb0 con 0x7fd000159a70 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 1 librados: init done 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7f4cdfe13640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7f4cdfe13640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd000139690 con 0x7fd000159a70 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.684+0000 7f4cdfe13640 10 monclient: monmap: 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.684732+0000 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.684732+0000 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 1 Processor -- start 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686416962 0 0) 0x7fc3e4058760 con 0x7fc3e4160c00 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 10 monclient(hunting): my global_id is 4495 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d0003610 con 0x7fc3e4160c00 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922150307 0 0) 0x7f0ab00b3570 con 0x7f0ab00585e0 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f0a9dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f0a9dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f0a9dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f0a9dffb640 10 monclient(hunting): my global_id is 4498 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ab00b3850 con 0x7f0ab00585e0 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 1 -- start start 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 10 monclient: init 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 10 monclient(hunting): picked mon.noname-b con 0x7f4cd81617a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314192367 0 0) 0x7f3b10163bb0 con 0x7f3b100585e0 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f3b0dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f3b0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f3b0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f3b0dffb640 10 monclient(hunting): my global_id is 4504 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3afc003610 con 0x7f3b100585e0 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303226332 0 0) 0x7fc3e40b0f90 con 0x7fc3e4156ab0 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 10 monclient(hunting): my global_id is 4508 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 10 monclient(hunting): picked mon.noname-a con 0x7f4cd8161b70 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e4058760 con 0x7fc3e4156ab0 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 10 monclient(hunting): picked mon.noname-c con 0x7f4cd80b5de0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd8167aa0 con 0x7f4cd8161b70 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd8167d80 con 0x7f4cd81617a0 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.685+0000 7f4cdfe13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd8168060 con 0x7f4cd80b5de0 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.686+0000 7f4cdfe13640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.686+0000 7f4cdfe13640 10 monclient(hunting): authenticate will time out at 3645.324024s 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.689+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740231398 0 0) 0x7f6a00163930 con 0x7f6a00159e40 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.689+0000 7f6a055c0640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.689+0000 7f6a055c0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.689+0000 7f6a055c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.689+0000 7f6a055c0640 10 monclient(hunting): my global_id is 4503 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.689+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69f0003610 con 0x7f6a00159e40 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.689+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1966426401 0 0) 0x7f9c4c160600 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.689+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c4c1fee00 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9c40003130 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f9c39ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f9c39ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f9c39ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f9c39ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889329353 0 0) 0x7f6a00163ed0 con 0x7f6a00058070 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f6a055c0640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f6a055c0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f6a055c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.690+0000 7f6a055c0640 10 monclient(hunting): my global_id is 4517 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a00163930 con 0x7f6a00058070 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3850199175 0 0) 0x7fe8dc163e90 con 0x7fe8dc0ba350 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fe8d37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fe8d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fe8d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fe8d37fe640 10 monclient(hunting): my global_id is 4520 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8c8003610 con 0x7fe8dc0ba350 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3572124352 0 0) 0x7fa324002c90 con 0x7fa3340b9f80 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fa323fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fa323fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fa323fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fa323fff640 10 monclient(hunting): my global_id is 4506 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.691+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa334163e90 con 0x7fa3340b9f80 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972881725 0 0) 0x7f2d3c0b5e40 con 0x7f2d3c15e280 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f2d2bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f2d2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f2d2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f2d2bfff640 10 monclient(hunting): my global_id is 4529 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d24003610 con 0x7f2d3c15e280 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694104092 0 0) 0x7fdce4144f90 con 0x7fdce40b7110 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7fdcbf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7fdcbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7fdcbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7fdcbf7fe640 10 monclient(hunting): my global_id is 4523 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcb0003610 con 0x7fdce40b7110 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1671605023 0 0) 0x7f40481544b0 con 0x7f40480b0ca0 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 >> v1:10.20.193.114:6789/0 conn(0x7f404815d0c0 legacy=0x7f4048119d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 >> v1:10.20.193.45:6789/0 conn(0x7f40480b28b0 legacy=0x7f40481440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 1 monclient: found mon.c 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4048154d50 con 0x7f40480b0ca0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f4035ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f404f4cd640 5 monclient: authenticate success, global_id 4496 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f404f4cd640 10 monclient: _renew_subs 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f404f4cd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.692+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4048155030 con 0x7f40480b0ca0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f404f4cd640 10 client.4496.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f404f4cd640 10 monclient: _renew_subs 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f404f4cd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f404811a410 con 0x7f40480b0ca0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f404f4cd640 1 librados: init done 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f404f4cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f404f4cd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f404f4cd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986463589 0 0) 0x7fc3e4058480 con 0x7fc3e41566e0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fc3e1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fc3e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fc3e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fc3e1ffb640 10 monclient(hunting): my global_id is 4509 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e40b0f90 con 0x7fc3e41566e0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f404805b510 con 0x7f40480b0ca0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2881964707 0 0) 0x7f0a80003610 con 0x7f0ab00ba350 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ab00b3570 con 0x7f0ab00ba350 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f0aac003420 con 0x7f0ab00ba350 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f0a9dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f0a9dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f0a9dffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7f0a9dffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37594804 0 0) 0x7fefa4163ed0 con 0x7fefa4159e40 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fefa27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fefa27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fefa27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fefa27fc640 10 monclient(hunting): my global_id is 4511 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.693+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa4163bf0 con 0x7fefa4159e40 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181721264 0 0) 0x7fefa4163930 con 0x7fefa4058070 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fefa27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fefa27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fefa27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fefa27fc640 10 monclient(hunting): my global_id is 4515 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa4163ed0 con 0x7fefa4058070 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1511272266 0 0) 0x7fa31c003610 con 0x7fa3340585e0 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 >> v1:10.20.193.114:6789/0 conn(0x7fa3340ba350 legacy=0x7fa334057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 >> v1:10.20.193.45:6789/0 conn(0x7fa3340b9f80 legacy=0x7fa334163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3340573f0 con 0x7fa3340585e0 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa330002df0 con 0x7fa3340585e0 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa33b89d640 5 monclient: authenticate success, global_id 4514 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2855921870 0 0) 0x7fdce41592a0 con 0x7fdce40ba300 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fdcbf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fdcbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa33b89d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fdcbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fdcbf7fe640 10 monclient(hunting): my global_id is 4521 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce4144f90 con 0x7fdce40ba300 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa323fff640 10 monclient: dump: 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fa33b89d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3451115061 0 0) 0x7fe8d8002c90 con 0x7fe8dc0585e0 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fe8d37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fe8d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fe8d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3548957578 0 0) 0x7f9c4c160320 con 0x7f9c4c0ba350 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c4c160600 con 0x7f9c4c0ba350 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9c480036d0 con 0x7f9c4c0ba350 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fe8d37fe640 10 monclient(hunting): my global_id is 4518 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7f9c39ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7f9c39ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7f9c39ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.694+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8dc163e90 con 0x7fe8dc0585e0 2026-02-24T19:17:53.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.695+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1836707858 0 0) 0x7f2d3c0b5880 con 0x7f2d3c0ba3b0 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.695+0000 7f2d2bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.695+0000 7f2d2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.695+0000 7f2d2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.695+0000 7f2d2bfff640 10 monclient(hunting): my global_id is 4527 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.695+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d3c0b5e40 con 0x7f2d3c0ba3b0 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.696+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139428206 0 0) 0x7f0ab00b3290 con 0x7f0ab00b9f80 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.696+0000 7f0a9dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.696+0000 7f0a9dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.696+0000 7f0a9dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.696+0000 7f0a9dffb640 10 monclient(hunting): my global_id is 4512 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.696+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a80003610 con 0x7f0ab00b9f80 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738503271 0 0) 0x7f3b04002910 con 0x7f3b100b9f80 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f3b0dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f3b0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f3b0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f3b0dffb640 10 monclient(hunting): my global_id is 4524 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b10163bb0 con 0x7f3b100b9f80 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910643269 0 0) 0x7f715c002910 con 0x7f71740ba350 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f716b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f716b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f716b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f716b7fe640 10 monclient(hunting): my global_id is 4530 2026-02-24T19:17:53.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.697+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7160003610 con 0x7f71740ba350 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.702+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2854115624 0 0) 0x7f9c4c1fee00 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 >> v1:10.20.193.179:6789/0 conn(0x7f9c4c0ba350 legacy=0x7f9c4c164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 >> v1:10.20.193.114:6789/0 conn(0x7f9c4c0585e0 legacy=0x7f9c4c15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 1 monclient: found mon.a 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c1608e0 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c39ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 5 monclient: authenticate success, global_id 4500 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 10 monclient: _renew_subs 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4c160bc0 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 10 client.4500.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 10 monclient: _renew_subs 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c4c1ff110 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 1 librados: init done 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.703+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4c0b96f0 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.705+0000 7f4cdd387640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f4cd8161b70 0x7f4cd80af080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44196/0 (socket says 10.20.193.45:44196) 2026-02-24T19:17:53.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.705+0000 7f4cdd387640 1 -- 10.20.193.45:0/1298789433 learned_addr learned my addr 10.20.193.45:0/1298789433 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2947316583 0 0) 0x7fc3e40b0f90 con 0x7fc3e41566e0 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 >> v1:10.20.193.179:6789/0 conn(0x7fc3e4156ab0 legacy=0x7fc3e4055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 >> v1:10.20.193.114:6789/0 conn(0x7fc3e4160c00 legacy=0x7fc3e4057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e40b1270 con 0x7fc3e41566e0 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3d8002dd0 con 0x7fc3e41566e0 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e95c8640 5 monclient: authenticate success, global_id 4509 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e95c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e1ffb640 10 monclient: dump: 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.708+0000 7fc3e95c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 819983532 0 0) 0x7fefa4163ed0 con 0x7fefa4058070 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 >> v1:10.20.193.179:6789/0 conn(0x7fefa4159e40 legacy=0x7fefa4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 >> v1:10.20.193.114:6789/0 conn(0x7fefa4159a70 legacy=0x7fefa40b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa4057590 con 0x7fefa4058070 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef98003150 con 0x7fefa4058070 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefa27fc640 10 monclient: dump: 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefaa05b640 5 monclient: authenticate success, global_id 4515 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.711+0000 7fefaa05b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1535214350 0 0) 0x7f0a80003610 con 0x7f0ab00b9f80 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ab00b3290 con 0x7f0ab00b9f80 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f0aa40030d0 con 0x7f0ab00b9f80 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f0a9dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f0a9dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f0a9dffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.720 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f6ba45c3640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f6ba45c3640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f6ba45c3640 10 monclient: monmap: 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.713485+0000 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.713485+0000 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7efccec13640 10 monclient: get_monmap_and_config 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7efccec13640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7efccec13640 10 monclient: monmap: 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:53.713527+0000 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:53.713527+0000 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f6ba45c3640 1 Processor -- start 2026-02-24T19:17:53.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f6ba45c3640 1 -- start start 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.713+0000 7f6ba45c3640 10 monclient: init 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.714+0000 7efccec13640 1 Processor -- start 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.714+0000 7efccec13640 1 -- start start 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.714+0000 7efccec13640 10 monclient: init 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.714+0000 7f6ba45c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.714+0000 7f6ba45c3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.714+0000 7f6ba45c3640 10 monclient(hunting): picked mon.noname-b con 0x7f6b9c0b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.714+0000 7f6ba45c3640 10 monclient(hunting): picked mon.noname-c con 0x7f6b9c0ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.714+0000 7f6ba45c3640 10 monclient(hunting): picked mon.noname-a con 0x7f6b9c0585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.714+0000 7f6ba45c3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c163930 con 0x7f6b9c0585e0 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7f6ba45c3640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c163bb0 con 0x7f6b9c0b9f80 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7f6ba45c3640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c163e90 con 0x7f6b9c0ba350 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7f6ba45c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7f6ba45c3640 10 monclient(hunting): authenticate will time out at 3645.353125s 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 10 monclient(hunting): picked mon.noname-c con 0x7efcc8155b20 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 10 monclient(hunting): picked mon.noname-a con 0x7efcc8056c70 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 10 monclient(hunting): picked mon.noname-b con 0x7efcc8162f10 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc80b18f0 con 0x7efcc8056c70 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc80b1bd0 con 0x7efcc8162f10 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc80b1eb0 con 0x7efcc8155b20 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7efccec13640 10 monclient(hunting): authenticate will time out at 3645.353413s 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 959869900 0 0) 0x7fe8dc163e90 con 0x7fe8dc0585e0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 >> v1:10.20.193.179:6789/0 conn(0x7fe8dc0ba350 legacy=0x7fe8dc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 >> v1:10.20.193.114:6789/0 conn(0x7fe8dc0b9f80 legacy=0x7fe8dc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc0573f0 con 0x7fe8dc0585e0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.715+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8d8003340 con 0x7fe8dc0585e0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7fe8d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7fe8d37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7fe8d37fe640 10 monclient: dump: 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.723 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7fe8e2ba2640 5 monclient: authenticate success, global_id 4518 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7fe8e2ba2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1394983953 0 0) 0x7f69f0003610 con 0x7f6a00159e40 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 >> v1:10.20.193.179:6789/0 conn(0x7f6a00058070 legacy=0x7f6a00058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 >> v1:10.20.193.114:6789/0 conn(0x7f6a00159a70 legacy=0x7f6a000b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a00057590 con 0x7f6a00159e40 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f69ec002df0 con 0x7f6a00159e40 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a055c0640 10 monclient: dump: 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a0884d640 5 monclient: authenticate success, global_id 4503 2026-02-24T19:17:53.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.716+0000 7f6a0884d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.775+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192619303 0 0) 0x7f7174163bb0 con 0x7f71740b9f80 2026-02-24T19:17:53.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.775+0000 7f716b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.775+0000 7f716b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.775+0000 7f716b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.775+0000 7f716b7fe640 10 monclient(hunting): my global_id is 4513 2026-02-24T19:17:53.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.775+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f715c002910 con 0x7f71740b9f80 2026-02-24T19:17:53.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.782+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720158944 0 0) 0x7fdce4159580 con 0x7fdce40b9f30 2026-02-24T19:17:53.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.782+0000 7fdcbf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.782+0000 7fdcbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.782+0000 7fdcbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.782+0000 7fdcbf7fe640 10 monclient(hunting): my global_id is 4516 2026-02-24T19:17:53.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.782+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce41592a0 con 0x7fdce40b9f30 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 902581848 0 0) 0x7f715c002910 con 0x7f71740b9f80 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 >> v1:10.20.193.179:6789/0 conn(0x7f71740585e0 legacy=0x7f7174166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 >> v1:10.20.193.45:6789/0 conn(0x7f71740ba350 legacy=0x7f7174057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71740573f0 con 0x7f71740b9f80 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f717ae93640 5 monclient: authenticate success, global_id 4513 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f717ae93640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7164002df0 con 0x7f71740b9f80 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f716b7fe640 10 monclient: dump: 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.788 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.789 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.789 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.789 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.789 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.789 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.786+0000 7f717ae93640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcfe80034f0 con 0x7fd000159a70 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7fcff57fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fcfe8003b50 con 0x7fd000159a70 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7fcff57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7fcff57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7fcff57fa640 10 monclient: dump: 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7fcff6ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3360394660 0 0) 0x7f3b10163e90 con 0x7f3b100ba350 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7f3b0dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7f3b0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7f3b0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7f3b0dffb640 10 monclient(hunting): my global_id is 4526 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.791+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b04002910 con 0x7f3b100ba350 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.792+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fcfe8003d30 con 0x7fd000159a70 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.792+0000 7fd004b26640 10 monclient: get_auth_request con 0x7fcfd0077d90 auth_method 0 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.792+0000 7fcff57fa640 10 client.4489.objecter ms_handle_connect 0x7fcfd0077d90 2026-02-24T19:17:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.793+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fcfe8093460 con 0x7fd000159a70 2026-02-24T19:17:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.793+0000 7fcff57fa640 10 client.4489.objecter ms_dispatch2 0x7fd000000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.793+0000 7fcff57fa640 3 client.4489.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.793+0000 7fcff57fa640 3 client.4489.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.793+0000 7fcff57fa640 20 client.4489.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.794+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fcfe805de90 con 0x7fd000159a70 2026-02-24T19:17:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.794+0000 7fcff57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.794+0000 7fcff57fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:53.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.795+0000 7f6ba2338640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f6b9c0b9f80 0x7f6b9c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49130/0 (socket says 10.20.193.45:49130) 2026-02-24T19:17:53.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.795+0000 7f6ba2338640 1 -- 10.20.193.45:0/4222453519 learned_addr learned my addr 10.20.193.45:0/4222453519 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2652442617 0 0) 0x7f2d24003610 con 0x7f2d3c15e280 2026-02-24T19:17:53.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 >> v1:10.20.193.114:6789/0 conn(0x7f2d3c15deb0 legacy=0x7f2d3c0b9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 >> v1:10.20.193.45:6789/0 conn(0x7f2d3c0ba3b0 legacy=0x7f2d3c0ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 1 monclient: found mon.noname-c 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c0b6120 con 0x7f2d3c15e280 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2d30002df0 con 0x7f2d3c15e280 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d2bfff640 10 monclient: dump: 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.799 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.800 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d43695640 5 monclient: authenticate success, global_id 4529 2026-02-24T19:17:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.796+0000 7f2d43695640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2788678643 0 0) 0x7f0ab00b3850 con 0x7f0ab00585e0 2026-02-24T19:17:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2642623453 0 0) 0x7fdcb0003610 con 0x7fdce40b7110 2026-02-24T19:17:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a80003610 con 0x7f0ab00585e0 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f0aa00031f0 con 0x7f0ab00585e0 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7f0a9dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7f0a9dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7f0a9dffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdce4159580 con 0x7fdce40b7110 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdcd0003090 con 0x7fdce40b7110 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7fdcbf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7fdcbf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7fdcbf7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.797+0000 7fdcbf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.798+0000 7efccd189640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7efcc8162f10 0x7efcc80b52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49142/0 (socket says 10.20.193.45:49142) 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.798+0000 7efccd189640 1 -- 10.20.193.45:0/1183405104 learned_addr learned my addr 10.20.193.45:0/1183405104 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 590939080 0 0) 0x7f3afc003610 con 0x7f3b100585e0 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 >> v1:10.20.193.179:6789/0 conn(0x7f3b100ba350 legacy=0x7f3b10057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 >> v1:10.20.193.45:6789/0 conn(0x7f3b100b9f80 legacy=0x7f3b10163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b100573f0 con 0x7f3b100585e0 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3b00003170 con 0x7f3b100585e0 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b0dffb640 10 monclient: dump: 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b157f5640 5 monclient: authenticate success, global_id 4504 2026-02-24T19:17:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.799+0000 7f3b157f5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.801+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4038003420 con 0x7f40480b0ca0 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.801+0000 7f4035ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.801+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4038004a70 con 0x7f40480b0ca0 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.801+0000 7f4035ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.801+0000 7f4035ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.801+0000 7f4035ffb640 10 monclient: dump: 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.805 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.801+0000 7f40377fe640 4 set_mon_vals no callback set 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.802+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f4038004c50 con 0x7f40480b0ca0 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.802+0000 7f404ca41640 10 monclient: get_auth_request con 0x7f4018077d00 auth_method 0 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.802+0000 7f4035ffb640 10 client.4496.objecter ms_handle_connect 0x7f4018077d00 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f40380931f0 con 0x7f40480b0ca0 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4035ffb640 10 client.4496.objecter ms_dispatch2 0x7f4048000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4035ffb640 3 client.4496.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4035ffb640 3 client.4496.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4035ffb640 20 client.4496.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4cdcb86640 1 -- 10.20.193.45:0/1298789433 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206649325 0 0) 0x7f4cd8167d80 con 0x7f4cd81617a0 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4cdcb86640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4cdcb86640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4cdcb86640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4cdcb86640 10 monclient(hunting): my global_id is 4522 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.804+0000 7f4cdcb86640 1 -- 10.20.193.45:0/1298789433 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cc0003610 con 0x7f4cd81617a0 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3766757947 0 0) 0x7fdce41592a0 con 0x7fdce40b9f30 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcb0003610 con 0x7fdce40b9f30 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdcd8003390 con 0x7fdce40b9f30 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7fdcbf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7fdcbf7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7fdcbf7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2184600692 0 0) 0x7f0a80003610 con 0x7f0ab00585e0 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 >> v1:10.20.193.179:6789/0 conn(0x7f0ab00ba350 legacy=0x7f0ab0263c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 >> v1:10.20.193.45:6789/0 conn(0x7f0ab00b9f80 legacy=0x7f0ab01ff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 1 monclient: found mon.b 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab00b3b30 con 0x7f0ab00585e0 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0a9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0ab7a67640 5 monclient: authenticate success, global_id 4498 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0ab7a67640 10 monclient: _renew_subs 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0ab7a67640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab00b3e10 con 0x7f0ab00585e0 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0ab7a67640 10 client.4498.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0ab7a67640 10 monclient: _renew_subs 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0ab7a67640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ab013aa20 con 0x7f0ab00585e0 2026-02-24T19:17:53.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f0ab7a67640 1 librados: init done 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688283435 0 0) 0x7f6b9c163bb0 con 0x7f6b9c0b9f80 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f6ba1336640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f6ba1336640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f6ba1336640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f6ba1336640 10 monclient(hunting): my global_id is 4525 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.805+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b84003610 con 0x7f6b9c0b9f80 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f0ab7a67640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f0ab7a67640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f0ab7a67640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab0157560 con 0x7f0ab00585e0 2026-02-24T19:17:53.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f404805b510 con 0x7f40480b0ca0 2026-02-24T19:17:53.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f4035ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f4035ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:53.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7164003000 con 0x7f71740b9f80 2026-02-24T19:17:53.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f716b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f716b7fe640 1 -- 10.20.193.45:0/3505897597 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7164003440 con 0x7f71740b9f80 2026-02-24T19:17:53.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f716b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f716b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f716b7fe640 10 monclient: dump: 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f717ae93640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.806+0000 7f717ae93640 4 set_mon_vals no callback set 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962349798 0 0) 0x7efcc80b1bd0 con 0x7efcc8162f10 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7efcbf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7efcbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7efcbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7efcbf7fe640 10 monclient(hunting): my global_id is 4528 2026-02-24T19:17:53.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb4003610 con 0x7efcc8162f10 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7f717ae93640 10 monclient: shutdown 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7f717ae93640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7f717ae93640 1 -- 10.20.193.45:0/3505897597 >> v1:10.20.193.114:6789/0 conn(0x7f71740b9f80 legacy=0x7f7174163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7f717ae93640 1 -- 10.20.193.45:0/3505897597 shutdown_connections 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7f717ae93640 1 -- 10.20.193.45:0/3505897597 >> 10.20.193.45:0/3505897597 conn(0x7f71740b7990 msgr2=0x7f71740b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7f717ae93640 1 -- 10.20.193.45:0/3505897597 shutdown_connections 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.807+0000 7f717ae93640 1 -- 10.20.193.45:0/3505897597 wait complete. 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 10 monclient: monmap: 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.814 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 1 librados: starting msgr at 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 1 librados: starting objecter 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 1 Processor -- start 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 1 -- start start 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 1 librados: setting wanted keys 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 1 librados: calling monclient init 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.808+0000 7f717ae93640 10 monclient: init 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 10 monclient(hunting): picked mon.noname-a con 0x7f71740585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 10 monclient(hunting): picked mon.noname-c con 0x7f71740b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 10 monclient(hunting): picked mon.noname-b con 0x7f71740ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7174156bc0 con 0x7f71740585e0 2026-02-24T19:17:53.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71741ff450 con 0x7f71740ba350 2026-02-24T19:17:53.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71741fb140 con 0x7f71740b9f80 2026-02-24T19:17:53.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.809+0000 7f717ae93640 10 monclient(hunting): authenticate will time out at 3645.447203s 2026-02-24T19:17:53.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b00003340 con 0x7f3b100585e0 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b0dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b0dffb640 1 -- 10.20.193.45:0/1626581695 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3b00003780 con 0x7f3b100585e0 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b0dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b0dffb640 10 monclient: dump: 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b157f5640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b157f5640 4 set_mon_vals no callback set 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b157f5640 10 monclient: shutdown 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b157f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.811+0000 7f3b157f5640 1 -- 10.20.193.45:0/1626581695 >> v1:10.20.193.114:6789/0 conn(0x7f3b100585e0 legacy=0x7f3b10166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 1 -- 10.20.193.45:0/1626581695 shutdown_connections 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 1 -- 10.20.193.45:0/1626581695 >> 10.20.193.45:0/1626581695 conn(0x7f3b100b7990 msgr2=0x7f3b100b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 1 -- 10.20.193.45:0/1626581695 shutdown_connections 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 1 -- 10.20.193.45:0/1626581695 wait complete. 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 10 monclient: monmap: 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.818 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 1 -- 10.20.193.45:0/1298789433 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 917414319 0 0) 0x7f4cc0003610 con 0x7f4cd81617a0 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 1 -- 10.20.193.45:0/1298789433 >> v1:10.20.193.179:6789/0 conn(0x7f4cd80b5de0 legacy=0x7f4cd80b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 1 -- 10.20.193.45:0/1298789433 >> v1:10.20.193.45:6789/0 conn(0x7f4cd8161b70 legacy=0x7f4cd80af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 1 -- 10.20.193.45:0/1298789433 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd8168340 con 0x7f4cd81617a0 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 1 -- 10.20.193.45:0/1298789433 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4cc8002df0 con 0x7f4cd81617a0 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdcb86640 10 monclient: dump: 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.819 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.820 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.820 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.820 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdfe13640 5 monclient: authenticate success, global_id 4522 2026-02-24T19:17:53.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f4cdfe13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 1 librados: starting msgr at 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 1 librados: starting objecter 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.812+0000 7f3b157f5640 1 Processor -- start 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 1 -- start start 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 1 librados: setting wanted keys 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 1 librados: calling monclient init 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 10 monclient: init 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 10 monclient(hunting): picked mon.noname-c con 0x7f3b100585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 10 monclient(hunting): picked mon.noname-b con 0x7f3b100b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 10 monclient(hunting): picked mon.noname-a con 0x7f3b100ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b101fef50 con 0x7f3b100ba350 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b101605d0 con 0x7f3b100b9f80 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b101608b0 con 0x7f3b100585e0 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.813+0000 7f3b157f5640 10 monclient(hunting): authenticate will time out at 3645.451536s 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.816+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa330003000 con 0x7fa3340585e0 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.816+0000 7fa323fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.816+0000 7fa323fff640 1 -- 10.20.193.45:0/3940832878 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa330003440 con 0x7fa3340585e0 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.816+0000 7fa323fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.816+0000 7fa323fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.816+0000 7fa323fff640 10 monclient: dump: 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.816+0000 7fa33b89d640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.816+0000 7fa33b89d640 4 set_mon_vals no callback set 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.817+0000 7fa33b89d640 10 monclient: shutdown 2026-02-24T19:17:53.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.817+0000 7fa33b89d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.817+0000 7fa33b89d640 1 -- 10.20.193.45:0/3940832878 >> v1:10.20.193.179:6789/0 conn(0x7fa3340585e0 legacy=0x7fa334166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.817+0000 7fa33b89d640 1 -- 10.20.193.45:0/3940832878 shutdown_connections 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.817+0000 7fa33b89d640 1 -- 10.20.193.45:0/3940832878 >> 10.20.193.45:0/3940832878 conn(0x7fa3340b7990 msgr2=0x7fa3340b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.817+0000 7fa33b89d640 1 -- 10.20.193.45:0/3940832878 shutdown_connections 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.817+0000 7fa33b89d640 1 -- 10.20.193.45:0/3940832878 wait complete. 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient: monmap: 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.823 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3724395712 0 0) 0x7fdce4159580 con 0x7fdce40b7110 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 >> v1:10.20.193.114:6789/0 conn(0x7fdce40b9f30 legacy=0x7fdce416a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 >> v1:10.20.193.45:6789/0 conn(0x7fdce40ba300 legacy=0x7fdce4158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 1 monclient: found mon.c 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce4145270 con 0x7fdce40b7110 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdcbf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 5 monclient: authenticate success, global_id 4523 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 10 monclient: _renew_subs 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdce4145550 con 0x7fdce40b7110 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 10 client.4523.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 10 monclient: _renew_subs 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdce4164c00 con 0x7fdce40b7110 2026-02-24T19:17:53.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 1 librados: init done 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 1 librados: starting msgr at 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 1 librados: starting objecter 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 1 Processor -- start 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 1 -- start start 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 1 librados: setting wanted keys 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 1 librados: calling monclient init 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient: init 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient(hunting): picked mon.noname-a con 0x7fa3340585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient(hunting): picked mon.noname-c con 0x7fa3340b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient(hunting): picked mon.noname-b con 0x7fa3340ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33413a0a0 con 0x7fa3340585e0 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa334139240 con 0x7fa3340ba350 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa334139520 con 0x7fa3340b9f80 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fa33b89d640 10 monclient(hunting): authenticate will time out at 3645.456751s 2026-02-24T19:17:53.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.818+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce4168ea0 con 0x7fdce40b7110 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d30003000 con 0x7f2d3c15e280 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d2bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d2bfff640 1 -- 10.20.193.45:0/2264095183 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2d30003440 con 0x7f2d3c15e280 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d2bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d2bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d2bfff640 10 monclient: dump: 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d43695640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d43695640 4 set_mon_vals no callback set 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d43695640 10 monclient: shutdown 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d43695640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d43695640 1 -- 10.20.193.45:0/2264095183 >> v1:10.20.193.179:6789/0 conn(0x7f2d3c15e280 legacy=0x7f2d3c0ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d43695640 1 -- 10.20.193.45:0/2264095183 shutdown_connections 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d43695640 1 -- 10.20.193.45:0/2264095183 >> 10.20.193.45:0/2264095183 conn(0x7f2d3c0b7990 msgr2=0x7f2d3c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d43695640 1 -- 10.20.193.45:0/2264095183 shutdown_connections 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.820+0000 7f2d43695640 1 -- 10.20.193.45:0/2264095183 wait complete. 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 10 monclient: monmap: 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 1 librados: starting msgr at 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 1 librados: starting objecter 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 1 Processor -- start 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 1 -- start start 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 1 librados: setting wanted keys 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 1 librados: calling monclient init 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.821+0000 7f2d43695640 10 monclient: init 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 10 monclient(hunting): picked mon.noname-c con 0x7f2d3c0ba3b0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 10 monclient(hunting): picked mon.noname-b con 0x7f2d3c15deb0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 10 monclient(hunting): picked mon.noname-a con 0x7f2d3c15e280 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3c0b9250 con 0x7f2d3c15e280 2026-02-24T19:17:53.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3c1497e0 con 0x7f2d3c15deb0 2026-02-24T19:17:53.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d3c149ac0 con 0x7f2d3c0ba3b0 2026-02-24T19:17:53.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.822+0000 7f2d43695640 10 monclient(hunting): authenticate will time out at 3645.460305s 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3d8002fa0 con 0x7fc3e41566e0 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e1ffb640 1 -- 10.20.193.45:0/3001764201 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3d80033e0 con 0x7fc3e41566e0 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e1ffb640 10 monclient: dump: 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e95c8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e95c8640 4 set_mon_vals no callback set 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e95c8640 10 monclient: shutdown 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e95c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3001764201 >> v1:10.20.193.45:6789/0 conn(0x7fc3e41566e0 legacy=0x7fc3e40b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.849+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3001764201 shutdown_connections 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3001764201 >> 10.20.193.45:0/3001764201 conn(0x7fc3e40b2ef0 msgr2=0x7fc3e40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3001764201 shutdown_connections 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3001764201 wait complete. 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 10 monclient: monmap: 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.852 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 1 librados: starting msgr at 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 1 librados: starting objecter 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 1 Processor -- start 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 1 -- start start 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 1 librados: setting wanted keys 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 1 librados: calling monclient init 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.850+0000 7fc3e95c8640 10 monclient: init 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 10 monclient(hunting): picked mon.noname-c con 0x7fc3e41566e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 10 monclient(hunting): picked mon.noname-b con 0x7fc3e4156ab0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 10 monclient(hunting): picked mon.noname-a con 0x7fc3e4160c00 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e4128500 con 0x7fc3e4160c00 2026-02-24T19:17:53.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e40a7b60 con 0x7fc3e4156ab0 2026-02-24T19:17:53.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e40a7e40 con 0x7fc3e41566e0 2026-02-24T19:17:53.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.851+0000 7fc3e95c8640 10 monclient(hunting): authenticate will time out at 3645.489337s 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c40003700 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7f9c39ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9c40003a50 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7f9c39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7f9c39ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7f9c39ffb640 10 monclient: dump: 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7f9c3b7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef98003320 con 0x7fefa4058070 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7fefa27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7fefa27fc640 1 -- 10.20.193.45:0/1398325203 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef98003760 con 0x7fefa4058070 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7fefa27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7fefa27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7fefa27fc640 10 monclient: dump: 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7fefaa05b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.855+0000 7fefaa05b640 4 set_mon_vals no callback set 2026-02-24T19:17:53.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f9c4001c8c0 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7fefaa05b640 10 monclient: shutdown 2026-02-24T19:17:53.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7fefaa05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7fefaa05b640 1 -- 10.20.193.45:0/1398325203 >> v1:10.20.193.45:6789/0 conn(0x7fefa4058070 legacy=0x7fefa4058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7fefaa05b640 1 -- 10.20.193.45:0/1398325203 shutdown_connections 2026-02-24T19:17:53.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7fefaa05b640 1 -- 10.20.193.45:0/1398325203 >> 10.20.193.45:0/1398325203 conn(0x7fefa40b7780 msgr2=0x7fefa40b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7fefaa05b640 1 -- 10.20.193.45:0/1398325203 shutdown_connections 2026-02-24T19:17:53.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7fefaa05b640 1 -- 10.20.193.45:0/1398325203 wait complete. 2026-02-24T19:17:53.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7f9c514f4640 10 monclient: get_auth_request con 0x7f9c1c077d90 auth_method 0 2026-02-24T19:17:53.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7f9c39ffb640 10 client.4500.objecter ms_handle_connect 0x7f9c1c077d90 2026-02-24T19:17:53.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7fefaa05b640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.856+0000 7fefaa05b640 10 monclient: monmap: 2026-02-24T19:17:53.860 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.860 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.860 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.860 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 1 librados: starting msgr at 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 1 librados: starting objecter 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 1 Processor -- start 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 1 -- start start 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 1 librados: setting wanted keys 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 1 librados: calling monclient init 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 10 monclient: init 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 10 monclient(hunting): picked mon.noname-c con 0x7fefa4058070 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 10 monclient(hunting): picked mon.noname-a con 0x7fefa4159a70 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 10 monclient(hunting): picked mon.noname-b con 0x7fefa4159e40 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa4163760 con 0x7fefa4159a70 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa413c9b0 con 0x7fefa4159e40 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa413cc90 con 0x7fefa4058070 2026-02-24T19:17:53.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.857+0000 7fefaa05b640 10 monclient(hunting): authenticate will time out at 3645.495560s 2026-02-24T19:17:53.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.860+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f9c40092140 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.860+0000 7f9c39ffb640 10 client.4500.objecter ms_dispatch2 0x7f9c4c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.860+0000 7f9c39ffb640 3 client.4500.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.860+0000 7f9c39ffb640 3 client.4500.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.860+0000 7f9c39ffb640 20 client.4500.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.860+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9c4005cb70 con 0x7f9c4c0b9f80 2026-02-24T19:17:53.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.860+0000 7f9c39ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.860+0000 7f9c39ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:53.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.865+0000 7f7178c08640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f71740585e0 0x7f71740b4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44224/0 (socket says 10.20.193.45:44224) 2026-02-24T19:17:53.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.865+0000 7f7178c08640 1 -- 10.20.193.45:0/2832821235 learned_addr learned my addr 10.20.193.45:0/2832821235 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.865+0000 7f3b0f7fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f3b100ba350 0x7f3b101619c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44238/0 (socket says 10.20.193.45:44238) 2026-02-24T19:17:53.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.865+0000 7f3b0f7fe640 1 -- 10.20.193.45:0/2466478945 learned_addr learned my addr 10.20.193.45:0/2466478945 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.865+0000 7f71697fa640 10 client.?.objecter ms_handle_connect 0x7f71740585e0 2026-02-24T19:17:53.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.865+0000 7f71697fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.866+0000 7f3aef7fe640 10 client.?.objecter ms_handle_connect 0x7f3b100ba350 2026-02-24T19:17:53.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.866+0000 7f3aef7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.869+0000 7f2d41c0b640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f2d3c15e280 0x7f2d3c1470e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44262/0 (socket says 10.20.193.45:44262) 2026-02-24T19:17:53.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.869+0000 7f2d41c0b640 1 -- 10.20.193.45:0/3644936424 learned_addr learned my addr 10.20.193.45:0/3644936424 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.869+0000 7fa339612640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fa3340585e0 0x7fa3341624a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44252/0 (socket says 10.20.193.45:44252) 2026-02-24T19:17:53.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.869+0000 7fa339612640 1 -- 10.20.193.45:0/3271905109 learned_addr learned my addr 10.20.193.45:0/3271905109 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.871+0000 7fa321ffb640 10 client.?.objecter ms_handle_connect 0x7fa3340585e0 2026-02-24T19:17:53.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.871+0000 7fa321ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.871+0000 7f2d29ffb640 10 client.?.objecter ms_handle_connect 0x7f2d3c15e280 2026-02-24T19:17:53.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.871+0000 7f2d29ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.874+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043645058 0 0) 0x7f6b98002c90 con 0x7f6b9c0585e0 2026-02-24T19:17:53.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.874+0000 7f6ba1336640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.874+0000 7f6ba1336640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.874+0000 7f6ba1336640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.874+0000 7f6ba1336640 10 monclient(hunting): my global_id is 4536 2026-02-24T19:17:53.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.874+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b9c163bb0 con 0x7f6b9c0585e0 2026-02-24T19:17:53.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.875+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658529183 0 0) 0x7f3b101fef50 con 0x7f3b100ba350 2026-02-24T19:17:53.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.875+0000 7f3aef7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.875+0000 7f3aef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.875+0000 7f3aef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.875+0000 7f3aef7fe640 10 monclient(hunting): my global_id is 4545 2026-02-24T19:17:53.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.875+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3adc003610 con 0x7f3b100ba350 2026-02-24T19:17:53.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.883+0000 7fc3e37fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc3e4160c00 0x7fc3e40a7340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44272/0 (socket says 10.20.193.45:44272) 2026-02-24T19:17:53.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.883+0000 7fc3e37fe640 1 -- 10.20.193.45:0/3010439374 learned_addr learned my addr 10.20.193.45:0/3010439374 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8d8003550 con 0x7fe8dc0585e0 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8d37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8d37fe640 1 -- 10.20.193.45:0/176126312 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8d8003a80 con 0x7fe8dc0585e0 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8d37fe640 10 monclient: dump: 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.887 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.888 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.888 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.888 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.888 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8e2ba2640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8e2ba2640 4 set_mon_vals no callback set 2026-02-24T19:17:53.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fc3c37fe640 10 client.?.objecter ms_handle_connect 0x7fc3e4160c00 2026-02-24T19:17:53.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fc3c37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914420004 0 0) 0x7efcc80b18f0 con 0x7efcc8056c70 2026-02-24T19:17:53.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7efcbf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7efcbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7efcbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7efcbf7fe640 10 monclient(hunting): my global_id is 4539 2026-02-24T19:17:53.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc80b1bd0 con 0x7efcc8056c70 2026-02-24T19:17:53.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8e2ba2640 10 monclient: shutdown 2026-02-24T19:17:53.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8e2ba2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/176126312 >> v1:10.20.193.45:6789/0 conn(0x7fe8dc0585e0 legacy=0x7fe8dc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/176126312 shutdown_connections 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/176126312 >> 10.20.193.45:0/176126312 conn(0x7fe8dc0b7990 msgr2=0x7fe8dc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/176126312 shutdown_connections 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.885+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/176126312 wait complete. 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777147824 0 0) 0x7fa33413a0a0 con 0x7fa3340585e0 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fa321ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fa321ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fa321ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fa321ffb640 10 monclient(hunting): my global_id is 4548 2026-02-24T19:17:53.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa304003610 con 0x7fa3340585e0 2026-02-24T19:17:53.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fefa2ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fefa4159a70 0x7fefa40b3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44278/0 (socket says 10.20.193.45:44278) 2026-02-24T19:17:53.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fefa2ffd640 1 -- 10.20.193.45:0/2222730626 learned_addr learned my addr 10.20.193.45:0/2222730626 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 10 monclient: monmap: 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.892 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 1 librados: starting msgr at 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 1 librados: starting objecter 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 1 Processor -- start 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 1 -- start start 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 1 librados: setting wanted keys 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 1 librados: calling monclient init 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.886+0000 7fe8e2ba2640 10 monclient: init 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 10 monclient(hunting): picked mon.noname-a con 0x7fe8dc0585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 10 monclient(hunting): picked mon.noname-c con 0x7fe8dc0b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 10 monclient(hunting): picked mon.noname-b con 0x7fe8dc0ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8dc158b50 con 0x7fe8dc0585e0 2026-02-24T19:17:53.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8dc1faf10 con 0x7fe8dc0ba350 2026-02-24T19:17:53.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8dc1fb1f0 con 0x7fe8dc0b9f80 2026-02-24T19:17:53.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fe8e2ba2640 10 monclient(hunting): authenticate will time out at 3645.525412s 2026-02-24T19:17:53.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fef7ffff640 10 client.?.objecter ms_handle_connect 0x7fefa4159a70 2026-02-24T19:17:53.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7fef7ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4173922571 0 0) 0x7f7174156bc0 con 0x7f71740585e0 2026-02-24T19:17:53.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7f71697fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7f71697fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7f71697fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7f71697fa640 10 monclient(hunting): my global_id is 4542 2026-02-24T19:17:53.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.887+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7144003610 con 0x7f71740585e0 2026-02-24T19:17:53.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69ec003080 con 0x7f6a00159e40 2026-02-24T19:17:53.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a055c0640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a055c0640 1 -- 10.20.193.45:0/228866009 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f69ec0034c0 con 0x7f6a00159e40 2026-02-24T19:17:53.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a055c0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a055c0640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a055c0640 10 monclient: dump: 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a0884d640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a0884d640 4 set_mon_vals no callback set 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a0884d640 10 monclient: shutdown 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a0884d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.888+0000 7f6a0884d640 1 -- 10.20.193.45:0/228866009 >> v1:10.20.193.45:6789/0 conn(0x7f6a00159e40 legacy=0x7f6a00163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 -- 10.20.193.45:0/228866009 shutdown_connections 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 -- 10.20.193.45:0/228866009 >> 10.20.193.45:0/228866009 conn(0x7f6a000b7780 msgr2=0x7f6a000b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 -- 10.20.193.45:0/228866009 shutdown_connections 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 -- 10.20.193.45:0/228866009 wait complete. 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 10 monclient: monmap: 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 librados: starting msgr at 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 librados: starting objecter 2026-02-24T19:17:53.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 Processor -- start 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 -- start start 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 librados: setting wanted keys 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 1 librados: calling monclient init 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.889+0000 7f6a0884d640 10 monclient: init 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 10 monclient(hunting): picked mon.noname-c con 0x7f6a00058070 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 10 monclient(hunting): picked mon.noname-a con 0x7f6a00159a70 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 10 monclient(hunting): picked mon.noname-b con 0x7f6a00159e40 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a00155c70 con 0x7f6a00159a70 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a001fe470 con 0x7f6a00159e40 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a001fe750 con 0x7f6a00058070 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f6a0884d640 10 monclient(hunting): authenticate will time out at 3645.528243s 2026-02-24T19:17:53.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919468814 0 0) 0x7f2d3c0b9250 con 0x7f2d3c15e280 2026-02-24T19:17:53.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f2d29ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f2d29ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f2d29ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f2d29ffb640 10 monclient(hunting): my global_id is 4551 2026-02-24T19:17:53.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.890+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d0c003610 con 0x7f2d3c15e280 2026-02-24T19:17:53.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1421337700 0 0) 0x7efcc80b1bd0 con 0x7efcc8056c70 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 >> v1:10.20.193.179:6789/0 conn(0x7efcc8155b20 legacy=0x7efcc80b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 >> v1:10.20.193.114:6789/0 conn(0x7efcc8162f10 legacy=0x7efcc80b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 1 monclient: found mon.noname-a 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc80b2190 con 0x7efcc8056c70 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7efcb0002df0 con 0x7efcc8056c70 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efcbf7fe640 10 monclient: dump: 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.901 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efccec13640 5 monclient: authenticate success, global_id 4539 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.895+0000 7efccec13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.898+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392396757 0 0) 0x7fc3e4128500 con 0x7fc3e4160c00 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.898+0000 7fc3c37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.898+0000 7fc3c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.898+0000 7fc3c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.898+0000 7fc3c37fe640 10 monclient(hunting): my global_id is 4554 2026-02-24T19:17:53.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.898+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3b0003610 con 0x7fc3e4160c00 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1901001502 0 0) 0x7f6b84003610 con 0x7f6b9c0b9f80 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 >> v1:10.20.193.179:6789/0 conn(0x7f6b9c0ba350 legacy=0x7f6b9c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 >> v1:10.20.193.45:6789/0 conn(0x7f6b9c0585e0 legacy=0x7f6b9c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 1 monclient: found mon.noname-b 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c0573f0 con 0x7f6b9c0b9f80 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6b8c002df0 con 0x7f6b9c0b9f80 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba1336640 10 monclient: dump: 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba45c3640 5 monclient: authenticate success, global_id 4525 2026-02-24T19:17:53.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.900+0000 7f6ba45c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 630908456 0 0) 0x7f7144003610 con 0x7f71740585e0 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7174156bc0 con 0x7f71740585e0 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7164003350 con 0x7f71740585e0 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7f71697fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7f71697fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7f71697fa640 10 monclient(hunting): dump: 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7f71697fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7fe8e0917640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe8dc0585e0 0x7fe8dc166160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44290/0 (socket says 10.20.193.45:44290) 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7fe8e0917640 1 -- 10.20.193.45:0/1987141892 learned_addr learned my addr 10.20.193.45:0/1987141892 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496962090 0 0) 0x7fefa4163760 con 0x7fefa4159a70 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7fef7ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7fef7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7fef7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7fef7ffff640 10 monclient(hunting): my global_id is 4557 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.902+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef74003610 con 0x7fefa4159a70 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.903+0000 7fe8d17fa640 10 client.?.objecter ms_handle_connect 0x7fe8dc0585e0 2026-02-24T19:17:53.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.903+0000 7fe8d17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.906+0000 7fd006db1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:53.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.906+0000 7fd006db1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:53.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.906+0000 7fd006db1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:53.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.906+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd0001393b0 con 0x7fd000159a70 2026-02-24T19:17:53.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.908+0000 7f6a05dc1640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6a00159a70 0x7f6a001fc640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44304/0 (socket says 10.20.193.45:44304) 2026-02-24T19:17:53.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.908+0000 7f6a05dc1640 1 -- 10.20.193.45:0/3681497911 learned_addr learned my addr 10.20.193.45:0/3681497911 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.908+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 692423961 0 0) 0x7f2d0c003610 con 0x7f2d3c15e280 2026-02-24T19:17:53.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.908+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d3c0b9250 con 0x7f2d3c15e280 2026-02-24T19:17:53.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.908+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2d38003470 con 0x7f2d3c15e280 2026-02-24T19:17:53.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.908+0000 7f2d29ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.908+0000 7f2d29ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.908+0000 7f2d29ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.908+0000 7f2d29ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.909+0000 7f69eaffd640 10 client.?.objecter ms_handle_connect 0x7f6a00159a70 2026-02-24T19:17:53.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.909+0000 7f69eaffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.910+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcd00048d0 con 0x7fdce40b7110 2026-02-24T19:17:53.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.910+0000 7fdcbf7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.910+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdcd0004ce0 con 0x7fdce40b7110 2026-02-24T19:17:53.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.910+0000 7fdcbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.910+0000 7fdcbf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.910+0000 7fdcbf7fe640 10 monclient: dump: 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.910+0000 7fdce17fa640 4 set_mon_vals no callback set 2026-02-24T19:17:53.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0aa0003550 con 0x7f0ab00585e0 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f0a9dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f0aa0002ff0 con 0x7f0ab00585e0 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f0a9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f0a9dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f0a9dffb640 10 monclient: dump: 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f0a9f7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:53.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fdcd0004ec0 con 0x7fdce40b7110 2026-02-24T19:17:53.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2387608610 0 0) 0x7f7174156bc0 con 0x7f71740585e0 2026-02-24T19:17:53.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 >> v1:10.20.193.179:6789/0 conn(0x7f71740b9f80 legacy=0x7f71741fc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 >> v1:10.20.193.114:6789/0 conn(0x7f71740ba350 legacy=0x7f7174158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:53.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 1 monclient: found mon.a 2026-02-24T19:17:53.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71741fb420 con 0x7f71740585e0 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f71697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f717ae93640 5 monclient: authenticate success, global_id 4542 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f717ae93640 10 monclient: _renew_subs 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f717ae93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f71741fb700 con 0x7f71740585e0 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f717ae93640 10 client.4542.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f717ae93640 10 monclient: _renew_subs 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f717ae93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f71741fbcc0 con 0x7f71740585e0 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7f717ae93640 1 librados: init done 2026-02-24T19:17:53.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.911+0000 7fdce27fc640 10 monclient: get_auth_request con 0x7fdcb0077d20 auth_method 0 2026-02-24T19:17:53.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f0aa001d9b0 con 0x7f0ab00585e0 2026-02-24T19:17:53.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7fdcbf7fe640 10 client.4523.objecter ms_handle_connect 0x7fdcb0077d20 2026-02-24T19:17:53.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7fc3c37fe640 10 client.?.objecter ms_handle_connect 0x7fc3e4156ab0 2026-02-24T19:17:53.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7fc3c37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f0ab4fdb640 10 monclient: get_auth_request con 0x7f0a80077f70 auth_method 0 2026-02-24T19:17:53.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f0a9dffb640 10 client.4498.objecter ms_handle_connect 0x7f0a80077f70 2026-02-24T19:17:53.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f717ae93640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f717ae93640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f717ae93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71740b6c80 con 0x7f71740585e0 2026-02-24T19:17:53.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1589333395 0 0) 0x7f3adc003610 con 0x7f3b100ba350 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b101fef50 con 0x7f3b100ba350 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3b00003690 con 0x7f3b100ba350 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f3aef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f3aef7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f3aef7fe640 10 monclient(hunting): dump: 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7f3aef7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fdcd0093360 con 0x7fdce40b7110 2026-02-24T19:17:53.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7fdcbf7fe640 10 client.4523.objecter ms_dispatch2 0x7fdce4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7fdcbf7fe640 3 client.4523.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.912+0000 7fdcbf7fe640 3 client.4523.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.913+0000 7fdcbf7fe640 20 client.4523.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f0aa0002ff0 con 0x7f0ab00585e0 2026-02-24T19:17:53.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7f0a9dffb640 10 client.4498.objecter ms_dispatch2 0x7f0ab0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:53.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7f0a9dffb640 3 client.4498.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:53.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7f0a9dffb640 3 client.4498.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3934525902 0 0) 0x7fc3b0003610 con 0x7fc3e4160c00 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3e4128500 con 0x7fc3e4160c00 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3d4003430 con 0x7fc3e4160c00 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fc3c37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fc3c37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fc3c37fe640 10 monclient(hunting): dump: 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fc3c37fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7f0a9dffb640 20 client.4498.objecter dump_active .. 0 homeless 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fdcd005dd90 con 0x7fdce40b7110 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fdcbf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fdcbf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2615606274 0 0) 0x7fa304003610 con 0x7fa3340585e0 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa33413a0a0 con 0x7fa3340585e0 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa324003600 con 0x7fa3340585e0 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fa321ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fa321ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:53.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fa321ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.914+0000 7fa321ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f0aa005db10 con 0x7f0ab00585e0 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f0a9dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:53.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f0a9dffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f4cdcb86640 1 -- 10.20.193.45:0/1298789433 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4cc8003000 con 0x7f4cd81617a0 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f4cdcb86640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f4cdcb86640 1 -- 10.20.193.45:0/1298789433 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4cc8003440 con 0x7f4cd81617a0 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f4cdcb86640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f4cdcb86640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f4cdcb86640 10 monclient: dump: 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f4cdfe13640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.915+0000 7f4cdfe13640 4 set_mon_vals no callback set 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.916+0000 7f2d29ffb640 10 client.?.objecter ms_handle_connect 0x7f2d3c0ba3b0 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.916+0000 7f2d29ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.916+0000 7f4cdfe13640 10 monclient: shutdown 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.916+0000 7f4cdfe13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.916+0000 7f4cdfe13640 1 -- 10.20.193.45:0/1298789433 >> v1:10.20.193.114:6789/0 conn(0x7f4cd81617a0 legacy=0x7f4cd80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.916+0000 7f4cdfe13640 1 -- 10.20.193.45:0/1298789433 shutdown_connections 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.916+0000 7f4cdfe13640 1 -- 10.20.193.45:0/1298789433 >> 10.20.193.45:0/1298789433 conn(0x7f4cd80b8c00 msgr2=0x7f4cd80b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.916+0000 7f4cdfe13640 1 -- 10.20.193.45:0/1298789433 shutdown_connections 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.916+0000 7f4cdfe13640 1 -- 10.20.193.45:0/1298789433 wait complete. 2026-02-24T19:17:53.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f3aef7fe640 10 client.?.objecter ms_handle_connect 0x7f3b100585e0 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f3aef7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 10 monclient: monmap: 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 1 librados: starting msgr at 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 1 librados: starting objecter 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 1 Processor -- start 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 1 -- start start 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 1 librados: setting wanted keys 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 1 librados: calling monclient init 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7f4cdfe13640 10 monclient: init 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7fe8d17fa640 10 client.?.objecter ms_handle_connect 0x7fe8dc0b9f80 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.917+0000 7fe8d17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 10 monclient(hunting): picked mon.noname-c con 0x7f4cd80b5de0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 10 monclient(hunting): picked mon.noname-a con 0x7f4cd81617a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f404f4cd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:53.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 10 monclient(hunting): picked mon.noname-b con 0x7f4cd82039c0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f404f4cd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:53.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f404f4cd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:53.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f404805e210 con 0x7f40480b0ca0 2026-02-24T19:17:53.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd80b24a0 con 0x7f4cd81617a0 2026-02-24T19:17:53.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd80b2780 con 0x7f4cd82039c0 2026-02-24T19:17:53.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd80b2a60 con 0x7f4cd80b5de0 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.918+0000 7f4cdfe13640 10 monclient(hunting): authenticate will time out at 3645.556153s 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.920+0000 7f69eaffd640 10 client.?.objecter ms_handle_connect 0x7f6a00159e40 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.920+0000 7f69eaffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.920+0000 7f2d29ffb640 10 client.?.objecter ms_handle_connect 0x7f2d3c15deb0 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.920+0000 7f2d29ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7f3aef7fe640 10 client.?.objecter ms_handle_connect 0x7f3b100b9f80 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7f3aef7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056923875 0 0) 0x7f2d3c149ac0 con 0x7f2d3c0ba3b0 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7f2d29ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7f2d29ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7f2d29ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7f2d29ffb640 10 monclient(hunting): my global_id is 4541 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d0c003610 con 0x7f2d3c0ba3b0 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7fa321ffb640 10 client.?.objecter ms_handle_connect 0x7fa3340b9f80 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.921+0000 7fa321ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7fef7ffff640 10 client.?.objecter ms_handle_connect 0x7fefa4058070 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7fef7ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882370968 0 0) 0x7fe8dc1fb1f0 con 0x7fe8dc0b9f80 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7fe8d17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7fe8d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7fe8d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7fe8d17fa640 10 monclient(hunting): my global_id is 4547 2026-02-24T19:17:53.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8ac003610 con 0x7fe8dc0b9f80 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b8c003000 con 0x7f6b9c0b9f80 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7f6ba1336640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7f6ba1336640 1 -- 10.20.193.45:0/4222453519 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6b8c003440 con 0x7f6b9c0b9f80 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7f6ba1336640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7f6ba1336640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7f6ba1336640 10 monclient: dump: 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.931 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7f6ba45c3640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.922+0000 7f6ba45c3640 4 set_mon_vals no callback set 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7f6ba45c3640 10 monclient: shutdown 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7f6ba45c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7f6ba45c3640 1 -- 10.20.193.45:0/4222453519 >> v1:10.20.193.114:6789/0 conn(0x7f6b9c0b9f80 legacy=0x7f6b9c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7f6ba45c3640 1 -- 10.20.193.45:0/4222453519 shutdown_connections 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7f6ba45c3640 1 -- 10.20.193.45:0/4222453519 >> 10.20.193.45:0/4222453519 conn(0x7f6b9c0b7990 msgr2=0x7f6b9c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7f6ba45c3640 1 -- 10.20.193.45:0/4222453519 shutdown_connections 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7f6ba45c3640 1 -- 10.20.193.45:0/4222453519 wait complete. 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7fcff57fa640 1 -- 10.20.193.45:0/3193130503 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 521551722) 0x7fcfe805d790 con 0x7fd000159a70 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7fcff57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7fcff57fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7fa321ffb640 10 client.?.objecter ms_handle_connect 0x7fa3340ba350 2026-02-24T19:17:53.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.923+0000 7fa321ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.933 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-24T19:17:53.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7fe8d17fa640 10 client.?.objecter ms_handle_connect 0x7fe8dc0ba350 2026-02-24T19:17:53.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7fe8d17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 10 monclient: build_initial_monmap 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 10 monclient: monmap: 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 1 librados: starting msgr at 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 1 librados: starting objecter 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 1 Processor -- start 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 1 -- start start 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 1 librados: setting wanted keys 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 1 librados: calling monclient init 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.924+0000 7f6ba45c3640 10 monclient: init 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 10 monclient(hunting): picked mon.noname-c con 0x7f6b9c0585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 10 monclient(hunting): picked mon.noname-b con 0x7f6b9c0b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:53.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 10 monclient(hunting): picked mon.noname-a con 0x7f6b9c0ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0b2e00 con 0x7f6b9c0ba350 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0b30c0 con 0x7f6b9c0b9f80 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0b33a0 con 0x7f6b9c0585e0 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.925+0000 7f6ba45c3640 10 monclient(hunting): authenticate will time out at 3645.563442s 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fef7ffff640 10 client.?.objecter ms_handle_connect 0x7fefa4159e40 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fef7ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 10 librados: watch_flush enter 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 10 librados: watch_flush exit 2026-02-24T19:17:53.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 20 client.4489.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 10 client.4489.objecter successfully canceled tick 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 >> v1:10.20.193.45:6800/1599977652 conn(0x7fcfd0077d90 legacy=0x7fcfd0098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 10 monclient: shutdown 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 >> v1:10.20.193.114:6789/0 conn(0x7fd000159a70 legacy=0x7fd0001fc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 shutdown_connections 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 >> 10.20.193.45:0/3193130503 conn(0x7fd0000b7780 msgr2=0x7fd000161f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 shutdown_connections 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 1 -- 10.20.193.45:0/3193130503 wait complete. 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fd006db1640 1 librados: shutdown 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.926+0000 7fc3c37fe640 10 client.?.objecter ms_handle_connect 0x7fc3e41566e0 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.927+0000 7fc3c37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.927+0000 7f6ba1b37640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f6b9c0b9f80 0x7f6b9c1fcc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49226/0 (socket says 10.20.193.45:49226) 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.927+0000 7f6ba1b37640 1 -- 10.20.193.45:0/1406871453 learned_addr learned my addr 10.20.193.45:0/1406871453 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.928+0000 7f6b82ffd640 10 client.?.objecter ms_handle_connect 0x7f6b9c0b9f80 2026-02-24T19:17:53.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.928+0000 7f6b82ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.929+0000 7f4cde389640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f4cd82039c0 0x7f4cd813d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49210/0 (socket says 10.20.193.45:49210) 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.929+0000 7f4cde389640 1 -- 10.20.193.45:0/2592963914 learned_addr learned my addr 10.20.193.45:0/2592963914 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.929+0000 7f4cc67fc640 10 client.?.objecter ms_handle_connect 0x7f4cd82039c0 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.929+0000 7f4cc67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.929+0000 7f4035ffb640 1 -- 10.20.193.45:0/2278757026 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 1257367751) 0x7f403805dc20 con 0x7f40480b0ca0 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.929+0000 7f4035ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.929+0000 7f4035ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3556309674 0 0) 0x7f2d0c003610 con 0x7f2d3c0ba3b0 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d3c149ac0 con 0x7f2d3c0ba3b0 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2d2c002fc0 con 0x7f2d3c0ba3b0 2026-02-24T19:17:53.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7f2d29ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7f2d29ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7f2d29ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1440842612 0 0) 0x7fe8ac003610 con 0x7fe8dc0b9f80 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8dc1fb1f0 con 0x7fe8dc0b9f80 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8c4002fb0 con 0x7fe8dc0b9f80 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7fe8d17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7fe8d17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7fe8d17fa640 10 monclient(hunting): dump: 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:53.938 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.930+0000 7fe8d17fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.931+0000 7f69eaffd640 10 client.?.objecter ms_handle_connect 0x7f6a00058070 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.931+0000 7f69eaffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934785140 0 0) 0x7f3b101608b0 con 0x7f3b100585e0 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f3aef7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f3aef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f3aef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f3aef7fe640 10 monclient(hunting): my global_id is 4544 2026-02-24T19:17:53.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3adc003610 con 0x7f3b100585e0 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f404f4cd640 10 librados: watch_flush enter 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f404f4cd640 10 librados: watch_flush exit 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f404f4cd640 20 client.4496.objecter shutdown clearing up homeless session... 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f404f4cd640 10 client.4496.objecter successfully canceled tick 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 >> v1:10.20.193.45:6800/1599977652 conn(0x7f4018077d00 legacy=0x7f40180981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f404f4cd640 10 monclient: shutdown 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f404f4cd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.932+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 >> v1:10.20.193.179:6789/0 conn(0x7f40480b0ca0 legacy=0x7f4048134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.933+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 shutdown_connections 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.933+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 >> 10.20.193.45:0/2278757026 conn(0x7f40480b5290 msgr2=0x7f4048157360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.933+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 shutdown_connections 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.933+0000 7f404f4cd640 1 -- 10.20.193.45:0/2278757026 wait complete. 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.933+0000 7f404f4cd640 1 librados: shutdown 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3449449744 0 0) 0x7fa334139520 con 0x7fa3340b9f80 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fa321ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fa321ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fa321ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fa321ffb640 10 monclient(hunting): my global_id is 4550 2026-02-24T19:17:53.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa304003610 con 0x7fa3340b9f80 2026-02-24T19:17:53.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.11 2026-02-24T19:17:53.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145208808 0 0) 0x7fc3e40a7e40 con 0x7fc3e41566e0 2026-02-24T19:17:53.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fc3c37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fc3c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fc3c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fc3c37fe640 10 monclient(hunting): my global_id is 4556 2026-02-24T19:17:53.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.934+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3b0003610 con 0x7fc3e41566e0 2026-02-24T19:17:53.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.935+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3063463155 0 0) 0x7fefa413cc90 con 0x7fefa4058070 2026-02-24T19:17:53.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.935+0000 7fef7ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:53.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.935+0000 7fef7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:53.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.935+0000 7fef7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:53.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.935+0000 7fef7ffff640 10 monclient(hunting): my global_id is 4553 2026-02-24T19:17:53.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.935+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa4163760 con 0x7fefa4058070 2026-02-24T19:17:53.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.936+0000 7f6b82ffd640 10 client.?.objecter ms_handle_connect 0x7f6b9c0585e0 2026-02-24T19:17:53.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.936+0000 7f6b82ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.936+0000 7f4cc67fc640 10 client.?.objecter ms_handle_connect 0x7f4cd80b5de0 2026-02-24T19:17:53.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.936+0000 7f4cc67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:53.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.0 2026-02-24T19:17:53.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.970+0000 7f9c5377f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:53.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.970+0000 7f9c5377f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:53.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.970+0000 7f9c5377f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:53.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:53.970+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9c4c0b9410 con 0x7f9c4c0b9f80 2026-02-24T19:17:54.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.023+0000 7f0ab7a67640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:54.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.023+0000 7f0ab7a67640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:54.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.023+0000 7f0ab7a67640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:54.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.023+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0ab00b64c0 con 0x7f0ab00585e0 2026-02-24T19:17:54.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.025+0000 7f0a9dffb640 1 -- 10.20.193.45:0/3139101406 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 778662779) 0x7f0aa005d410 con 0x7f0ab00585e0 2026-02-24T19:17:54.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.025+0000 7f0a9dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:54.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.025+0000 7f0a9dffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:54.026 INFO:teuthology.orchestra.run.trial045.stdout:90194313219 2026-02-24T19:17:54.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.025+0000 7fdce9404640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:54.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.025+0000 7fdce9404640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:54.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.025+0000 7fdce9404640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:54.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.025+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fdce4168bc0 con 0x7fdce40b7110 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 10 librados: watch_flush enter 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 10 librados: watch_flush exit 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 20 client.4498.objecter shutdown clearing up homeless session... 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 10 client.4498.objecter successfully canceled tick 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 >> v1:10.20.193.45:6800/1599977652 conn(0x7f0a80077f70 legacy=0x7f0a80098420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 10 monclient: shutdown 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 >> v1:10.20.193.114:6789/0 conn(0x7f0ab00585e0 legacy=0x7f0ab013a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 shutdown_connections 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 >> 10.20.193.45:0/3139101406 conn(0x7f0ab00b7990 msgr2=0x7f0ab00b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 shutdown_connections 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 1 -- 10.20.193.45:0/3139101406 wait complete. 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7f0ab7a67640 1 librados: shutdown 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7fdcbf7fe640 1 -- 10.20.193.45:0/3094090899 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 1257367751) 0x7fdcd005d690 con 0x7fdce40b7110 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7fdcbf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.027+0000 7fdcbf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:54.029 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:54.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 10 librados: watch_flush enter 2026-02-24T19:17:54.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 10 librados: watch_flush exit 2026-02-24T19:17:54.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 20 client.4523.objecter shutdown clearing up homeless session... 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 10 client.4523.objecter successfully canceled tick 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 >> v1:10.20.193.45:6800/1599977652 conn(0x7fdcb0077d20 legacy=0x7fdcb00981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 10 monclient: shutdown 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 >> v1:10.20.193.179:6789/0 conn(0x7fdce40b7110 legacy=0x7fdce4145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 shutdown_connections 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 >> 10.20.193.45:0/3094090899 conn(0x7fdce40b7990 msgr2=0x7fdce40b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 shutdown_connections 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 1 -- 10.20.193.45:0/3094090899 wait complete. 2026-02-24T19:17:54.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.030+0000 7fdce9404640 1 librados: shutdown 2026-02-24T19:17:54.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313219 for osd.2 2026-02-24T19:17:54.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.7 2026-02-24T19:17:54.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcb0003000 con 0x7efcc8056c70 2026-02-24T19:17:54.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efcbf7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:54.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efcbf7fe640 1 -- 10.20.193.45:0/1183405104 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7efcb0003400 con 0x7efcc8056c70 2026-02-24T19:17:54.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efcbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efcbf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:54.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efcbf7fe640 10 monclient: dump: 2026-02-24T19:17:54.051 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.051 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efccec13640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:54.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efccec13640 4 set_mon_vals no callback set 2026-02-24T19:17:54.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 176715078 0 0) 0x7f2d3c0b9250 con 0x7f2d3c15e280 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 >> v1:10.20.193.179:6789/0 conn(0x7f2d3c0ba3b0 legacy=0x7f2d3c14ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 >> v1:10.20.193.114:6789/0 conn(0x7f2d3c15deb0 legacy=0x7f2d3c0b8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 1 monclient: found mon.a 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c149da0 con 0x7f2d3c15e280 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d43695640 5 monclient: authenticate success, global_id 4551 2026-02-24T19:17:54.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d43695640 10 monclient: _renew_subs 2026-02-24T19:17:54.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d43695640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c14a080 con 0x7f2d3c15e280 2026-02-24T19:17:54.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d43695640 10 client.4551.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:54.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d43695640 10 monclient: _renew_subs 2026-02-24T19:17:54.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d43695640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2d3c14a640 con 0x7f2d3c15e280 2026-02-24T19:17:54.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7f2d43695640 1 librados: init done 2026-02-24T19:17:54.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 495605421 0 0) 0x7fef74003610 con 0x7fefa4159a70 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefa413cc90 con 0x7fefa4159a70 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef940030f0 con 0x7fefa4159a70 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7fef7ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7fef7ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7fef7ffff640 10 monclient(hunting): dump: 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.056 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.057 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.057 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.057 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7fef7ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:54.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efccec13640 10 monclient: shutdown 2026-02-24T19:17:54.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efccec13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:54.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efccec13640 1 -- 10.20.193.45:0/1183405104 >> v1:10.20.193.45:6789/0 conn(0x7efcc8056c70 legacy=0x7efcc8162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efccec13640 1 -- 10.20.193.45:0/1183405104 shutdown_connections 2026-02-24T19:17:54.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efccec13640 1 -- 10.20.193.45:0/1183405104 >> 10.20.193.45:0/1183405104 conn(0x7efcc80b2ef0 msgr2=0x7efcc80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:54.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efccec13640 1 -- 10.20.193.45:0/1183405104 shutdown_connections 2026-02-24T19:17:54.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.049+0000 7efccec13640 1 -- 10.20.193.45:0/1183405104 wait complete. 2026-02-24T19:17:54.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7f2d43695640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7f2d43695640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7f2d43695640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3c13a7a0 con 0x7f2d3c15e280 2026-02-24T19:17:54.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 10 monclient: build_initial_monmap 2026-02-24T19:17:54.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 10 monclient: monmap: 2026-02-24T19:17:54.061 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:54.061 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:54.061 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:54.061 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:54.061 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:54.061 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 1 librados: starting msgr at 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 1 librados: starting objecter 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 1 Processor -- start 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 1 -- start start 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 1 librados: setting wanted keys 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 1 librados: calling monclient init 2026-02-24T19:17:54.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.050+0000 7efccec13640 10 monclient: init 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 10 monclient(hunting): picked mon.noname-c con 0x7efcc8056c70 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 10 monclient(hunting): picked mon.noname-a con 0x7efcc8155b20 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 10 monclient(hunting): picked mon.noname-b con 0x7efcc8162f10 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc8152fb0 con 0x7efcc8155b20 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc80ab710 con 0x7efcc8162f10 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc80ab9f0 con 0x7efcc8056c70 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccec13640 10 monclient(hunting): authenticate will time out at 3645.689262s 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccc988640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7efcc8056c70 0x7efcc81528a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36234/0 (socket says 10.20.193.45:36234) 2026-02-24T19:17:54.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efccc988640 1 -- 10.20.193.45:0/824539588 learned_addr learned my addr 10.20.193.45:0/824539588 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:54.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efcbd7fa640 10 client.?.objecter ms_handle_connect 0x7efcc8056c70 2026-02-24T19:17:54.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.051+0000 7efcbd7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:54.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.052+0000 7efcbd7fa640 10 client.?.objecter ms_handle_connect 0x7efcc8162f10 2026-02-24T19:17:54.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.052+0000 7efcbd7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:54.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.053+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7164003000 con 0x7f71740585e0 2026-02-24T19:17:54.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.053+0000 7f71697fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:54.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.053+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7164004e80 con 0x7f71740585e0 2026-02-24T19:17:54.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.053+0000 7f71697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.053+0000 7f71697fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:54.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.053+0000 7f716affd640 4 set_mon_vals no callback set 2026-02-24T19:17:54.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.053+0000 7f71697fa640 10 monclient: dump: 2026-02-24T19:17:54.065 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.054+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f716401dcf0 con 0x7f71740585e0 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.054+0000 7f716bfff640 10 monclient: get_auth_request con 0x7f7144077cc0 auth_method 0 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.054+0000 7f71697fa640 10 client.4542.objecter ms_handle_connect 0x7f7144077cc0 2026-02-24T19:17:54.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.057+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f71640933e0 con 0x7f71740585e0 2026-02-24T19:17:54.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.057+0000 7f71697fa640 10 client.4542.objecter ms_dispatch2 0x7f7174000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:54.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.057+0000 7f71697fa640 3 client.4542.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:54.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.057+0000 7f71697fa640 3 client.4542.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:54.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.057+0000 7f71697fa640 20 client.4542.objecter dump_active .. 0 homeless 2026-02-24T19:17:54.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.057+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f716405de10 con 0x7f71740585e0 2026-02-24T19:17:54.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.057+0000 7f71697fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.057+0000 7f71697fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:54.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297346173 0 0) 0x7fe8dc158b50 con 0x7fe8dc0585e0 2026-02-24T19:17:54.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7fe8d17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7fe8d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7fe8d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7fe8d17fa640 10 monclient(hunting): my global_id is 4560 2026-02-24T19:17:54.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8ac003610 con 0x7fe8dc0585e0 2026-02-24T19:17:54.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860590952 0 0) 0x7f6a00155c70 con 0x7f6a00159a70 2026-02-24T19:17:54.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7f69eaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7f69eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7f69eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7f69eaffd640 10 monclient(hunting): my global_id is 4563 2026-02-24T19:17:54.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.062+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69d0003610 con 0x7f6a00159a70 2026-02-24T19:17:54.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2743193777 0 0) 0x7fa33413a0a0 con 0x7fa3340585e0 2026-02-24T19:17:54.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 >> v1:10.20.193.179:6789/0 conn(0x7fa3340b9f80 legacy=0x7fa3341656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 >> v1:10.20.193.114:6789/0 conn(0x7fa3340ba350 legacy=0x7fa33425f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:54.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 1 monclient: found mon.a 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa334139800 con 0x7fa3340585e0 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa321ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa33b89d640 5 monclient: authenticate success, global_id 4548 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa33b89d640 10 monclient: _renew_subs 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa33b89d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa334139ae0 con 0x7fa3340585e0 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa33b89d640 10 client.4548.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:54.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa33b89d640 10 monclient: _renew_subs 2026-02-24T19:17:54.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa33b89d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3341ff0b0 con 0x7fa3340585e0 2026-02-24T19:17:54.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.063+0000 7fa33b89d640 1 librados: init done 2026-02-24T19:17:54.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7fa33b89d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7fa33b89d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7fa33b89d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3341ff340 con 0x7fa3340585e0 2026-02-24T19:17:54.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2947188056 0 0) 0x7f3b101fef50 con 0x7f3b100ba350 2026-02-24T19:17:54.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 >> v1:10.20.193.179:6789/0 conn(0x7f3b100585e0 legacy=0x7f3b1015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 >> v1:10.20.193.114:6789/0 conn(0x7f3b100b9f80 legacy=0x7f3b101fe840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 1 monclient: found mon.a 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b10160b90 con 0x7f3b100ba350 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3aef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3b157f5640 5 monclient: authenticate success, global_id 4545 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3b157f5640 10 monclient: _renew_subs 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3b157f5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b101611c0 con 0x7f3b100ba350 2026-02-24T19:17:54.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3b157f5640 10 client.4545.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:54.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3b157f5640 10 monclient: _renew_subs 2026-02-24T19:17:54.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3b157f5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b101ff340 con 0x7f3b100ba350 2026-02-24T19:17:54.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.064+0000 7f3b157f5640 1 librados: init done 2026-02-24T19:17:54.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.065+0000 7f3b157f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.065+0000 7f3b157f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.065+0000 7f3b157f5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.065+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b10160dd0 con 0x7f3b100ba350 2026-02-24T19:17:54.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4009161898 0 0) 0x7fc3e4128500 con 0x7fc3e4160c00 2026-02-24T19:17:54.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 >> v1:10.20.193.179:6789/0 conn(0x7fc3e41566e0 legacy=0x7fc3e40af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 >> v1:10.20.193.114:6789/0 conn(0x7fc3e4156ab0 legacy=0x7fc3e40a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:54.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 1 monclient: found mon.a 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e40a8120 con 0x7fc3e4160c00 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3e95c8640 5 monclient: authenticate success, global_id 4554 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3e95c8640 10 monclient: _renew_subs 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3e95c8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e40a8400 con 0x7fc3e4160c00 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3e95c8640 10 client.4554.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3e95c8640 10 monclient: _renew_subs 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3e95c8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3e4127ce0 con 0x7fc3e4160c00 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.068+0000 7fc3e95c8640 1 librados: init done 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.069+0000 7fc3e95c8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.069+0000 7fc3e95c8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.069+0000 7fc3e95c8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.069+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e415a520 con 0x7fc3e4160c00 2026-02-24T19:17:54.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.070+0000 7f4cc67fc640 10 client.?.objecter ms_handle_connect 0x7f4cd81617a0 2026-02-24T19:17:54.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.070+0000 7f4cc67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:54.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.073+0000 7f6b82ffd640 10 client.?.objecter ms_handle_connect 0x7f6b9c0ba350 2026-02-24T19:17:54.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.073+0000 7f6b82ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:54.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.166+0000 7f717ae93640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:54.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.166+0000 7f717ae93640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:54.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.166+0000 7f717ae93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.166+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f71740b9170 con 0x7f71740585e0 2026-02-24T19:17:54.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.209+0000 7f9c39ffb640 1 -- 10.20.193.45:0/4052145813 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 778662779) 0x7f9c4005c470 con 0x7f9c4c0b9f80 2026-02-24T19:17:54.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.209+0000 7f9c39ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:54.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.209+0000 7f9c39ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:54.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1657807886 0 0) 0x7fefa413cc90 con 0x7fefa4159a70 2026-02-24T19:17:54.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7efcbd7fa640 10 client.?.objecter ms_handle_connect 0x7efcc8155b20 2026-02-24T19:17:54.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7efcbd7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:54.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 >> v1:10.20.193.179:6789/0 conn(0x7fefa4058070 legacy=0x7fefa4163050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 >> v1:10.20.193.114:6789/0 conn(0x7fefa4159e40 legacy=0x7fefa40b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:54.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 1 monclient: found mon.a 2026-02-24T19:17:54.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:54.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa413cf70 con 0x7fefa4159a70 2026-02-24T19:17:54.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 10 monclient: _finish_auth 0 2026-02-24T19:17:54.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:54.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fef7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:54.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 5 monclient: authenticate success, global_id 4557 2026-02-24T19:17:54.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 10 monclient: _renew_subs 2026-02-24T19:17:54.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fefa413d250 con 0x7fefa4159a70 2026-02-24T19:17:54.214 INFO:teuthology.orchestra.run.trial045.stdout:90194313219 2026-02-24T19:17:54.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 10 client.4557.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:54.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 10 monclient: _renew_subs 2026-02-24T19:17:54.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fefa40b4570 con 0x7fefa4159a70 2026-02-24T19:17:54.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 1 librados: init done 2026-02-24T19:17:54.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.210+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa4038120 con 0x7fefa4159a70 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 10 librados: watch_flush enter 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 10 librados: watch_flush exit 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 20 client.4500.objecter shutdown clearing up homeless session... 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 10 client.4500.objecter successfully canceled tick 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 >> v1:10.20.193.45:6800/1599977652 conn(0x7f9c1c077d90 legacy=0x7f9c1c098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 10 monclient: shutdown 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 >> v1:10.20.193.45:6789/0 conn(0x7f9c4c0b9f80 legacy=0x7f9c4c1fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 shutdown_connections 2026-02-24T19:17:54.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 >> 10.20.193.45:0/4052145813 conn(0x7f9c4c0b7990 msgr2=0x7f9c4c15bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:54.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 shutdown_connections 2026-02-24T19:17:54.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.212+0000 7f9c5377f640 1 -- 10.20.193.45:0/4052145813 wait complete. 2026-02-24T19:17:54.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.213+0000 7f9c5377f640 1 librados: shutdown 2026-02-24T19:17:54.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.4 2026-02-24T19:17:54.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.237+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d38003820 con 0x7f2d3c15e280 2026-02-24T19:17:54.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.237+0000 7f2d29ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:54.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.237+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2d38003ed0 con 0x7f2d3c15e280 2026-02-24T19:17:54.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.237+0000 7f2d29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.237+0000 7f2d29ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.237+0000 7f2d29ffb640 10 monclient: dump: 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.237+0000 7f2d2b7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:54.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.238+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f2d380040b0 con 0x7f2d3c15e280 2026-02-24T19:17:54.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.238+0000 7f2d4140a640 10 monclient: get_auth_request con 0x7f2d0c077c80 auth_method 0 2026-02-24T19:17:54.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.238+0000 7f2d29ffb640 10 client.4551.objecter ms_handle_connect 0x7f2d0c077c80 2026-02-24T19:17:54.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f2d380936e0 con 0x7f2d3c15e280 2026-02-24T19:17:54.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7f2d29ffb640 10 client.4551.objecter ms_dispatch2 0x7f2d3c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:54.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7f2d29ffb640 3 client.4551.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:54.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7f2d29ffb640 3 client.4551.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:54.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7f2d29ffb640 20 client.4551.objecter dump_active .. 0 homeless 2026-02-24T19:17:54.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2d3805e110 con 0x7f2d3c15e280 2026-02-24T19:17:54.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7f2d29ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7f2d29ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:54.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3744146407 0 0) 0x7fe8ac003610 con 0x7fe8dc0585e0 2026-02-24T19:17:54.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8dc158b50 con 0x7fe8dc0585e0 2026-02-24T19:17:54.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8cc003090 con 0x7fe8dc0585e0 2026-02-24T19:17:54.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7fe8d17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:54.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7fe8d17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:54.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.243+0000 7fe8d17fa640 10 monclient(hunting): dump: 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.247 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.244+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2961406549 0 0) 0x7f4cd80b24a0 con 0x7f4cd81617a0 2026-02-24T19:17:54.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.244+0000 7f4cc67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.244+0000 7f4cc67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.244+0000 7f4cc67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.244+0000 7f4cc67fc640 10 monclient(hunting): my global_id is 4566 2026-02-24T19:17:54.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.244+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cac003610 con 0x7f4cd81617a0 2026-02-24T19:17:54.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408297359 0 0) 0x7f6a001fe470 con 0x7f6a00159e40 2026-02-24T19:17:54.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7f69eaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7f69eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7f69eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7f69eaffd640 10 monclient(hunting): my global_id is 4531 2026-02-24T19:17:54.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a00155c70 con 0x7f6a00159e40 2026-02-24T19:17:54.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 903091108 0 0) 0x7efcc8152fb0 con 0x7efcc8155b20 2026-02-24T19:17:54.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7efcbd7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7efcbd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7efcbd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7efcbd7fa640 10 monclient(hunting): my global_id is 4572 2026-02-24T19:17:54.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.250+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc98003610 con 0x7efcc8155b20 2026-02-24T19:17:54.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.252+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899196784 0 0) 0x7f6b9c0b30c0 con 0x7f6b9c0b9f80 2026-02-24T19:17:54.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.252+0000 7f6b82ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.252+0000 7f6b82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.252+0000 7f6b82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.252+0000 7f6b82ffd640 10 monclient(hunting): my global_id is 4537 2026-02-24T19:17:54.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.252+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b6c003610 con 0x7f6b9c0b9f80 2026-02-24T19:17:54.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.253+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358902704 0 0) 0x7f4cd80b2780 con 0x7f4cd82039c0 2026-02-24T19:17:54.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.253+0000 7f4cc67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.253+0000 7f4cc67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.253+0000 7f4cc67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.253+0000 7f4cc67fc640 10 monclient(hunting): my global_id is 4540 2026-02-24T19:17:54.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.253+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd80b24a0 con 0x7f4cd82039c0 2026-02-24T19:17:54.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.255+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68722437 0 0) 0x7fe8dc1faf10 con 0x7fe8dc0ba350 2026-02-24T19:17:54.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.255+0000 7fe8d17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.255+0000 7fe8d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.255+0000 7fe8d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.255+0000 7fe8d17fa640 10 monclient(hunting): my global_id is 4534 2026-02-24T19:17:54.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.255+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8ac003610 con 0x7fe8dc0ba350 2026-02-24T19:17:54.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.256+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099020511 0 0) 0x7efcc80ab710 con 0x7efcc8162f10 2026-02-24T19:17:54.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.256+0000 7efcbd7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.256+0000 7efcbd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.256+0000 7efcbd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.256+0000 7efcbd7fa640 10 monclient(hunting): my global_id is 4543 2026-02-24T19:17:54.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.256+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcc8152fb0 con 0x7efcc8162f10 2026-02-24T19:17:54.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.348+0000 7f2d43695640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:54.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.348+0000 7f2d43695640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:54.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.348+0000 7f2d43695640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.348+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2d3c13a4c0 con 0x7f2d3c15e280 2026-02-24T19:17:54.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2118697758 0 0) 0x7f6b9c0b2e00 con 0x7f6b9c0ba350 2026-02-24T19:17:54.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f6b82ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f6b82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f6b82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f6b82ffd640 10 monclient(hunting): my global_id is 4569 2026-02-24T19:17:54.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b9c0b30c0 con 0x7f6b9c0ba350 2026-02-24T19:17:54.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 932071362 0 0) 0x7f69d0003610 con 0x7f6a00159a70 2026-02-24T19:17:54.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a001fe470 con 0x7f6a00159a70 2026-02-24T19:17:54.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f69ec0033d0 con 0x7f6a00159a70 2026-02-24T19:17:54.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f69eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f69eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f69eaffd640 10 monclient(hunting): dump: 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.753 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.754 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.749+0000 7f69eaffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:54.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.754+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b000032f0 con 0x7f3b100ba350 2026-02-24T19:17:54.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.754+0000 7f3aef7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:54.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.754+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3b000050a0 con 0x7f3b100ba350 2026-02-24T19:17:54.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.754+0000 7f3aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.754+0000 7f3aef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:54.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.754+0000 7f3aef7fe640 10 monclient: dump: 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.754+0000 7f3b0d7fa640 4 set_mon_vals no callback set 2026-02-24T19:17:54.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.755+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f3b0001df10 con 0x7f3b100ba350 2026-02-24T19:17:54.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.755+0000 7f3b0effd640 10 monclient: get_auth_request con 0x7f3adc077d90 auth_method 0 2026-02-24T19:17:54.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.755+0000 7f3aef7fe640 10 client.4545.objecter ms_handle_connect 0x7f3adc077d90 2026-02-24T19:17:54.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.758+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f3b000935c0 con 0x7f3b100ba350 2026-02-24T19:17:54.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.758+0000 7f3aef7fe640 10 client.4545.objecter ms_dispatch2 0x7f3b10000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:54.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.758+0000 7f3aef7fe640 3 client.4545.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:54.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.758+0000 7f3aef7fe640 3 client.4545.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:54.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.758+0000 7f3aef7fe640 20 client.4545.objecter dump_active .. 0 homeless 2026-02-24T19:17:54.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.758+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f3b10160dd0 con 0x7f3b100ba350 2026-02-24T19:17:54.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.758+0000 7f3aef7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.758+0000 7f3aef7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:54.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.762+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3d40037e0 con 0x7fc3e4160c00 2026-02-24T19:17:54.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.762+0000 7fc3c37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.762+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc3d40050a0 con 0x7fc3e4160c00 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.762+0000 7fc3c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.762+0000 7fc3c37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.762+0000 7fc3c37fe640 10 monclient: dump: 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.765 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.766 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.766 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.762+0000 7fc3e17fa640 4 set_mon_vals no callback set 2026-02-24T19:17:54.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.763+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fc3d401df10 con 0x7fc3e4160c00 2026-02-24T19:17:54.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.763+0000 7fc3e2ffd640 10 monclient: get_auth_request con 0x7fc3b0077cb0 auth_method 0 2026-02-24T19:17:54.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.764+0000 7fc3c37fe640 10 client.4554.objecter ms_handle_connect 0x7fc3b0077cb0 2026-02-24T19:17:54.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.776+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3240038b0 con 0x7fa3340585e0 2026-02-24T19:17:54.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.776+0000 7fa321ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:54.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.776+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa324003ed0 con 0x7fa3340585e0 2026-02-24T19:17:54.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.776+0000 7fa321ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.776+0000 7fa321ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:54.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.776+0000 7fa3237fe640 4 set_mon_vals no callback set 2026-02-24T19:17:54.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.776+0000 7fa321ffb640 10 monclient: dump: 2026-02-24T19:17:54.778 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.778 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.779 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.779 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.779 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.779 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.779 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.779 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.779 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.779 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.776+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fa3240040b0 con 0x7fa3340585e0 2026-02-24T19:17:54.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fa338e11640 10 monclient: get_auth_request con 0x7fa304077cb0 auth_method 0 2026-02-24T19:17:54.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fa321ffb640 10 client.4548.objecter ms_handle_connect 0x7fa304077cb0 2026-02-24T19:17:54.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fc3d4093770 con 0x7fc3e4160c00 2026-02-24T19:17:54.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fc3c37fe640 10 client.4554.objecter ms_dispatch2 0x7fc3e4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:54.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fc3c37fe640 3 client.4554.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:54.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fc3c37fe640 3 client.4554.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:54.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fc3c37fe640 20 client.4554.objecter dump_active .. 0 homeless 2026-02-24T19:17:54.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc3d405e1a0 con 0x7fc3e4160c00 2026-02-24T19:17:54.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fc3c37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.777+0000 7fc3c37fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:54.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fa3240937c0 con 0x7fa3340585e0 2026-02-24T19:17:54.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fa321ffb640 10 client.4548.objecter ms_dispatch2 0x7fa334000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:54.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fa321ffb640 3 client.4548.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:54.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fa321ffb640 3 client.4548.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:54.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fa321ffb640 20 client.4548.objecter dump_active .. 0 homeless 2026-02-24T19:17:54.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa334163930 con 0x7fa3340585e0 2026-02-24T19:17:54.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fa321ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fa321ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:54.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 212935652 0 0) 0x7fe8dc158b50 con 0x7fe8dc0585e0 2026-02-24T19:17:54.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 >> v1:10.20.193.179:6789/0 conn(0x7fe8dc0b9f80 legacy=0x7fe8dc158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 >> v1:10.20.193.114:6789/0 conn(0x7fe8dc0ba350 legacy=0x7fe8dc0b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:54.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 1 monclient: found mon.a 2026-02-24T19:17:54.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:54.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc1fb4d0 con 0x7fe8dc0585e0 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8d17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8e2ba2640 5 monclient: authenticate success, global_id 4560 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8e2ba2640 10 monclient: _renew_subs 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8e2ba2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc1fb7b0 con 0x7fe8dc0585e0 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8e2ba2640 10 client.4560.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8e2ba2640 10 monclient: _renew_subs 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8e2ba2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8dc0b2450 con 0x7fe8dc0585e0 2026-02-24T19:17:54.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.783+0000 7fe8e2ba2640 1 librados: init done 2026-02-24T19:17:54.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.784+0000 7fe8e2ba2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.784+0000 7fe8e2ba2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.784+0000 7fe8e2ba2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.784+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc157ef0 con 0x7fe8dc0585e0 2026-02-24T19:17:54.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.787+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef940034c0 con 0x7fefa4159a70 2026-02-24T19:17:54.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.787+0000 7fef7ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:54.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.787+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef94004d20 con 0x7fefa4159a70 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.787+0000 7fef7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.787+0000 7fef7ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.787+0000 7fefa1ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.787+0000 7fef7ffff640 10 monclient: dump: 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.790 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.791 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.791 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.788+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fef9401db90 con 0x7fefa4159a70 2026-02-24T19:17:54.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.788+0000 7fefa37fe640 10 monclient: get_auth_request con 0x7fef74077ca0 auth_method 0 2026-02-24T19:17:54.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.789+0000 7fef7ffff640 10 client.4557.objecter ms_handle_connect 0x7fef74077ca0 2026-02-24T19:17:54.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.794+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fef94093480 con 0x7fefa4159a70 2026-02-24T19:17:54.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.794+0000 7fef7ffff640 10 client.4557.objecter ms_dispatch2 0x7fefa4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:54.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.794+0000 7fef7ffff640 3 client.4557.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:54.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.794+0000 7fef7ffff640 3 client.4557.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:54.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.794+0000 7fef7ffff640 20 client.4557.objecter dump_active .. 0 homeless 2026-02-24T19:17:54.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.794+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fefa4038120 con 0x7fefa4159a70 2026-02-24T19:17:54.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.794+0000 7fef7ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.794+0000 7fef7ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:54.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.800+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1087024061 0 0) 0x7efc98003610 con 0x7efcc8155b20 2026-02-24T19:17:54.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.800+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcc80ab710 con 0x7efcc8155b20 2026-02-24T19:17:54.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.800+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7efcb0003350 con 0x7efcc8155b20 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.800+0000 7efcbd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.800+0000 7efcbd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.800+0000 7efcbd7fa640 10 monclient(hunting): dump: 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.803 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.804 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.800+0000 7efcbd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:54.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.802+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498363639 0 0) 0x7f6a001fe750 con 0x7f6a00058070 2026-02-24T19:17:54.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.802+0000 7f69eaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.802+0000 7f69eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.802+0000 7f69eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.802+0000 7f69eaffd640 10 monclient(hunting): my global_id is 4559 2026-02-24T19:17:54.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.802+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69d0003610 con 0x7f6a00058070 2026-02-24T19:17:54.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.802+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050390096 0 0) 0x7f6b9c0b33a0 con 0x7f6b9c0585e0 2026-02-24T19:17:54.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.803+0000 7f6b82ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.803+0000 7f6b82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.803+0000 7f6b82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.803+0000 7f6b82ffd640 10 monclient(hunting): my global_id is 4562 2026-02-24T19:17:54.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.803+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b9c0b2e00 con 0x7f6b9c0585e0 2026-02-24T19:17:54.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999552813 0 0) 0x7f4cd80b2a60 con 0x7f4cd80b5de0 2026-02-24T19:17:54.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f4cc67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f4cc67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f4cc67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f4cc67fc640 10 monclient(hunting): my global_id is 4565 2026-02-24T19:17:54.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd80b2780 con 0x7f4cd80b5de0 2026-02-24T19:17:54.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930311003 0 0) 0x7efcc80ab9f0 con 0x7efcc8056c70 2026-02-24T19:17:54.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7efcbd7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7efcbd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7efcbd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7efcbd7fa640 10 monclient(hunting): my global_id is 4568 2026-02-24T19:17:54.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc98003610 con 0x7efcc8056c70 2026-02-24T19:17:54.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3292693568 0 0) 0x7f6a001fe470 con 0x7f6a00159a70 2026-02-24T19:17:54.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 >> v1:10.20.193.179:6789/0 conn(0x7f6a00058070 legacy=0x7f6a00155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 >> v1:10.20.193.114:6789/0 conn(0x7f6a00159e40 legacy=0x7f6a00165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 1 monclient: found mon.a 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a001fea30 con 0x7f6a00159a70 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f69eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f6a0884d640 5 monclient: authenticate success, global_id 4563 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f6a0884d640 10 monclient: _renew_subs 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f6a0884d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6a001fed10 con 0x7f6a00159a70 2026-02-24T19:17:54.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f6a0884d640 10 client.4563.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:54.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f6a0884d640 10 monclient: _renew_subs 2026-02-24T19:17:54.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f6a0884d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6a0013aec0 con 0x7f6a00159a70 2026-02-24T19:17:54.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.806+0000 7f6a0884d640 1 librados: init done 2026-02-24T19:17:54.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.807+0000 7f6a0884d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.807+0000 7f6a0884d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.807+0000 7f6a0884d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.807+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a000ba0b0 con 0x7f6a00159a70 2026-02-24T19:17:54.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.876+0000 7f3b157f5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:54.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.876+0000 7f3b157f5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:54.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.876+0000 7f3b157f5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.876+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f3b101572e0 con 0x7f3b100ba350 2026-02-24T19:17:54.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.886+0000 7fc3e95c8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:54.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.886+0000 7fc3e95c8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:54.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.886+0000 7fc3e95c8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.886+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7fc3e415fde0 con 0x7fc3e4160c00 2026-02-24T19:17:54.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.893+0000 7fa33b89d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:17:54.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.893+0000 7fa33b89d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:17:54.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.893+0000 7fa33b89d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.893+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7fa33413a2b0 con 0x7fa3340585e0 2026-02-24T19:17:54.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.902+0000 7fefaa05b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:54.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.902+0000 7fefaa05b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:54.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.902+0000 7fefaa05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:54.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.902+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fefa40b4800 con 0x7fefa4159a70 2026-02-24T19:17:54.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f71697fa640 1 -- 10.20.193.45:0/2832821235 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 1257367751) 0x7f716405d710 con 0x7f71740585e0 2026-02-24T19:17:54.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f71697fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:54.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f71697fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:54.936 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:54.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3544262874 0 0) 0x7f6b9c0b30c0 con 0x7f6b9c0ba350 2026-02-24T19:17:54.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b9c0b33a0 con 0x7f6b9c0ba350 2026-02-24T19:17:54.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6b98003600 con 0x7f6b9c0ba350 2026-02-24T19:17:54.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f6b82ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f6b82ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f6b82ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.938 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.934+0000 7f6b82ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:54.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.935+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 123467056 0 0) 0x7f4cac003610 con 0x7f4cd81617a0 2026-02-24T19:17:54.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.935+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4cd80b2a60 con 0x7f4cd81617a0 2026-02-24T19:17:54.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.935+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4ccc002f00 con 0x7f4cd81617a0 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.935+0000 7f4cc67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.935+0000 7f4cc67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.935+0000 7f4cc67fc640 10 monclient(hunting): dump: 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:54.940 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:54.941 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:54.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.935+0000 7f4cc67fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:54.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 10 librados: watch_flush enter 2026-02-24T19:17:54.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 10 librados: watch_flush exit 2026-02-24T19:17:54.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 20 client.4542.objecter shutdown clearing up homeless session... 2026-02-24T19:17:54.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 10 client.4542.objecter successfully canceled tick 2026-02-24T19:17:54.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 >> v1:10.20.193.45:6800/1599977652 conn(0x7f7144077cc0 legacy=0x7f7144098170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 10 monclient: shutdown 2026-02-24T19:17:54.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:54.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 >> v1:10.20.193.45:6789/0 conn(0x7f71740585e0 legacy=0x7f71740b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 shutdown_connections 2026-02-24T19:17:54.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 >> 10.20.193.45:0/2832821235 conn(0x7f71740b7990 msgr2=0x7f717415bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:54.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 shutdown_connections 2026-02-24T19:17:54.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 1 -- 10.20.193.45:0/2832821235 wait complete. 2026-02-24T19:17:54.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:54.937+0000 7f717ae93640 1 librados: shutdown 2026-02-24T19:17:54.943 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-24T19:17:54.944 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-24T19:17:54.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.6 2026-02-24T19:17:55.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.011+0000 7f8eabb02640 10 monclient: get_monmap_and_config 2026-02-24T19:17:55.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.011+0000 7f8eabb02640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.011+0000 7f8eabb02640 10 monclient: monmap: 2026-02-24T19:17:55.014 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.014 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.014 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:55.012038+0000 2026-02-24T19:17:55.014 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:55.012038+0000 2026-02-24T19:17:55.014 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.014 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.015 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.015 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.015 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.015 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.011+0000 7f5426799640 10 monclient: get_monmap_and_config 2026-02-24T19:17:55.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.011+0000 7f5426799640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 10 monclient: monmap: 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:55.012091+0000 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:55.012091+0000 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 1 Processor -- start 2026-02-24T19:17:55.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f8eabb02640 1 Processor -- start 2026-02-24T19:17:55.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 1 -- start start 2026-02-24T19:17:55.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 10 monclient: init 2026-02-24T19:17:55.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f8eabb02640 1 -- start start 2026-02-24T19:17:55.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f8eabb02640 10 monclient: init 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 10 monclient(hunting): picked mon.noname-b con 0x7f5420157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 10 monclient(hunting): picked mon.noname-a con 0x7f5420157b50 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 10 monclient(hunting): picked mon.noname-c con 0x7f5420164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.012+0000 7f5426799640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542005de70 con 0x7f5420157b50 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f5426799640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5420055b20 con 0x7f5420157780 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f5426799640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5420055e00 con 0x7f5420164d00 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f5426799640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f5426799640 10 monclient(hunting): authenticate will time out at 3646.651018s 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 10 monclient(hunting): picked mon.noname-a con 0x7f8ea40b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 10 monclient(hunting): picked mon.noname-b con 0x7f8ea40ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 10 monclient(hunting): picked mon.noname-c con 0x7f8ea40585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea4163930 con 0x7f8ea40b9f80 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea4163bb0 con 0x7f8ea40ba350 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea4163e90 con 0x7f8ea40585e0 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f8eabb02640 10 monclient(hunting): authenticate will time out at 3646.651293s 2026-02-24T19:17:55.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f541ffff640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f5420157780 0x7f5420056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49242/0 (socket says 10.20.193.45:49242) 2026-02-24T19:17:55.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.013+0000 7f541ffff640 1 -- 10.20.193.45:0/2700282426 learned_addr learned my addr 10.20.193.45:0/2700282426 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.014+0000 7f8eaa078640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f8ea40585e0 0x7f8ea4166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36262/0 (socket says 10.20.193.45:36262) 2026-02-24T19:17:55.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.014+0000 7f8eaa078640 1 -- 10.20.193.45:0/260568625 learned_addr learned my addr 10.20.193.45:0/260568625 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.039 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-24T19:17:55.042 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-24T19:17:55.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.070+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8cc003700 con 0x7fe8dc0585e0 2026-02-24T19:17:55.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.070+0000 7fe8d17fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.070+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe8cc003ad0 con 0x7fe8dc0585e0 2026-02-24T19:17:55.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.070+0000 7fe8d17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.070+0000 7fe8d17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.070+0000 7fe8d17fa640 10 monclient: dump: 2026-02-24T19:17:55.073 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.073 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.073 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.074 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.074 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.074 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.074 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.074 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.074 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.074 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.070+0000 7fe8d2ffd640 4 set_mon_vals no callback set 2026-02-24T19:17:55.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.071+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fe8cc003cb0 con 0x7fe8dc0585e0 2026-02-24T19:17:55.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.072+0000 7fe8d3fff640 10 monclient: get_auth_request con 0x7fe8ac077d60 auth_method 0 2026-02-24T19:17:55.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.072+0000 7fe8d17fa640 10 client.4560.objecter ms_handle_connect 0x7fe8ac077d60 2026-02-24T19:17:55.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.076+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fe8cc0932d0 con 0x7fe8dc0585e0 2026-02-24T19:17:55.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.076+0000 7fe8d17fa640 10 client.4560.objecter ms_dispatch2 0x7fe8dc000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:55.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.076+0000 7fe8d17fa640 3 client.4560.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:55.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.076+0000 7fe8d17fa640 3 client.4560.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:55.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.076+0000 7fe8d17fa640 20 client.4560.objecter dump_active .. 0 homeless 2026-02-24T19:17:55.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.076+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe8cc05dd00 con 0x7fe8dc0585e0 2026-02-24T19:17:55.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.076+0000 7fe8d17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.076+0000 7fe8d17fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:55.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3399200774 0 0) 0x7efcc80ab710 con 0x7efcc8155b20 2026-02-24T19:17:55.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 >> v1:10.20.193.179:6789/0 conn(0x7efcc8056c70 legacy=0x7efcc81528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 >> v1:10.20.193.114:6789/0 conn(0x7efcc8162f10 legacy=0x7efcc805be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 1 monclient: found mon.a 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc80abcd0 con 0x7efcc8155b20 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efcbd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efccec13640 5 monclient: authenticate success, global_id 4572 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efccec13640 10 monclient: _renew_subs 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efccec13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efcc80abfb0 con 0x7efcc8155b20 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efccec13640 10 client.4572.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:55.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efccec13640 10 monclient: _renew_subs 2026-02-24T19:17:55.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efccec13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efcc80a5600 con 0x7efcc8155b20 2026-02-24T19:17:55.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.078+0000 7efccec13640 1 librados: init done 2026-02-24T19:17:55.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.079+0000 7efccec13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.079+0000 7efccec13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.079+0000 7efccec13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.079+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc8059bc0 con 0x7efcc8155b20 2026-02-24T19:17:55.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.082+0000 7f3aef7fe640 1 -- 10.20.193.45:0/2466478945 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 778662779) 0x7f3b0005dff0 con 0x7f3b100ba350 2026-02-24T19:17:55.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.082+0000 7f3aef7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:55.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.082+0000 7f3aef7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.084 INFO:teuthology.orchestra.run.trial045.stdout:90194313219 2026-02-24T19:17:55.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 10 librados: watch_flush enter 2026-02-24T19:17:55.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 10 librados: watch_flush exit 2026-02-24T19:17:55.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 20 client.4545.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 10 client.4545.objecter successfully canceled tick 2026-02-24T19:17:55.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 >> v1:10.20.193.45:6800/1599977652 conn(0x7f3adc077d90 legacy=0x7f3adc098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 10 monclient: shutdown 2026-02-24T19:17:55.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 >> v1:10.20.193.45:6789/0 conn(0x7f3b100ba350 legacy=0x7f3b101619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 shutdown_connections 2026-02-24T19:17:55.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.084+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 >> 10.20.193.45:0/2466478945 conn(0x7f3b100b7990 msgr2=0x7f3b1015acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.085+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 shutdown_connections 2026-02-24T19:17:55.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.085+0000 7f3b157f5640 1 -- 10.20.193.45:0/2466478945 wait complete. 2026-02-24T19:17:55.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.085+0000 7f3b157f5640 1 librados: shutdown 2026-02-24T19:17:55.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.088+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69ec003020 con 0x7f6a00159a70 2026-02-24T19:17:55.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.088+0000 7f69eaffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.088+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f69ec003bc0 con 0x7f6a00159a70 2026-02-24T19:17:55.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.088+0000 7f69eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.088+0000 7f69eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.088+0000 7f69eaffd640 10 monclient: dump: 2026-02-24T19:17:55.090 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.090 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.091 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.091 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.091 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.091 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.091 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.091 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.091 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.091 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.088+0000 7f6a04dbf640 4 set_mon_vals no callback set 2026-02-24T19:17:55.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.088+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f69ec003da0 con 0x7f6a00159a70 2026-02-24T19:17:55.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.089+0000 7f6a065c2640 10 monclient: get_auth_request con 0x7f69d0077d90 auth_method 0 2026-02-24T19:17:55.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.089+0000 7f69eaffd640 10 client.4563.objecter ms_handle_connect 0x7f69d0077d90 2026-02-24T19:17:55.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313219 for osd.8 2026-02-24T19:17:55.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.099+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f69ec093350 con 0x7f6a00159a70 2026-02-24T19:17:55.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.099+0000 7f69eaffd640 10 client.4563.objecter ms_dispatch2 0x7f6a00000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:55.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.099+0000 7f69eaffd640 3 client.4563.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:55.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.099+0000 7f69eaffd640 3 client.4563.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:55.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.099+0000 7f69eaffd640 20 client.4563.objecter dump_active .. 0 homeless 2026-02-24T19:17:55.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.099+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f69ec05dd80 con 0x7f6a00159a70 2026-02-24T19:17:55.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.099+0000 7f69eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.099+0000 7f69eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:55.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.101+0000 7fc3c37fe640 1 -- 10.20.193.45:0/3010439374 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 778662779) 0x7fc3d405daa0 con 0x7fc3e4160c00 2026-02-24T19:17:55.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.101+0000 7fc3c37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:55.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.101+0000 7fc3c37fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.104 INFO:teuthology.orchestra.run.trial045.stdout:90194313219 2026-02-24T19:17:55.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7fef7ffff640 1 -- 10.20.193.45:0/2222730626 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 521551722) 0x7fef9405deb0 con 0x7fefa4159a70 2026-02-24T19:17:55.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7fef7ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:55.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7fef7ffff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.105 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-24T19:17:55.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1283829952 0 0) 0x7f6b9c0b33a0 con 0x7f6b9c0ba350 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 >> v1:10.20.193.179:6789/0 conn(0x7f6b9c0585e0 legacy=0x7f6b9c155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 >> v1:10.20.193.114:6789/0 conn(0x7f6b9c0b9f80 legacy=0x7f6b9c1fcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 1 monclient: found mon.a 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c0b3680 con 0x7f6b9c0ba350 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6b82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6ba45c3640 5 monclient: authenticate success, global_id 4569 2026-02-24T19:17:55.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6ba45c3640 10 monclient: _renew_subs 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6ba45c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c0b3960 con 0x7f6b9c0ba350 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6ba45c3640 10 client.4569.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6ba45c3640 10 monclient: _renew_subs 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6ba45c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6b9c1fc6e0 con 0x7f6b9c0ba350 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.102+0000 7f6ba45c3640 1 librados: init done 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.103+0000 7f6ba45c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.103+0000 7f6ba45c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.103+0000 7f6ba45c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.103+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c0b64c0 con 0x7f6b9c0ba350 2026-02-24T19:17:55.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.103+0000 7ffb73f4c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:55.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.103+0000 7ffb73f4c640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.103+0000 7ffb73f4c640 10 monclient: monmap: 2026-02-24T19:17:55.110 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.110 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.110 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:55.103608+0000 2026-02-24T19:17:55.110 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:55.103608+0000 2026-02-24T19:17:55.110 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.110 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 1 Processor -- start 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 1 -- start start 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 10 monclient: init 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 10 monclient(hunting): picked mon.noname-c con 0x7ffb6c159da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 10 monclient(hunting): picked mon.noname-a con 0x7ffb6c165880 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 10 monclient(hunting): picked mon.noname-b con 0x7ffb6c056090 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c15a170 con 0x7ffb6c165880 2026-02-24T19:17:55.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c0b4650 con 0x7ffb6c056090 2026-02-24T19:17:55.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c0b4930 con 0x7ffb6c159da0 2026-02-24T19:17:55.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb73f4c640 10 monclient(hunting): authenticate will time out at 3646.742596s 2026-02-24T19:17:55.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb71cc1640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7ffb6c159da0 0x7ffb6c165170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36264/0 (socket says 10.20.193.45:36264) 2026-02-24T19:17:55.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7ffb71cc1640 1 -- 10.20.193.45:0/2203960155 learned_addr learned my addr 10.20.193.45:0/2203960155 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7fc3e95c8640 10 librados: watch_flush enter 2026-02-24T19:17:55.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7fc3e95c8640 10 librados: watch_flush exit 2026-02-24T19:17:55.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7fc3e95c8640 20 client.4554.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.104+0000 7fc3e95c8640 10 client.4554.objecter successfully canceled tick 2026-02-24T19:17:55.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 >> v1:10.20.193.45:6800/1599977652 conn(0x7fc3b0077cb0 legacy=0x7fc3b0098160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fc3e95c8640 10 monclient: shutdown 2026-02-24T19:17:55.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fc3e95c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 >> v1:10.20.193.45:6789/0 conn(0x7fc3e4160c00 legacy=0x7fc3e40a7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 shutdown_connections 2026-02-24T19:17:55.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 >> 10.20.193.45:0/3010439374 conn(0x7fc3e40b2ef0 msgr2=0x7fc3e40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 shutdown_connections 2026-02-24T19:17:55.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fc3e95c8640 1 -- 10.20.193.45:0/3010439374 wait complete. 2026-02-24T19:17:55.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fc3e95c8640 1 librados: shutdown 2026-02-24T19:17:55.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 10 librados: watch_flush enter 2026-02-24T19:17:55.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 10 librados: watch_flush exit 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 20 client.4557.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 10 client.4557.objecter successfully canceled tick 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 >> v1:10.20.193.45:6800/1599977652 conn(0x7fef74077ca0 legacy=0x7fef74098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 10 monclient: shutdown 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 >> v1:10.20.193.45:6789/0 conn(0x7fefa4159a70 legacy=0x7fefa40b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 shutdown_connections 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 >> 10.20.193.45:0/2222730626 conn(0x7fefa40b7780 msgr2=0x7fefa4161c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 shutdown_connections 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 1 -- 10.20.193.45:0/2222730626 wait complete. 2026-02-24T19:17:55.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.105+0000 7fefaa05b640 1 librados: shutdown 2026-02-24T19:17:55.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.14 2026-02-24T19:17:55.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.10 2026-02-24T19:17:55.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.137+0000 7f2d29ffb640 1 -- 10.20.193.45:0/3644936424 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 737253363) 0x7f2d3805da10 con 0x7f2d3c15e280 2026-02-24T19:17:55.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.138+0000 7f2d29ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:55.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.138+0000 7f2d29ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.140 INFO:teuthology.orchestra.run.trial045.stdout:94489280515 2026-02-24T19:17:55.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 10 librados: watch_flush enter 2026-02-24T19:17:55.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 10 librados: watch_flush exit 2026-02-24T19:17:55.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 20 client.4551.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 10 client.4551.objecter successfully canceled tick 2026-02-24T19:17:55.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 >> v1:10.20.193.45:6800/1599977652 conn(0x7f2d0c077c80 legacy=0x7f2d0c098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 10 monclient: shutdown 2026-02-24T19:17:55.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 >> v1:10.20.193.45:6789/0 conn(0x7f2d3c15e280 legacy=0x7f2d3c1470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 shutdown_connections 2026-02-24T19:17:55.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 >> 10.20.193.45:0/3644936424 conn(0x7f2d3c0b7990 msgr2=0x7f2d3c15b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 shutdown_connections 2026-02-24T19:17:55.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 1 -- 10.20.193.45:0/3644936424 wait complete. 2026-02-24T19:17:55.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.140+0000 7f2d43695640 1 librados: shutdown 2026-02-24T19:17:55.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.142+0000 7fa321ffb640 1 -- 10.20.193.45:0/3271905109 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 1257367751) 0x7fa32405e1f0 con 0x7fa3340585e0 2026-02-24T19:17:55.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.142+0000 7fa321ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:17:55.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.142+0000 7fa321ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.145 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:55.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.143+0000 7f3bcff92640 10 monclient: get_monmap_and_config 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient: monmap: 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:55.144093+0000 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:55.144093+0000 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.146 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 1 Processor -- start 2026-02-24T19:17:55.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 1 -- start start 2026-02-24T19:17:55.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient: init 2026-02-24T19:17:55.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:55.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient(hunting): picked mon.noname-a con 0x7f3bc8157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient(hunting): picked mon.noname-b con 0x7f3bc8157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient(hunting): picked mon.noname-c con 0x7f3bc8164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc805de70 con 0x7f3bc8157780 2026-02-24T19:17:55.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc8055b20 con 0x7f3bc8157b50 2026-02-24T19:17:55.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc8055e00 con 0x7f3bc8164d00 2026-02-24T19:17:55.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.144+0000 7f3bcff92640 10 monclient(hunting): authenticate will time out at 3646.782979s 2026-02-24T19:17:55.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 10 librados: watch_flush enter 2026-02-24T19:17:55.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 10 librados: watch_flush exit 2026-02-24T19:17:55.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 20 client.4548.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 10 client.4548.objecter successfully canceled tick 2026-02-24T19:17:55.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 >> v1:10.20.193.45:6800/1599977652 conn(0x7fa304077cb0 legacy=0x7fa304098160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 10 monclient: shutdown 2026-02-24T19:17:55.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 >> v1:10.20.193.45:6789/0 conn(0x7fa3340585e0 legacy=0x7fa3341624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 shutdown_connections 2026-02-24T19:17:55.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 >> 10.20.193.45:0/3271905109 conn(0x7fa3340b7990 msgr2=0x7fa334056830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 shutdown_connections 2026-02-24T19:17:55.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 1 -- 10.20.193.45:0/3271905109 wait complete. 2026-02-24T19:17:55.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7fa33b89d640 1 librados: shutdown 2026-02-24T19:17:55.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7f3bce508640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f3bc8164d00 0x7f3bc81c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36268/0 (socket says 10.20.193.45:36268) 2026-02-24T19:17:55.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.145+0000 7f3bce508640 1 -- 10.20.193.45:0/1839055593 learned_addr learned my addr 10.20.193.45:0/1839055593 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.3 2026-02-24T19:17:55.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.13 2026-02-24T19:17:55.157 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:55.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.183+0000 7fe8e2ba2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:17:55.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.183+0000 7fe8e2ba2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:17:55.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.183+0000 7fe8e2ba2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.183+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe8dc157c10 con 0x7fe8dc0585e0 2026-02-24T19:17:55.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.206+0000 7f6a0884d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:17:55.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.206+0000 7f6a0884d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:17:55.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.206+0000 7f6a0884d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.206+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f6a00161410 con 0x7f6a00159a70 2026-02-24T19:17:55.225 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-24T19:17:55.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.290+0000 7f6b1de82640 10 monclient: get_monmap_and_config 2026-02-24T19:17:55.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.290+0000 7f6b1de82640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.290+0000 7f6b1de82640 10 monclient: monmap: 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:55.291661+0000 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:55.291661+0000 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.294 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 1 Processor -- start 2026-02-24T19:17:55.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 1 -- start start 2026-02-24T19:17:55.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 10 monclient: init 2026-02-24T19:17:55.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:55.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 10 monclient(hunting): picked mon.noname-c con 0x7f6b1815d610 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 10 monclient(hunting): picked mon.noname-b con 0x7f6b181667e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 10 monclient(hunting): picked mon.noname-a con 0x7f6b18056ea0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1815d9e0 con 0x7f6b18056ea0 2026-02-24T19:17:55.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b18055b20 con 0x7f6b181667e0 2026-02-24T19:17:55.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b18055e00 con 0x7f6b1815d610 2026-02-24T19:17:55.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.291+0000 7f6b1de82640 10 monclient(hunting): authenticate will time out at 3646.930965s 2026-02-24T19:17:55.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.292+0000 7f6b16ffd640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f6b181667e0 0x7f6b180ba010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49276/0 (socket says 10.20.193.45:49276) 2026-02-24T19:17:55.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.292+0000 7f6b16ffd640 1 -- 10.20.193.45:0/4076772275 learned_addr learned my addr 10.20.193.45:0/4076772275 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.403+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcb0003000 con 0x7efcc8155b20 2026-02-24T19:17:55.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.403+0000 7efcbd7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.403+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7efcb0003940 con 0x7efcc8155b20 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.403+0000 7efcbd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.403+0000 7efcbeffd640 4 set_mon_vals no callback set 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.403+0000 7efcbd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.403+0000 7efcbd7fa640 10 monclient: dump: 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.407 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.408 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.408 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.408 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.404+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7efcb0003b20 con 0x7efcc8155b20 2026-02-24T19:17:55.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.404+0000 7efccc988640 10 monclient: get_auth_request con 0x7efc98077e20 auth_method 0 2026-02-24T19:17:55.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.404+0000 7efcbd7fa640 10 client.4572.objecter ms_handle_connect 0x7efc98077e20 2026-02-24T19:17:55.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3947734030 0 0) 0x7f4cd80b2a60 con 0x7f4cd81617a0 2026-02-24T19:17:55.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 >> v1:10.20.193.179:6789/0 conn(0x7f4cd80b5de0 legacy=0x7f4cd82011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 >> v1:10.20.193.114:6789/0 conn(0x7f4cd82039c0 legacy=0x7f4cd813d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 1 monclient: found mon.a 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd80b2d40 con 0x7f4cd81617a0 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cc67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cdfe13640 5 monclient: authenticate success, global_id 4566 2026-02-24T19:17:55.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cdfe13640 10 monclient: _renew_subs 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cdfe13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd80b3020 con 0x7f4cd81617a0 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cdfe13640 10 client.4566.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cdfe13640 10 monclient: _renew_subs 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cdfe13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4cd80b3820 con 0x7f4cd81617a0 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.406+0000 7f4cdfe13640 1 librados: init done 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.407+0000 7f4cdfe13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.407+0000 7f4cdfe13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.407+0000 7f4cdfe13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.407+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd8053640 con 0x7f4cd81617a0 2026-02-24T19:17:55.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.407+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7efcb00920a0 con 0x7efcc8155b20 2026-02-24T19:17:55.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.407+0000 7efcbd7fa640 10 client.4572.objecter ms_dispatch2 0x7efcc8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:55.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.407+0000 7efcbd7fa640 3 client.4572.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:55.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.407+0000 7efcbd7fa640 3 client.4572.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:55.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.408+0000 7efcbd7fa640 20 client.4572.objecter dump_active .. 0 homeless 2026-02-24T19:17:55.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.408+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7efcc8059bc0 con 0x7efcc8155b20 2026-02-24T19:17:55.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.408+0000 7efcbd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.408+0000 7efcbd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:55.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062209648 0 0) 0x7f8e94002910 con 0x7f8ea40b9f80 2026-02-24T19:17:55.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f8ea8875640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f8ea8875640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f8ea8875640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f8ea8875640 10 monclient(hunting): my global_id is 4578 2026-02-24T19:17:55.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e8c003610 con 0x7f8ea40b9f80 2026-02-24T19:17:55.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259445014 0 0) 0x7f542005de70 con 0x7f5420157b50 2026-02-24T19:17:55.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f541effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f541effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f541effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f541effd640 10 monclient(hunting): my global_id is 4575 2026-02-24T19:17:55.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.409+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5404003610 con 0x7f5420157b50 2026-02-24T19:17:55.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.413+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b98002bf0 con 0x7f6b9c0ba350 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.413+0000 7f6b82ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.414+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6b98003c60 con 0x7f6b9c0ba350 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.414+0000 7f6b82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.414+0000 7f6b82ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.414+0000 7f6b82ffd640 10 monclient: dump: 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.417 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.418 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.418 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.418 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.418 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.414+0000 7f6ba0b35640 4 set_mon_vals no callback set 2026-02-24T19:17:55.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.414+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f6b98003e40 con 0x7f6b9c0ba350 2026-02-24T19:17:55.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.415+0000 7f6ba2338640 10 monclient: get_auth_request con 0x7f6b6c077d90 auth_method 0 2026-02-24T19:17:55.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.415+0000 7f6b82ffd640 10 client.4569.objecter ms_handle_connect 0x7f6b6c077d90 2026-02-24T19:17:55.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.417+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f6b98092480 con 0x7f6b9c0ba350 2026-02-24T19:17:55.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.417+0000 7f6b82ffd640 10 client.4569.objecter ms_dispatch2 0x7f6b9c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:55.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.417+0000 7f6b82ffd640 3 client.4569.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:55.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.417+0000 7f6b82ffd640 3 client.4569.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:55.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.417+0000 7f6b82ffd640 20 client.4569.objecter dump_active .. 0 homeless 2026-02-24T19:17:55.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.417+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6b9c163930 con 0x7f6b9c0ba350 2026-02-24T19:17:55.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.417+0000 7f6b82ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.417+0000 7f6b82ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:55.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.425+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831349720 0 0) 0x7f5420055b20 con 0x7f5420157780 2026-02-24T19:17:55.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.425+0000 7f541effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.425+0000 7f541effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.425+0000 7f541effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.425+0000 7f541effd640 10 monclient(hunting): my global_id is 4546 2026-02-24T19:17:55.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.425+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f542005de70 con 0x7f5420157780 2026-02-24T19:17:55.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3733363098 0 0) 0x7f8ea4163bb0 con 0x7f8ea40ba350 2026-02-24T19:17:55.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f8ea8875640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f8ea8875640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f8ea8875640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f8ea8875640 10 monclient(hunting): my global_id is 4549 2026-02-24T19:17:55.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e94002910 con 0x7f8ea40ba350 2026-02-24T19:17:55.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 146037670 0 0) 0x7ffb6c0b4650 con 0x7ffb6c056090 2026-02-24T19:17:55.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7ffb70cbf640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7ffb70cbf640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7ffb70cbf640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7ffb70cbf640 10 monclient(hunting): my global_id is 4552 2026-02-24T19:17:55.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb54003610 con 0x7ffb6c056090 2026-02-24T19:17:55.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385022387 0 0) 0x7f3bc8055b20 con 0x7f3bc8157b50 2026-02-24T19:17:55.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f3bccd05640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f3bccd05640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f3bccd05640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f3bccd05640 10 monclient(hunting): my global_id is 4555 2026-02-24T19:17:55.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bb0003610 con 0x7f3bc8157b50 2026-02-24T19:17:55.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561189145 0 0) 0x7f6b18055b20 con 0x7f6b181667e0 2026-02-24T19:17:55.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f6b167fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f6b167fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f6b167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f6b167fc640 10 monclient(hunting): my global_id is 4558 2026-02-24T19:17:55.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.427+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6afc003610 con 0x7f6b181667e0 2026-02-24T19:17:55.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7fe8d17fa640 1 -- 10.20.193.45:0/1987141892 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 1257367751) 0x7fe8cc05d600 con 0x7fe8dc0585e0 2026-02-24T19:17:55.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7fe8d17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:17:55.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7fe8d17fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.434 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:55.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7f69eaffd640 1 -- 10.20.193.45:0/3681497911 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 521551722) 0x7f69ec05d680 con 0x7f6a00159a70 2026-02-24T19:17:55.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7f69eaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:17:55.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7f69eaffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.435 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-24T19:17:55.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407266412 0 0) 0x7f5420055e00 con 0x7f5420164d00 2026-02-24T19:17:55.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7f541effd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7f541effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7f541effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7f541effd640 10 monclient(hunting): my global_id is 4571 2026-02-24T19:17:55.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.428+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5420055b20 con 0x7f5420164d00 2026-02-24T19:17:55.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626408357 0 0) 0x7f6b18055e00 con 0x7f6b1815d610 2026-02-24T19:17:55.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f6b167fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f6b167fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f6b167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f6b167fc640 10 monclient(hunting): my global_id is 4583 2026-02-24T19:17:55.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b18055b20 con 0x7f6b1815d610 2026-02-24T19:17:55.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534003302 0 0) 0x7f8ea4163e90 con 0x7f8ea40585e0 2026-02-24T19:17:55.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient(hunting): my global_id is 4574 2026-02-24T19:17:55.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ea4163bb0 con 0x7f8ea40585e0 2026-02-24T19:17:55.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661392931 0 0) 0x7ffb6c0b4930 con 0x7ffb6c159da0 2026-02-24T19:17:55.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7ffb70cbf640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7ffb70cbf640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7ffb70cbf640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7ffb70cbf640 10 monclient(hunting): my global_id is 4577 2026-02-24T19:17:55.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb6c0b4650 con 0x7ffb6c159da0 2026-02-24T19:17:55.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729854887 0 0) 0x7f3bc8055e00 con 0x7f3bc8164d00 2026-02-24T19:17:55.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f3bccd05640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f3bccd05640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f3bccd05640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f3bccd05640 10 monclient(hunting): my global_id is 4580 2026-02-24T19:17:55.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bc8055b20 con 0x7f3bc8164d00 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 851319090 0 0) 0x7f8e8c003610 con 0x7f8ea40b9f80 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 >> v1:10.20.193.179:6789/0 conn(0x7f8ea40585e0 legacy=0x7f8ea4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 >> v1:10.20.193.114:6789/0 conn(0x7f8ea40ba350 legacy=0x7f8ea4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 1 monclient: found mon.noname-a 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea40573f0 con 0x7f8ea40b9f80 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8e94002fc0 con 0x7f8ea40b9f80 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8ea8875640 10 monclient: dump: 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.442 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.443 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.443 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8eabb02640 5 monclient: authenticate success, global_id 4578 2026-02-24T19:17:55.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.429+0000 7f8eabb02640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:55.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.430+0000 7fe8e2ba2640 10 librados: watch_flush enter 2026-02-24T19:17:55.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.430+0000 7fe8e2ba2640 10 librados: watch_flush exit 2026-02-24T19:17:55.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.430+0000 7fe8e2ba2640 20 client.4560.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.430+0000 7fe8e2ba2640 10 client.4560.objecter successfully canceled tick 2026-02-24T19:17:55.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.430+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 >> v1:10.20.193.45:6800/1599977652 conn(0x7fe8ac077d60 legacy=0x7fe8ac098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.430+0000 7fe8e2ba2640 10 monclient: shutdown 2026-02-24T19:17:55.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.430+0000 7fe8e2ba2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.430+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 >> v1:10.20.193.45:6789/0 conn(0x7fe8dc0585e0 legacy=0x7fe8dc166160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 shutdown_connections 2026-02-24T19:17:55.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 >> 10.20.193.45:0/1987141892 conn(0x7fe8dc0b7990 msgr2=0x7fe8dc15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 shutdown_connections 2026-02-24T19:17:55.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7fe8e2ba2640 1 -- 10.20.193.45:0/1987141892 wait complete. 2026-02-24T19:17:55.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7fe8e2ba2640 1 librados: shutdown 2026-02-24T19:17:55.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3184011700 0 0) 0x7f542005de70 con 0x7f5420157780 2026-02-24T19:17:55.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 >> v1:10.20.193.179:6789/0 conn(0x7f5420164d00 legacy=0x7f54201c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 >> v1:10.20.193.45:6789/0 conn(0x7f5420157b50 legacy=0x7f54201645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 1 monclient: found mon.noname-b 2026-02-24T19:17:55.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54200560e0 con 0x7f5420157780 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f540c002df0 con 0x7f5420157780 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f541effd640 10 monclient: dump: 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.447 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.448 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.448 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.448 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.448 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.448 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.448 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.448 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f5426799640 5 monclient: authenticate success, global_id 4546 2026-02-24T19:17:55.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f5426799640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:55.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 10 librados: watch_flush enter 2026-02-24T19:17:55.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 10 librados: watch_flush exit 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 20 client.4563.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 10 client.4563.objecter successfully canceled tick 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 >> v1:10.20.193.45:6800/1599977652 conn(0x7f69d0077d90 legacy=0x7f69d0098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 10 monclient: shutdown 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 >> v1:10.20.193.45:6789/0 conn(0x7f6a00159a70 legacy=0x7f6a001fc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 shutdown_connections 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.431+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 >> 10.20.193.45:0/3681497911 conn(0x7f6a000b7780 msgr2=0x7f6a000b8900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 shutdown_connections 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7f6a0884d640 1 -- 10.20.193.45:0/3681497911 wait complete. 2026-02-24T19:17:55.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7f6a0884d640 1 librados: shutdown 2026-02-24T19:17:55.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2833462177 0 0) 0x7ffb54003610 con 0x7ffb6c056090 2026-02-24T19:17:55.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 >> v1:10.20.193.179:6789/0 conn(0x7ffb6c159da0 legacy=0x7ffb6c165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 >> v1:10.20.193.45:6789/0 conn(0x7ffb6c165880 legacy=0x7ffb6c055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 1 monclient: found mon.noname-b 2026-02-24T19:17:55.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:55.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c0b4c10 con 0x7ffb6c056090 2026-02-24T19:17:55.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb70cbf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb73f4c640 5 monclient: authenticate success, global_id 4552 2026-02-24T19:17:55.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7ffb73f4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:55.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931040481 0 0) 0x7f3bc805de70 con 0x7f3bc8157780 2026-02-24T19:17:55.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7f3bccd05640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7f3bccd05640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7f3bccd05640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7f3bccd05640 10 monclient(hunting): my global_id is 4584 2026-02-24T19:17:55.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.432+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bc8055e00 con 0x7f3bc8157780 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e94003190 con 0x7f8ea40b9f80 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f8ea8875640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f8ea8875640 1 -- 10.20.193.45:0/260568625 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8e94003700 con 0x7f8ea40b9f80 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f8ea8875640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f8ea8875640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f8ea8875640 10 monclient: dump: 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.454 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.455 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.455 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.455 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.455 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f8eabb02640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:55.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f8eabb02640 4 set_mon_vals no callback set 2026-02-24T19:17:55.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffb68003170 con 0x7ffb6c056090 2026-02-24T19:17:55.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7ffb70cbf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7ffb70cbf640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7ffb70cbf640 10 monclient: dump: 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7ffb73f4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:55.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190931026 0 0) 0x7f6b1815d9e0 con 0x7f6b18056ea0 2026-02-24T19:17:55.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f6b167fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f6b167fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f6b167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f6b167fc640 10 monclient(hunting): my global_id is 4587 2026-02-24T19:17:55.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.433+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b18055e00 con 0x7f6b18056ea0 2026-02-24T19:17:55.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.435+0000 7f8eabb02640 10 monclient: shutdown 2026-02-24T19:17:55.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.435+0000 7f8eabb02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.435+0000 7f8eabb02640 1 -- 10.20.193.45:0/260568625 >> v1:10.20.193.45:6789/0 conn(0x7f8ea40b9f80 legacy=0x7f8ea4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.435+0000 7f8eabb02640 1 -- 10.20.193.45:0/260568625 shutdown_connections 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.435+0000 7f8eabb02640 1 -- 10.20.193.45:0/260568625 >> 10.20.193.45:0/260568625 conn(0x7f8ea40b7990 msgr2=0x7f8ea40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.435+0000 7f8eabb02640 1 -- 10.20.193.45:0/260568625 shutdown_connections 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.435+0000 7f8eabb02640 1 -- 10.20.193.45:0/260568625 wait complete. 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 10 monclient: monmap: 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.459 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.460 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f540c002fc0 con 0x7f5420157780 2026-02-24T19:17:55.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f541effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f541effd640 1 -- 10.20.193.45:0/2700282426 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f540c003400 con 0x7f5420157780 2026-02-24T19:17:55.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f541effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f541effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:55.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f541effd640 10 monclient: dump: 2026-02-24T19:17:55.460 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.460 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f5426799640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:55.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f5426799640 4 set_mon_vals no callback set 2026-02-24T19:17:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 1 librados: starting msgr at 2026-02-24T19:17:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 1 librados: starting objecter 2026-02-24T19:17:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 1 Processor -- start 2026-02-24T19:17:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 1 -- start start 2026-02-24T19:17:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 1 librados: setting wanted keys 2026-02-24T19:17:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 1 librados: calling monclient init 2026-02-24T19:17:55.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f8eabb02640 10 monclient: init 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3165438541 0 0) 0x7f6afc003610 con 0x7f6b181667e0 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 >> v1:10.20.193.179:6789/0 conn(0x7f6b1815d610 legacy=0x7f6b180b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 >> v1:10.20.193.45:6789/0 conn(0x7f6b18056ea0 legacy=0x7f6b181c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 1 monclient: found mon.noname-b 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b180560e0 con 0x7f6b181667e0 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6b08002df0 con 0x7f6b181667e0 2026-02-24T19:17:55.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1786795709 0 0) 0x7f3bb0003610 con 0x7f3bc8157b50 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 >> v1:10.20.193.179:6789/0 conn(0x7f3bc8164d00 legacy=0x7f3bc81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b167fc640 10 monclient: dump: 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.464 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.465 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 >> v1:10.20.193.45:6789/0 conn(0x7f3bc8157780 legacy=0x7f3bc8056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 1 monclient: found mon.noname-b 2026-02-24T19:17:55.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b1de82640 5 monclient: authenticate success, global_id 4558 2026-02-24T19:17:55.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f6b1de82640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc80560e0 con 0x7f3bc8157b50 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3bbc002df0 con 0x7f3bc8157b50 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bccd05640 10 monclient: dump: 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.466 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bcff92640 5 monclient: authenticate success, global_id 4555 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f3bcff92640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:55.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f5426799640 10 monclient: shutdown 2026-02-24T19:17:55.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f5426799640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f5426799640 1 -- 10.20.193.45:0/2700282426 >> v1:10.20.193.114:6789/0 conn(0x7f5420157780 legacy=0x7f5420056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f5426799640 1 -- 10.20.193.45:0/2700282426 shutdown_connections 2026-02-24T19:17:55.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f5426799640 1 -- 10.20.193.45:0/2700282426 >> 10.20.193.45:0/2700282426 conn(0x7f54200b2ef0 msgr2=0x7f54200b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.436+0000 7f5426799640 1 -- 10.20.193.45:0/2700282426 shutdown_connections 2026-02-24T19:17:55.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 1 -- 10.20.193.45:0/2700282426 wait complete. 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 10 monclient(hunting): picked mon.noname-b con 0x7f8ea40585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 10 monclient(hunting): picked mon.noname-c con 0x7f8ea40b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 10 monclient(hunting): picked mon.noname-a con 0x7f8ea40ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea40b4ea0 con 0x7f8ea40ba350 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea40b23b0 con 0x7f8ea40585e0 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea40b2690 con 0x7f8ea40b9f80 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f8eabb02640 10 monclient(hunting): authenticate will time out at 3647.076187s 2026-02-24T19:17:55.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 10 monclient: monmap: 2026-02-24T19:17:55.470 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.470 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:55.470 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:55.470 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:55.470 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.470 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:55.470 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 1 librados: starting msgr at 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 1 librados: starting objecter 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 1 Processor -- start 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 1 -- start start 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 1 librados: setting wanted keys 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 1 librados: calling monclient init 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.437+0000 7f5426799640 10 monclient: init 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 10 monclient(hunting): picked mon.noname-b con 0x7f5420157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 10 monclient(hunting): picked mon.noname-c con 0x7f5420157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 10 monclient(hunting): picked mon.noname-a con 0x7f5420164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542005b8e0 con 0x7f5420164d00 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54200b5c60 con 0x7f5420157780 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5420145f80 con 0x7f5420157b50 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7f5426799640 10 monclient(hunting): authenticate will time out at 3647.077493s 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb680033c0 con 0x7ffb6c056090 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7ffb70cbf640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7ffb70cbf640 1 -- 10.20.193.45:0/2203960155 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffb68003800 con 0x7ffb6c056090 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7ffb73f4c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7ffb73f4c640 4 set_mon_vals no callback set 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7ffb70cbf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7ffb70cbf640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.438+0000 7ffb70cbf640 10 monclient: dump: 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.472 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.473 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.473 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.473 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f8ea9076640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f8ea40b9f80 0x7f8ea41fc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36280/0 (socket says 10.20.193.45:36280) 2026-02-24T19:17:55.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f8ea9076640 1 -- 10.20.193.45:0/2820526200 learned_addr learned my addr 10.20.193.45:0/2820526200 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.1 2026-02-24T19:17:55.474 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:55.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7ffb73f4c640 10 monclient: shutdown 2026-02-24T19:17:55.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7ffb73f4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7ffb73f4c640 1 -- 10.20.193.45:0/2203960155 >> v1:10.20.193.114:6789/0 conn(0x7ffb6c056090 legacy=0x7ffb6c0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7ffb73f4c640 1 -- 10.20.193.45:0/2203960155 shutdown_connections 2026-02-24T19:17:55.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7ffb73f4c640 1 -- 10.20.193.45:0/2203960155 >> 10.20.193.45:0/2203960155 conn(0x7ffb6c0b78c0 msgr2=0x7ffb6c0b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7ffb73f4c640 1 -- 10.20.193.45:0/2203960155 shutdown_connections 2026-02-24T19:17:55.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7ffb73f4c640 1 -- 10.20.193.45:0/2203960155 wait complete. 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f8e927fc640 10 client.?.objecter ms_handle_connect 0x7f8ea40b9f80 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f8e927fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b08002fc0 con 0x7f6b181667e0 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f6b167fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f6b167fc640 1 -- 10.20.193.45:0/4076772275 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6b08003400 con 0x7f6b181667e0 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f6b167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f6b167fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f6b167fc640 10 monclient: dump: 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.475 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f6b1de82640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f6b1de82640 4 set_mon_vals no callback set 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f541f7fe640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f5420157b50 0x7f542005bdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36284/0 (socket says 10.20.193.45:36284) 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.439+0000 7f541f7fe640 1 -- 10.20.193.45:0/3109668220 learned_addr learned my addr 10.20.193.45:0/3109668220 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 10 monclient: monmap: 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:55.476 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f6b1de82640 10 monclient: shutdown 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f6b1de82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f6b1de82640 1 -- 10.20.193.45:0/4076772275 >> v1:10.20.193.114:6789/0 conn(0x7f6b181667e0 legacy=0x7f6b180ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f6b1de82640 1 -- 10.20.193.45:0/4076772275 shutdown_connections 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f6b1de82640 1 -- 10.20.193.45:0/4076772275 >> 10.20.193.45:0/4076772275 conn(0x7f6b180b7470 msgr2=0x7f6b180b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f6b1de82640 1 -- 10.20.193.45:0/4076772275 shutdown_connections 2026-02-24T19:17:55.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f6b1de82640 1 -- 10.20.193.45:0/4076772275 wait complete. 2026-02-24T19:17:55.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 1 librados: starting msgr at 2026-02-24T19:17:55.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 1 librados: starting objecter 2026-02-24T19:17:55.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.15 2026-02-24T19:17:55.479 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 1 Processor -- start 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 1 -- start start 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 1 librados: setting wanted keys 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 1 librados: calling monclient init 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7ffb73f4c640 10 monclient: init 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f6b1de82640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f6b1de82640 10 monclient: monmap: 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.479 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f541cff9640 10 client.?.objecter ms_handle_connect 0x7f5420157b50 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f541cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628321590 0 0) 0x7f8ea40b2690 con 0x7f8ea40b9f80 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f8e927fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f8e927fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f8e927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.440+0000 7f8e927fc640 10 monclient(hunting): my global_id is 4586 2026-02-24T19:17:55.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e74003610 con 0x7f8ea40b9f80 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 10 monclient(hunting): picked mon.noname-c con 0x7ffb6c056090 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 10 monclient(hunting): picked mon.noname-b con 0x7ffb6c159da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 1 librados: starting msgr at 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 1 librados: starting objecter 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 10 monclient(hunting): picked mon.noname-a con 0x7ffb6c165880 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c0b6d90 con 0x7ffb6c165880 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c1fc900 con 0x7ffb6c159da0 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c1fcbe0 con 0x7ffb6c056090 2026-02-24T19:17:55.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7ffb73f4c640 10 monclient(hunting): authenticate will time out at 3647.080133s 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 1 Processor -- start 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 1 -- start start 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 1 librados: setting wanted keys 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 1 librados: calling monclient init 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 10 monclient: init 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 10 monclient(hunting): picked mon.noname-b con 0x7f6b18056ea0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 10 monclient(hunting): picked mon.noname-c con 0x7f6b1815d610 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 10 monclient(hunting): picked mon.noname-a con 0x7f6b181667e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1811fea0 con 0x7f6b181667e0 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b18120180 con 0x7f6b18056ea0 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b18120460 con 0x7f6b1815d610 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f6b1de82640 10 monclient(hunting): authenticate will time out at 3647.080670s 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f8e927fc640 10 client.?.objecter ms_handle_connect 0x7f8ea40585e0 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.441+0000 7f8e927fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025383538 0 0) 0x7f5420145f80 con 0x7f5420157b50 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f541cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f541cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f541cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f541cff9640 10 monclient(hunting): my global_id is 4589 2026-02-24T19:17:55.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53f0003610 con 0x7f5420157b50 2026-02-24T19:17:55.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f6b16ffd640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f6b1815d610 0x7f6b180b6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36294/0 (socket says 10.20.193.45:36294) 2026-02-24T19:17:55.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f6b16ffd640 1 -- 10.20.193.45:0/1395509219 learned_addr learned my addr 10.20.193.45:0/1395509219 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7ffb71cc1640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7ffb6c056090 0x7ffb6c1575c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36292/0 (socket says 10.20.193.45:36292) 2026-02-24T19:17:55.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7ffb71cc1640 1 -- 10.20.193.45:0/3676775112 learned_addr learned my addr 10.20.193.45:0/3676775112 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3bbc002fc0 con 0x7f3bc8157b50 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f3bccd05640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f3bccd05640 1 -- 10.20.193.45:0/1839055593 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3bbc003400 con 0x7f3bc8157b50 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f3bccd05640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f3bccd05640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f3bccd05640 10 monclient: dump: 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f3bcff92640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.442+0000 7f3bcff92640 4 set_mon_vals no callback set 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 10 monclient: shutdown 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 1 -- 10.20.193.45:0/1839055593 >> v1:10.20.193.114:6789/0 conn(0x7f3bc8157b50 legacy=0x7f3bc81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 1 -- 10.20.193.45:0/1839055593 shutdown_connections 2026-02-24T19:17:55.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 1 -- 10.20.193.45:0/1839055593 >> 10.20.193.45:0/1839055593 conn(0x7f3bc80b2ef0 msgr2=0x7f3bc80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 1 -- 10.20.193.45:0/1839055593 shutdown_connections 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 1 -- 10.20.193.45:0/1839055593 wait complete. 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 10 monclient: build_initial_monmap 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 10 monclient: monmap: 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 1 librados: starting msgr at 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 1 librados: starting objecter 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.443+0000 7f3bcff92640 1 Processor -- start 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 1 -- start start 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 1 librados: setting wanted keys 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 1 librados: calling monclient init 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 10 monclient: init 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f541cff9640 10 client.?.objecter ms_handle_connect 0x7f5420157780 2026-02-24T19:17:55.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f541cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 10 monclient(hunting): picked mon.noname-b con 0x7f3bc8157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 10 monclient(hunting): picked mon.noname-c con 0x7f3bc8157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 10 monclient(hunting): picked mon.noname-a con 0x7f3bc8164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc80a83d0 con 0x7f3bc8164d00 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc8145340 con 0x7f3bc8157780 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc80ae690 con 0x7f3bc8157b50 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f3bcff92640 10 monclient(hunting): authenticate will time out at 3647.083377s 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7ffb5a7fc640 10 client.?.objecter ms_handle_connect 0x7ffb6c056090 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7ffb5a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f6af3fff640 10 client.?.objecter ms_handle_connect 0x7f6b1815d610 2026-02-24T19:17:55.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.444+0000 7f6af3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.445+0000 7ffb5a7fc640 10 client.?.objecter ms_handle_connect 0x7ffb6c159da0 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.445+0000 7ffb5a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.445+0000 7f6af3fff640 10 client.?.objecter ms_handle_connect 0x7f6b18056ea0 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.445+0000 7f6af3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.447+0000 7f3bcdd07640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f3bc8157780 0x7f3bc8156af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49314/0 (socket says 10.20.193.45:49314) 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.447+0000 7f3bcdd07640 1 -- 10.20.193.45:0/2898482222 learned_addr learned my addr 10.20.193.45:0/2898482222 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.447+0000 7f3bb67fc640 10 client.?.objecter ms_handle_connect 0x7f3bc8157780 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.447+0000 7f3bb67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3714323280 0 0) 0x7f53f0003610 con 0x7f5420157b50 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5420145f80 con 0x7f5420157b50 2026-02-24T19:17:55.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f54100030f0 con 0x7f5420157b50 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f541cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f541cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f541cff9640 10 monclient(hunting): dump: 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f541cff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4047095335 0 0) 0x7f8e74003610 con 0x7f8ea40b9f80 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ea40b2690 con 0x7f8ea40b9f80 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8e980030f0 con 0x7f8ea40b9f80 2026-02-24T19:17:55.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f8e927fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f8e927fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f8e927fc640 10 monclient(hunting): dump: 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.448+0000 7f8e927fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 15488099 0 0) 0x7ffb6c1fcbe0 con 0x7ffb6c056090 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7ffb5a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7ffb5a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7ffb5a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7ffb5a7fc640 10 monclient(hunting): my global_id is 4592 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb3c003610 con 0x7ffb6c056090 2026-02-24T19:17:55.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604392597 0 0) 0x7f6b18120460 con 0x7f6b1815d610 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7f6af3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7f6af3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7f6af3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7f6af3fff640 10 monclient(hunting): my global_id is 4595 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.449+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ae8003610 con 0x7f6b1815d610 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f3bb67fc640 10 client.?.objecter ms_handle_connect 0x7f3bc8157b50 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f3bb67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3261000375 0 0) 0x7f8ea40b2690 con 0x7f8ea40b9f80 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 >> v1:10.20.193.114:6789/0 conn(0x7f8ea40585e0 legacy=0x7f8ea40b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 >> v1:10.20.193.45:6789/0 conn(0x7f8ea40ba350 legacy=0x7f8ea41fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 1 monclient: found mon.c 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea40b2970 con 0x7f8ea40b9f80 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8e927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8eabb02640 5 monclient: authenticate success, global_id 4586 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8eabb02640 10 monclient: _renew_subs 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8eabb02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea40b2c50 con 0x7f8ea40b9f80 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8eabb02640 10 client.4586.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8eabb02640 10 monclient: _renew_subs 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8eabb02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ea40b3210 con 0x7f8ea40b9f80 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.454+0000 7f8eabb02640 1 librados: init done 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.455+0000 7f8eabb02640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.455+0000 7f8eabb02640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.455+0000 7f8eabb02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.455+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea40b64c0 con 0x7f8ea40b9f80 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 604405247 0 0) 0x7f6ae8003610 con 0x7f6b1815d610 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b18120460 con 0x7f6b1815d610 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6b08003310 con 0x7f6b1815d610 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f6af3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:55.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f6af3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f6af3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f6af3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1133504396 0 0) 0x7f5420145f80 con 0x7f5420157b50 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 >> v1:10.20.193.114:6789/0 conn(0x7f5420157780 legacy=0x7f54200b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 >> v1:10.20.193.45:6789/0 conn(0x7f5420164d00 legacy=0x7f54201564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 1 monclient: found mon.c 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5420146260 con 0x7f5420157b50 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f541cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f5426799640 5 monclient: authenticate success, global_id 4589 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f5426799640 10 monclient: _renew_subs 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f5426799640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5420146540 con 0x7f5420157b50 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f5426799640 10 client.4589.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f5426799640 10 monclient: _renew_subs 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f5426799640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5420145b70 con 0x7f5420157b50 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.458+0000 7f5426799640 1 librados: init done 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.459+0000 7f5426799640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.459+0000 7f5426799640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.459+0000 7f5426799640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.459+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5420146a60 con 0x7f5420157b50 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715537258 0 0) 0x7f3bc80ae690 con 0x7f3bc8157b50 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7f3bb67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7f3bb67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7f3bb67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7f3bb67fc640 10 monclient(hunting): my global_id is 4598 2026-02-24T19:17:55.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b98003610 con 0x7f3bc8157b50 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 749381079 0 0) 0x7ffb3c003610 con 0x7ffb6c056090 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb6c1fcbe0 con 0x7ffb6c056090 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffb5c0030f0 con 0x7ffb6c056090 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7ffb5a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7ffb5a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7ffb5a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.462+0000 7ffb5a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:55.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.516+0000 7efccec13640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:17:55.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.516+0000 7efccec13640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:17:55.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.516+0000 7efccec13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.516+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7efcc81548e0 con 0x7efcc8155b20 2026-02-24T19:17:55.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.528+0000 7f6ba45c3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:17:55.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.528+0000 7f6ba45c3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:17:55.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.528+0000 7f6ba45c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.528+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6b9c13be20 con 0x7f6b9c0ba350 2026-02-24T19:17:55.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.550+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e980034a0 con 0x7f8ea40b9f80 2026-02-24T19:17:55.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.550+0000 7f8e927fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.550+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f8e98003b90 con 0x7f8ea40b9f80 2026-02-24T19:17:55.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.550+0000 7f8e927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.550+0000 7f8e927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:55.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.550+0000 7f8e927fc640 10 monclient: dump: 2026-02-24T19:17:55.553 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.553 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.550+0000 7f8e93fff640 4 set_mon_vals no callback set 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.551+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f8e98003d70 con 0x7f8ea40b9f80 2026-02-24T19:17:55.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.552+0000 7f8ea9877640 10 monclient: get_auth_request con 0x7f8e74077cc0 auth_method 0 2026-02-24T19:17:55.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.552+0000 7f8e927fc640 10 client.4586.objecter ms_handle_connect 0x7f8e74077cc0 2026-02-24T19:17:55.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.570+0000 7efcbd7fa640 1 -- 10.20.193.45:0/824539588 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 1257367751) 0x7efcb005cad0 con 0x7efcc8155b20 2026-02-24T19:17:55.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.570+0000 7efcbd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:17:55.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.570+0000 7efcbd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.573 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:55.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.572+0000 7efccec13640 10 librados: watch_flush enter 2026-02-24T19:17:55.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.572+0000 7efccec13640 10 librados: watch_flush exit 2026-02-24T19:17:55.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.572+0000 7efccec13640 20 client.4572.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.572+0000 7efccec13640 10 client.4572.objecter successfully canceled tick 2026-02-24T19:17:55.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.572+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 >> v1:10.20.193.45:6800/1599977652 conn(0x7efc98077e20 legacy=0x7efc980982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.572+0000 7efccec13640 10 monclient: shutdown 2026-02-24T19:17:55.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.572+0000 7efccec13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.572+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 >> v1:10.20.193.45:6789/0 conn(0x7efcc8155b20 legacy=0x7efcc80a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.573+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 shutdown_connections 2026-02-24T19:17:55.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.573+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 >> 10.20.193.45:0/824539588 conn(0x7efcc80b2ef0 msgr2=0x7efcc8161de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.573+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 shutdown_connections 2026-02-24T19:17:55.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.573+0000 7efccec13640 1 -- 10.20.193.45:0/824539588 wait complete. 2026-02-24T19:17:55.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.573+0000 7efccec13640 1 librados: shutdown 2026-02-24T19:17:55.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.575+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ccc003490 con 0x7f4cd81617a0 2026-02-24T19:17:55.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.575+0000 7f4cc67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.575+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4ccc004a70 con 0x7f4cd81617a0 2026-02-24T19:17:55.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.575+0000 7f4cc67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.575+0000 7f4cc67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.575+0000 7f4cc67fc640 10 monclient: dump: 2026-02-24T19:17:55.578 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.578 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.578 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.579 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.579 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.579 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.579 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.579 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.579 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.579 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.575+0000 7f4cc7fff640 4 set_mon_vals no callback set 2026-02-24T19:17:55.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.575+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f4ccc004c50 con 0x7f4cd81617a0 2026-02-24T19:17:55.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.576+0000 7f4cddb88640 10 monclient: get_auth_request con 0x7f4cac077d60 auth_method 0 2026-02-24T19:17:55.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.576+0000 7f4cc67fc640 10 client.4566.objecter ms_handle_connect 0x7f4cac077d60 2026-02-24T19:17:55.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.578+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f4ccc0931d0 con 0x7f4cd81617a0 2026-02-24T19:17:55.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.578+0000 7f4cc67fc640 10 client.4566.objecter ms_dispatch2 0x7f4cd8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:55.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.578+0000 7f4cc67fc640 3 client.4566.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:55.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.578+0000 7f4cc67fc640 3 client.4566.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:55.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.578+0000 7f4cc67fc640 20 client.4566.objecter dump_active .. 0 homeless 2026-02-24T19:17:55.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.578+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4cd8053640 con 0x7f4cd81617a0 2026-02-24T19:17:55.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.578+0000 7f4cc67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.578+0000 7f4cc67fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:55.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.12 2026-02-24T19:17:55.585 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:55.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.584+0000 7ffb5a7fc640 10 client.?.objecter ms_handle_connect 0x7ffb6c165880 2026-02-24T19:17:55.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.584+0000 7ffb5a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.585+0000 7f6af3fff640 10 client.?.objecter ms_handle_connect 0x7f6b181667e0 2026-02-24T19:17:55.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.585+0000 7f6af3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.585+0000 7f3bb67fc640 10 client.?.objecter ms_handle_connect 0x7f3bc8164d00 2026-02-24T19:17:55.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.585+0000 7f3bb67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:55.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.588+0000 7f6b82ffd640 1 -- 10.20.193.45:0/1406871453 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1257367751) 0x7f6b9805ceb0 con 0x7f6b9c0ba350 2026-02-24T19:17:55.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.588+0000 7f6b82ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:17:55.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.588+0000 7f6b82ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.591 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:55.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3977404733 0 0) 0x7f6b1811fea0 con 0x7f6b181667e0 2026-02-24T19:17:55.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f6af3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f6af3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f6af3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f6af3fff640 10 monclient(hunting): my global_id is 4593 2026-02-24T19:17:55.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ae8003610 con 0x7f6b181667e0 2026-02-24T19:17:55.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987265772 0 0) 0x7ffb6c0b6d90 con 0x7ffb6c165880 2026-02-24T19:17:55.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7ffb5a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7ffb5a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7ffb5a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7ffb5a7fc640 10 monclient(hunting): my global_id is 4590 2026-02-24T19:17:55.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb3c003610 con 0x7ffb6c165880 2026-02-24T19:17:55.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474032467 0 0) 0x7f3bc8055b20 con 0x7f3bc8164d00 2026-02-24T19:17:55.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f3bb67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:55.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f3bb67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:55.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f3bb67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:55.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f3bb67fc640 10 monclient(hunting): my global_id is 4596 2026-02-24T19:17:55.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.589+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bc80ae690 con 0x7f3bc8164d00 2026-02-24T19:17:55.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 10 librados: watch_flush enter 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 10 librados: watch_flush exit 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 20 client.4569.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 10 client.4569.objecter successfully canceled tick 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6b6c077d90 legacy=0x7f6b6c098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 10 monclient: shutdown 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 >> v1:10.20.193.45:6789/0 conn(0x7f6b9c0ba350 legacy=0x7f6b9c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 shutdown_connections 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 >> 10.20.193.45:0/1406871453 conn(0x7f6b9c0b7990 msgr2=0x7f6b9c15adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 shutdown_connections 2026-02-24T19:17:55.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 1 -- 10.20.193.45:0/1406871453 wait complete. 2026-02-24T19:17:55.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.591+0000 7f6ba45c3640 1 librados: shutdown 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.594+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 230509261 0 0) 0x7f6ae8003610 con 0x7f6b181667e0 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.594+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b1811fea0 con 0x7f6b181667e0 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.594+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6b0c003300 con 0x7f6b181667e0 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.594+0000 7f6af3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.594+0000 7f6af3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.594+0000 7f6af3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.598 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.599 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.599 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.599 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.599 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.599 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.597+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2813143259 0 0) 0x7ffb3c003610 con 0x7ffb6c165880 2026-02-24T19:17:55.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.597+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb6c0b6d90 con 0x7ffb6c165880 2026-02-24T19:17:55.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.597+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffb68003710 con 0x7ffb6c165880 2026-02-24T19:17:55.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.597+0000 7ffb5a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:55.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.597+0000 7ffb5a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.597+0000 7ffb5a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.601 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.598+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3898312163 0 0) 0x7f3bc80ae690 con 0x7f3bc8164d00 2026-02-24T19:17:55.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.598+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3bc8055b20 con 0x7f3bc8164d00 2026-02-24T19:17:55.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.598+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3bc4003370 con 0x7f3bc8164d00 2026-02-24T19:17:55.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.598+0000 7f3bb67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:55.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.598+0000 7f3bb67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:55.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.598+0000 7f3bb67fc640 10 monclient(hunting): dump: 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.598+0000 7f3bb67fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3781642535 0 0) 0x7f6b1811fea0 con 0x7f6b181667e0 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 >> v1:10.20.193.179:6789/0 conn(0x7f6b1815d610 legacy=0x7f6b180b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 >> v1:10.20.193.114:6789/0 conn(0x7f6b18056ea0 legacy=0x7f6b181655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 1 monclient: found mon.a 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b18120740 con 0x7f6b181667e0 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6af3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6b1de82640 5 monclient: authenticate success, global_id 4593 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6b1de82640 10 monclient: _renew_subs 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6b1de82640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6b18165cc0 con 0x7f6b181667e0 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6b1de82640 10 client.4593.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6b1de82640 10 monclient: _renew_subs 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6b1de82640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6b180b6d70 con 0x7f6b181667e0 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.599+0000 7f6b1de82640 1 librados: init done 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.600+0000 7f6b1de82640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.600+0000 7f6b1de82640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.600+0000 7f6b1de82640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.600+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b180b8b70 con 0x7f6b181667e0 2026-02-24T19:17:55.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.5 2026-02-24T19:17:55.608 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:55.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.638+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f8e98093460 con 0x7f8ea40b9f80 2026-02-24T19:17:55.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.638+0000 7f8e927fc640 10 client.4586.objecter ms_dispatch2 0x7f8ea4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:55.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.638+0000 7f8e927fc640 3 client.4586.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:55.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.638+0000 7f8e927fc640 3 client.4586.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:55.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.638+0000 7f8e927fc640 20 client.4586.objecter dump_active .. 0 homeless 2026-02-24T19:17:55.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.641+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8e9805de90 con 0x7f8ea40b9f80 2026-02-24T19:17:55.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.641+0000 7f8e927fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.641+0000 7f8e927fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:55.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.647+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54100034a0 con 0x7f5420157b50 2026-02-24T19:17:55.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.647+0000 7f541cff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.647+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5410003b90 con 0x7f5420157b50 2026-02-24T19:17:55.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.647+0000 7f541cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.647+0000 7f541cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.647+0000 7f541e7fc640 4 set_mon_vals no callback set 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.647+0000 7f541cff9640 10 monclient: dump: 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.651 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.652 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.648+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f5410003d70 con 0x7f5420157b50 2026-02-24T19:17:55.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.649+0000 7f541ffff640 10 monclient: get_auth_request con 0x7f53f0077c60 auth_method 0 2026-02-24T19:17:55.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.649+0000 7f541cff9640 10 client.4589.objecter ms_handle_connect 0x7f53f0077c60 2026-02-24T19:17:55.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.651+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f5410093400 con 0x7f5420157b50 2026-02-24T19:17:55.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.651+0000 7f541cff9640 10 client.4589.objecter ms_dispatch2 0x7f5420000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:55.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.651+0000 7f541cff9640 3 client.4589.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:55.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.651+0000 7f541cff9640 3 client.4589.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:55.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.651+0000 7f541cff9640 20 client.4589.objecter dump_active .. 0 homeless 2026-02-24T19:17:55.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.653+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f541005de30 con 0x7f5420157b50 2026-02-24T19:17:55.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.653+0000 7f541cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.653+0000 7f541cff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:55.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.661+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3332986128 0 0) 0x7f3b98003610 con 0x7f3bc8157b50 2026-02-24T19:17:55.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.661+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3bc80ae690 con 0x7f3bc8157b50 2026-02-24T19:17:55.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.661+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3bbc003310 con 0x7f3bc8157b50 2026-02-24T19:17:55.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.661+0000 7f3bb67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:55.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.661+0000 7f3bb67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:55.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.661+0000 7f3bb67fc640 10 monclient(hunting): dump: 2026-02-24T19:17:55.664 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.665 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.665 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.665 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.665 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.665 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.665 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.665 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.665 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.665 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.690+0000 7f4cdfe13640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:17:55.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.690+0000 7f4cdfe13640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:17:55.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.690+0000 7f4cdfe13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.690+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f4cd80b5170 con 0x7f4cd81617a0 2026-02-24T19:17:55.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.728+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1726464326 0 0) 0x7f3bc8055b20 con 0x7f3bc8164d00 2026-02-24T19:17:55.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.728+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 >> v1:10.20.193.179:6789/0 conn(0x7f3bc8157b50 legacy=0x7f3bc80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.728+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 >> v1:10.20.193.114:6789/0 conn(0x7f3bc8157780 legacy=0x7f3bc8156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.728+0000 7f3bb67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.728+0000 7f3bb67fc640 1 monclient: found mon.a 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.728+0000 7f3bb67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bb67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc80ae970 con 0x7f3bc8164d00 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bb67fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bb67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bb67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 5 monclient: authenticate success, global_id 4596 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 10 monclient: _renew_subs 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc80aec50 con 0x7f3bc8164d00 2026-02-24T19:17:55.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 10 client.4596.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:55.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 10 monclient: _renew_subs 2026-02-24T19:17:55.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3bc80af210 con 0x7f3bc8164d00 2026-02-24T19:17:55.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 1 librados: init done 2026-02-24T19:17:55.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc80b5870 con 0x7f3bc8164d00 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.729+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3408806261 0 0) 0x7ffb6c0b6d90 con 0x7ffb6c165880 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 >> v1:10.20.193.179:6789/0 conn(0x7ffb6c056090 legacy=0x7ffb6c1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 >> v1:10.20.193.114:6789/0 conn(0x7ffb6c159da0 legacy=0x7ffb6c1fc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 1 monclient: found mon.a 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c1fcec0 con 0x7ffb6c165880 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:55.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 5 monclient: authenticate success, global_id 4590 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 10 monclient: _renew_subs 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c1fd1a0 con 0x7ffb6c165880 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 10 client.4590.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 10 monclient: _renew_subs 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffb6c1fd760 con 0x7ffb6c165880 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 1 librados: init done 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.730+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6c0565c0 con 0x7ffb6c165880 2026-02-24T19:17:55.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.735+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b0c0038b0 con 0x7f6b181667e0 2026-02-24T19:17:55.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.735+0000 7f6af3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.735+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6b0c003c20 con 0x7f6b181667e0 2026-02-24T19:17:55.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.735+0000 7f6af3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.735+0000 7f6af3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.735+0000 7f6b15ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.735+0000 7f6af3fff640 10 monclient: dump: 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.739 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.740 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.735+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f6b0c01ca90 con 0x7f6b181667e0 2026-02-24T19:17:55.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.736+0000 7f6b177fe640 10 monclient: get_auth_request con 0x7f6ae8077cb0 auth_method 0 2026-02-24T19:17:55.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.736+0000 7f6af3fff640 10 client.4593.objecter ms_handle_connect 0x7f6ae8077cb0 2026-02-24T19:17:55.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.741+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f6b0c0923e0 con 0x7f6b181667e0 2026-02-24T19:17:55.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.741+0000 7f6af3fff640 10 client.4593.objecter ms_dispatch2 0x7f6b18000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:55.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.741+0000 7f6af3fff640 3 client.4593.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:55.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.741+0000 7f6af3fff640 3 client.4593.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:55.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.741+0000 7f6af3fff640 20 client.4593.objecter dump_active .. 0 homeless 2026-02-24T19:17:55.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.741+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6b0c05ce10 con 0x7f6b181667e0 2026-02-24T19:17:55.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.741+0000 7f6af3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:55.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.741+0000 7f6af3fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:55.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.747+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb68002d30 con 0x7ffb6c165880 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.747+0000 7ffb5a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.747+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffb68003dd0 con 0x7ffb6c165880 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.747+0000 7ffb5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.747+0000 7ffb5a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.747+0000 7ffb5a7fc640 10 monclient: dump: 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:55.751 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:55.752 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:55.752 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:55.752 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:55.752 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:55.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.747+0000 7ffb5bfff640 4 set_mon_vals no callback set 2026-02-24T19:17:55.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.750+0000 7f4cc67fc640 1 -- 10.20.193.45:0/2592963914 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 1257367751) 0x7f4cd80b5170 con 0x7f4cd81617a0 2026-02-24T19:17:55.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.750+0000 7f4cc67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:17:55.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.750+0000 7f4cc67fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.753 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:55.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.750+0000 7f8eabb02640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:55.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.750+0000 7f8eabb02640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:55.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.750+0000 7f8eabb02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.750+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8ea40b94f0 con 0x7f8ea40b9f80 2026-02-24T19:17:55.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 10 librados: watch_flush enter 2026-02-24T19:17:55.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 10 librados: watch_flush exit 2026-02-24T19:17:55.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 20 client.4566.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 10 client.4566.objecter successfully canceled tick 2026-02-24T19:17:55.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 >> v1:10.20.193.45:6800/1599977652 conn(0x7f4cac077d60 legacy=0x7f4cac098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 10 monclient: shutdown 2026-02-24T19:17:55.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 >> v1:10.20.193.45:6789/0 conn(0x7f4cd81617a0 legacy=0x7f4cd82032b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 shutdown_connections 2026-02-24T19:17:55.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 >> 10.20.193.45:0/2592963914 conn(0x7f4cd80b8c00 msgr2=0x7f4cd80ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 shutdown_connections 2026-02-24T19:17:55.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 1 -- 10.20.193.45:0/2592963914 wait complete. 2026-02-24T19:17:55.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.752+0000 7f4cdfe13640 1 librados: shutdown 2026-02-24T19:17:55.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.753+0000 7f8e927fc640 1 -- 10.20.193.45:0/2820526200 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 1498640560) 0x7f8e9805d790 con 0x7f8ea40b9f80 2026-02-24T19:17:55.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.753+0000 7f8e927fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:17:55.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.753+0000 7f8e927fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.758 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:55.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.755+0000 7f8eabb02640 10 librados: watch_flush enter 2026-02-24T19:17:55.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.755+0000 7f8eabb02640 10 librados: watch_flush exit 2026-02-24T19:17:55.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 20 client.4586.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 10 client.4586.objecter successfully canceled tick 2026-02-24T19:17:55.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 >> v1:10.20.193.45:6800/1599977652 conn(0x7f8e74077cc0 legacy=0x7f8e74098170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 10 monclient: shutdown 2026-02-24T19:17:55.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 >> v1:10.20.193.179:6789/0 conn(0x7f8ea40b9f80 legacy=0x7f8ea41fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 shutdown_connections 2026-02-24T19:17:55.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 >> 10.20.193.45:0/2820526200 conn(0x7f8ea40b7990 msgr2=0x7f8ea40b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 shutdown_connections 2026-02-24T19:17:55.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 1 -- 10.20.193.45:0/2820526200 wait complete. 2026-02-24T19:17:55.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.756+0000 7f8eabb02640 1 librados: shutdown 2026-02-24T19:17:55.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.759+0000 7f5426799640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:55.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.759+0000 7f5426799640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:55.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.759+0000 7f5426799640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:55.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.759+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f542005bab0 con 0x7f5420157b50 2026-02-24T19:17:55.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.9 2026-02-24T19:17:55.765 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:55.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.0 2026-02-24T19:17:55.768 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:55.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.784+0000 7f541cff9640 1 -- 10.20.193.45:0/3109668220 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 213165853) 0x7f541005d730 con 0x7f5420157b50 2026-02-24T19:17:55.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.784+0000 7f541cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:17:55.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.784+0000 7f541cff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:55.787 INFO:teuthology.orchestra.run.trial045.stdout:94489280517 2026-02-24T19:17:55.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 10 librados: watch_flush enter 2026-02-24T19:17:55.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 10 librados: watch_flush exit 2026-02-24T19:17:55.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 20 client.4589.objecter shutdown clearing up homeless session... 2026-02-24T19:17:55.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 10 client.4589.objecter successfully canceled tick 2026-02-24T19:17:55.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 >> v1:10.20.193.45:6800/1599977652 conn(0x7f53f0077c60 legacy=0x7f53f0098110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 10 monclient: shutdown 2026-02-24T19:17:55.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:55.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 >> v1:10.20.193.179:6789/0 conn(0x7f5420157b50 legacy=0x7f542005bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:55.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 shutdown_connections 2026-02-24T19:17:55.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 >> 10.20.193.45:0/3109668220 conn(0x7f54200b2ef0 msgr2=0x7f54200b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:55.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 shutdown_connections 2026-02-24T19:17:55.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 1 -- 10.20.193.45:0/3109668220 wait complete. 2026-02-24T19:17:55.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.786+0000 7f5426799640 1 librados: shutdown 2026-02-24T19:17:55.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.791+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7ffb6801cc40 con 0x7ffb6c165880 2026-02-24T19:17:55.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.791+0000 7ffb71cc1640 10 monclient: get_auth_request con 0x7ffb3c077c50 auth_method 0 2026-02-24T19:17:55.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.791+0000 7ffb5a7fc640 10 client.4590.objecter ms_handle_connect 0x7ffb3c077c50 2026-02-24T19:17:55.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.11 2026-02-24T19:17:55.798 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:55.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.849+0000 7f6b1de82640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:55.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.849+0000 7f6b1de82640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:55.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.849+0000 7f6b1de82640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:55.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:55.849+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6b180b8890 con 0x7f6b181667e0 2026-02-24T19:17:55.949 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-24T19:17:56.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.015+0000 7faa0be5b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:56.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.015+0000 7faa0be5b640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.015+0000 7faa0be5b640 10 monclient: monmap: 2026-02-24T19:17:56.018 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.019 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.019 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:56.016644+0000 2026-02-24T19:17:56.019 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:56.016644+0000 2026-02-24T19:17:56.019 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.019 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.019 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.019 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.019 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.019 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 1 Processor -- start 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 1 -- start start 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 10 monclient: init 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 10 monclient(hunting): picked mon.noname-a con 0x7faa04157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 10 monclient(hunting): picked mon.noname-c con 0x7faa04157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 10 monclient(hunting): picked mon.noname-b con 0x7faa04164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0405de70 con 0x7faa04157780 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa04055b20 con 0x7faa04164d00 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa04055e00 con 0x7faa04157b50 2026-02-24T19:17:56.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.016+0000 7faa0be5b640 10 monclient(hunting): authenticate will time out at 3647.655704s 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.017+0000 7faa0a3d1640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7faa04164d00 0x7faa041c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49320/0 (socket says 10.20.193.45:49320) 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.017+0000 7faa0a3d1640 1 -- 10.20.193.45:0/858499613 learned_addr learned my addr 10.20.193.45:0/858499613 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350489946 0 0) 0x7faa04055e00 con 0x7faa04157b50 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 10 monclient(hunting): my global_id is 4601 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9ec003610 con 0x7faa04157b50 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731783035 0 0) 0x7faa04055b20 con 0x7faa04164d00 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 10 monclient(hunting): my global_id is 4561 2026-02-24T19:17:56.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.018+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa04055e00 con 0x7faa04164d00 2026-02-24T19:17:56.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 991290339 0 0) 0x7fa9ec003610 con 0x7faa04157b50 2026-02-24T19:17:56.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 >> v1:10.20.193.114:6789/0 conn(0x7faa04164d00 legacy=0x7faa041c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 >> v1:10.20.193.45:6789/0 conn(0x7faa04157780 legacy=0x7faa04056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 1 monclient: found mon.noname-c 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa040560e0 con 0x7faa04157b50 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa9f8002df0 con 0x7faa04157b50 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa08bce640 10 monclient: dump: 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa0be5b640 5 monclient: authenticate success, global_id 4601 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.020+0000 7faa0be5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9f8003000 con 0x7faa04157b50 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa08bce640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa08bce640 1 -- 10.20.193.45:0/858499613 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa9f8003440 con 0x7faa04157b50 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa08bce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa08bce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa08bce640 10 monclient: dump: 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 4 set_mon_vals no callback set 2026-02-24T19:17:56.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 10 monclient: shutdown 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 1 -- 10.20.193.45:0/858499613 >> v1:10.20.193.179:6789/0 conn(0x7faa04157b50 legacy=0x7faa041645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 1 -- 10.20.193.45:0/858499613 shutdown_connections 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 1 -- 10.20.193.45:0/858499613 >> 10.20.193.45:0/858499613 conn(0x7faa040b2ef0 msgr2=0x7faa040b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 1 -- 10.20.193.45:0/858499613 shutdown_connections 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 1 -- 10.20.193.45:0/858499613 wait complete. 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.021+0000 7faa0be5b640 10 monclient: monmap: 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 1 librados: starting msgr at 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 1 librados: starting objecter 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 1 Processor -- start 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 1 -- start start 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 1 librados: setting wanted keys 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 1 librados: calling monclient init 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 10 monclient: init 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 10 monclient(hunting): picked mon.noname-c con 0x7faa04157780 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 10 monclient(hunting): picked mon.noname-a con 0x7faa04157b50 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 10 monclient(hunting): picked mon.noname-b con 0x7faa04164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0412d630 con 0x7faa04157b50 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa040a2c50 con 0x7faa04164d00 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0412cd90 con 0x7faa04157780 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0be5b640 10 monclient(hunting): authenticate will time out at 3647.661485s 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0a3d1640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7faa04164d00 0x7faa0415a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49326/0 (socket says 10.20.193.45:49326) 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.022+0000 7faa0a3d1640 1 -- 10.20.193.45:0/373588492 learned_addr learned my addr 10.20.193.45:0/373588492 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 10 client.?.objecter ms_handle_connect 0x7faa04157780 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 10 client.?.objecter ms_handle_connect 0x7faa04164d00 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598096881 0 0) 0x7faa0412cd90 con 0x7faa04157780 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 10 monclient(hunting): my global_id is 4604 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.023+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9d4003610 con 0x7faa04157780 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.024+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70012691 0 0) 0x7faa040a2c50 con 0x7faa04164d00 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.024+0000 7fa9f27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.024+0000 7fa9f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.024+0000 7fa9f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.024+0000 7fa9f27fc640 10 monclient(hunting): my global_id is 4564 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.024+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa0412cd90 con 0x7faa04164d00 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 397704425 0 0) 0x7fa9d4003610 con 0x7faa04157780 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa040a2c50 con 0x7faa04157780 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa9f4002f70 con 0x7faa04157780 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 10 monclient(hunting): dump: 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 123352071 0 0) 0x7faa0412cd90 con 0x7faa04164d00 2026-02-24T19:17:56.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa9d4003610 con 0x7faa04164d00 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7faa00003370 con 0x7faa04164d00 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.026+0000 7fa9f27fc640 10 monclient(hunting): dump: 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2562454806 0 0) 0x7faa040a2c50 con 0x7faa04157780 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 >> v1:10.20.193.114:6789/0 conn(0x7faa04164d00 legacy=0x7faa0415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 >> v1:10.20.193.45:6789/0 conn(0x7faa04157b50 legacy=0x7faa040a2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 1 monclient: found mon.c 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0412d070 con 0x7faa04157780 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7fa9f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 5 monclient: authenticate success, global_id 4604 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 10 monclient: _renew_subs 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faa0412d350 con 0x7faa04157780 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 10 client.4604.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 10 monclient: _renew_subs 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faa04129570 con 0x7faa04157780 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 1 librados: init done 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.028+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa04129790 con 0x7faa04157780 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.033+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9f40035f0 con 0x7faa04157780 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.033+0000 7fa9f27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.033+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa9f4003940 con 0x7faa04157780 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.033+0000 7fa9f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.033+0000 7fa9f27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.033+0000 7fa9f27fc640 10 monclient: dump: 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.035 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.036 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.036 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.036 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.036 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.033+0000 7fa9f3fff640 4 set_mon_vals no callback set 2026-02-24T19:17:56.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.036+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fa9f401c7b0 con 0x7faa04157780 2026-02-24T19:17:56.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.036+0000 7faa093cf640 10 monclient: get_auth_request con 0x7fa9d4077bf0 auth_method 0 2026-02-24T19:17:56.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.037+0000 7fa9f27fc640 10 client.4604.objecter ms_handle_connect 0x7fa9d4077bf0 2026-02-24T19:17:56.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.037+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fa9f40920e0 con 0x7faa04157780 2026-02-24T19:17:56.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.037+0000 7fa9f27fc640 10 client.4604.objecter ms_dispatch2 0x7faa04000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:56.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.037+0000 7fa9f27fc640 3 client.4604.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:56.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.037+0000 7fa9f27fc640 3 client.4604.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:56.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.037+0000 7fa9f27fc640 20 client.4604.objecter dump_active .. 0 homeless 2026-02-24T19:17:56.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.043+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7ffb68092590 con 0x7ffb6c165880 2026-02-24T19:17:56.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.043+0000 7ffb5a7fc640 10 client.4590.objecter ms_dispatch2 0x7ffb6c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:56.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.043+0000 7ffb5a7fc640 3 client.4590.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:56.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.043+0000 7ffb5a7fc640 3 client.4590.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:56.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.043+0000 7ffb5a7fc640 20 client.4590.objecter dump_active .. 0 homeless 2026-02-24T19:17:56.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.043+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ffb6805cfc0 con 0x7ffb6c165880 2026-02-24T19:17:56.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.043+0000 7ffb5a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.043+0000 7ffb5a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:56.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.054+0000 7f6af3fff640 1 -- 10.20.193.45:0/1395509219 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1257367751) 0x7f6b0c05c710 con 0x7f6b181667e0 2026-02-24T19:17:56.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.054+0000 7f6af3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:17:56.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.054+0000 7f6af3fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:56.057 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:56.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 10 librados: watch_flush enter 2026-02-24T19:17:56.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 10 librados: watch_flush exit 2026-02-24T19:17:56.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 20 client.4593.objecter shutdown clearing up homeless session... 2026-02-24T19:17:56.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 10 client.4593.objecter successfully canceled tick 2026-02-24T19:17:56.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6ae8077cb0 legacy=0x7f6ae8098160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 10 monclient: shutdown 2026-02-24T19:17:56.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 >> v1:10.20.193.45:6789/0 conn(0x7f6b181667e0 legacy=0x7f6b180b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 shutdown_connections 2026-02-24T19:17:56.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 >> 10.20.193.45:0/1395509219 conn(0x7f6b180b7470 msgr2=0x7f6b1815ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 shutdown_connections 2026-02-24T19:17:56.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.056+0000 7f6b1de82640 1 -- 10.20.193.45:0/1395509219 wait complete. 2026-02-24T19:17:56.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.057+0000 7f6b1de82640 1 librados: shutdown 2026-02-24T19:17:56.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.4 2026-02-24T19:17:56.069 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:56.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.078+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3bc4004c50 con 0x7f3bc8164d00 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.078+0000 7f3bb67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.078+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3bc4004fa0 con 0x7f3bc8164d00 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.078+0000 7f3bb67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.078+0000 7f3bb67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.078+0000 7f3bb67fc640 10 monclient: dump: 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.082 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.083 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.083 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.083 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.083 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.083 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.078+0000 7f3bb7fff640 4 set_mon_vals no callback set 2026-02-24T19:17:56.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.079+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f3bc401de10 con 0x7f3bc8164d00 2026-02-24T19:17:56.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.079+0000 7f3bcdd07640 10 monclient: get_auth_request con 0x7f3b98077c20 auth_method 0 2026-02-24T19:17:56.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.079+0000 7f3bb67fc640 10 client.4596.objecter ms_handle_connect 0x7f3b98077c20 2026-02-24T19:17:56.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.082+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f3bc40935e0 con 0x7f3bc8164d00 2026-02-24T19:17:56.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.082+0000 7f3bb67fc640 10 client.4596.objecter ms_dispatch2 0x7f3bc8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.082+0000 7f3bb67fc640 3 client.4596.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.082+0000 7f3bb67fc640 3 client.4596.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.082+0000 7f3bb67fc640 20 client.4596.objecter dump_active .. 0 homeless 2026-02-24T19:17:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.082+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f3bc80a83d0 con 0x7f3bc8164d00 2026-02-24T19:17:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.082+0000 7f3bb67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.082+0000 7f3bb67fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:56.097 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-24T19:17:56.118 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-24T19:17:56.119 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-24T19:17:56.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.124+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7faa04129790 con 0x7faa04157780 2026-02-24T19:17:56.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.124+0000 7fa9f27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.124+0000 7fa9f27fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:56.153 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-24T19:17:56.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.150+0000 7ffb73f4c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:56.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.150+0000 7ffb73f4c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:56.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.150+0000 7ffb73f4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:56.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.150+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ffb6c055b00 con 0x7ffb6c165880 2026-02-24T19:17:56.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.155+0000 7ffb5a7fc640 1 -- 10.20.193.45:0/3676775112 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 1498640560) 0x7ffb6805c8c0 con 0x7ffb6c165880 2026-02-24T19:17:56.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.155+0000 7ffb5a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:17:56.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.155+0000 7ffb5a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:56.158 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:56.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 10 librados: watch_flush enter 2026-02-24T19:17:56.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 10 librados: watch_flush exit 2026-02-24T19:17:56.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 20 client.4590.objecter shutdown clearing up homeless session... 2026-02-24T19:17:56.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 10 client.4590.objecter successfully canceled tick 2026-02-24T19:17:56.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 >> v1:10.20.193.45:6800/1599977652 conn(0x7ffb3c077c50 legacy=0x7ffb3c098100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 10 monclient: shutdown 2026-02-24T19:17:56.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 >> v1:10.20.193.45:6789/0 conn(0x7ffb6c165880 legacy=0x7ffb6c0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 shutdown_connections 2026-02-24T19:17:56.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.157+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 >> 10.20.193.45:0/3676775112 conn(0x7ffb6c0b78c0 msgr2=0x7ffb6c154660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.158+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 shutdown_connections 2026-02-24T19:17:56.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.158+0000 7ffb73f4c640 1 -- 10.20.193.45:0/3676775112 wait complete. 2026-02-24T19:17:56.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.158+0000 7ffb73f4c640 1 librados: shutdown 2026-02-24T19:17:56.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.162+0000 7f44b81b1640 10 monclient: get_monmap_and_config 2026-02-24T19:17:56.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.162+0000 7f44b81b1640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.162+0000 7f44b81b1640 10 monclient: monmap: 2026-02-24T19:17:56.165 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.165 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.165 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:56.163415+0000 2026-02-24T19:17:56.165 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:56.163415+0000 2026-02-24T19:17:56.165 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.166 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.166 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.166 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.166 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.166 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.162+0000 7f44b81b1640 1 Processor -- start 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.162+0000 7f44b81b1640 1 -- start start 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.162+0000 7f44b81b1640 10 monclient: init 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 10 monclient(hunting): picked mon.noname-c con 0x7f44b01594e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 10 monclient(hunting): picked mon.noname-b con 0x7f44b01598b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 10 monclient(hunting): picked mon.noname-a con 0x7f44b0161d60 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b00583c0 con 0x7f44b0161d60 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b00586a0 con 0x7f44b01598b0 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b0160b70 con 0x7f44b01594e0 2026-02-24T19:17:56.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.163+0000 7f44b81b1640 10 monclient(hunting): authenticate will time out at 3647.802774s 2026-02-24T19:17:56.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.164+0000 7f44b5725640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f44b01598b0 0x7f44b00b4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49342/0 (socket says 10.20.193.45:49342) 2026-02-24T19:17:56.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.164+0000 7f44b5725640 1 -- 10.20.193.45:0/630186363 learned_addr learned my addr 10.20.193.45:0/630186363 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2337706180 0 0) 0x7f44b0160b70 con 0x7f44b01594e0 2026-02-24T19:17:56.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): my global_id is 4607 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4498004760 con 0x7f44b01594e0 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1170087825 0 0) 0x7f44b00583c0 con 0x7f44b0161d60 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): my global_id is 4599 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b0160b70 con 0x7f44b0161d60 2026-02-24T19:17:56.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 205677778 0 0) 0x7f44b00586a0 con 0x7f44b01598b0 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 10 monclient(hunting): my global_id is 4567 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.165+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b00583c0 con 0x7f44b01598b0 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3093077787 0 0) 0x7f4498004760 con 0x7f44b01594e0 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 >> v1:10.20.193.114:6789/0 conn(0x7f44b01598b0 legacy=0x7f44b00b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 >> v1:10.20.193.45:6789/0 conn(0x7f44b0161d60 legacy=0x7f44b01c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 1 monclient: found mon.noname-c 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b0160e50 con 0x7f44b01594e0 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f44a0002df0 con 0x7f44b01594e0 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b4f24640 10 monclient: dump: 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.173 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.174 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.174 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.174 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.174 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b81b1640 5 monclient: authenticate success, global_id 4607 2026-02-24T19:17:56.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.167+0000 7f44b81b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:56.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.2 2026-02-24T19:17:56.176 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:56.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44a0002fc0 con 0x7f44b01594e0 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b4f24640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b4f24640 1 -- 10.20.193.45:0/630186363 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f44a0003400 con 0x7f44b01594e0 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b4f24640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b4f24640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b4f24640 10 monclient: dump: 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.181 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b81b1640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b81b1640 4 set_mon_vals no callback set 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b81b1640 10 monclient: shutdown 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b81b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b81b1640 1 -- 10.20.193.45:0/630186363 >> v1:10.20.193.179:6789/0 conn(0x7f44b01594e0 legacy=0x7f44b0161650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b81b1640 1 -- 10.20.193.45:0/630186363 shutdown_connections 2026-02-24T19:17:56.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b81b1640 1 -- 10.20.193.45:0/630186363 >> 10.20.193.45:0/630186363 conn(0x7f44b00b2ef0 msgr2=0x7f44b00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b81b1640 1 -- 10.20.193.45:0/630186363 shutdown_connections 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.168+0000 7f44b81b1640 1 -- 10.20.193.45:0/630186363 wait complete. 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient: monmap: 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.183 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 1 librados: starting msgr at 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 1 librados: starting objecter 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 1 Processor -- start 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 1 -- start start 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 1 librados: setting wanted keys 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 1 librados: calling monclient init 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient: init 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:56.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient(hunting): picked mon.noname-c con 0x7f44b01594e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient(hunting): picked mon.noname-b con 0x7f44b01598b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient(hunting): picked mon.noname-a con 0x7f44b0161d60 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b005d0f0 con 0x7f44b0161d60 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b013d190 con 0x7f44b01598b0 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b013d470 con 0x7f44b01594e0 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.169+0000 7f44b81b1640 10 monclient(hunting): authenticate will time out at 3647.808876s 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.170+0000 7f44b5725640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f44b01598b0 0x7f44b005c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49350/0 (socket says 10.20.193.45:49350) 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.170+0000 7f44b5725640 1 -- 10.20.193.45:0/2270069031 learned_addr learned my addr 10.20.193.45:0/2270069031 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.170+0000 7f449e7fc640 10 client.?.objecter ms_handle_connect 0x7f44b01598b0 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.170+0000 7f449e7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.170+0000 7f449e7fc640 10 client.?.objecter ms_handle_connect 0x7f44b01594e0 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.170+0000 7f449e7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.170+0000 7f449e7fc640 10 client.?.objecter ms_handle_connect 0x7f44b0161d60 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.170+0000 7f449e7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237472530 0 0) 0x7f44b013d470 con 0x7f44b01594e0 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): my global_id is 4610 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4480003610 con 0x7f44b01594e0 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895196741 0 0) 0x7f44b005d0f0 con 0x7f44b0161d60 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): my global_id is 4602 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b013d470 con 0x7f44b0161d60 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214685899 0 0) 0x7f44b013d190 con 0x7f44b01598b0 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 10 monclient(hunting): my global_id is 4570 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.171+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b005d0f0 con 0x7f44b01598b0 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.173+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3463757517 0 0) 0x7f4480003610 con 0x7f44b01594e0 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.173+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b013d190 con 0x7f44b01594e0 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.173+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f44a0003310 con 0x7f44b01594e0 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.173+0000 7f449e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.173+0000 7f449e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.173+0000 7f449e7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.173+0000 7f449e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:56.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1789322079 0 0) 0x7f44b005d0f0 con 0x7f44b01598b0 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4480003610 con 0x7f44b01598b0 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f44a4002fe0 con 0x7f44b01598b0 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.189 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3791903051 0 0) 0x7f44b013d470 con 0x7f44b0161d60 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b005d0f0 con 0x7f44b0161d60 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f44ac003260 con 0x7f44b0161d60 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.174+0000 7f449e7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.190 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2890589091 0 0) 0x7f44b013d190 con 0x7f44b01594e0 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 >> v1:10.20.193.114:6789/0 conn(0x7f44b01598b0 legacy=0x7f44b005c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 >> v1:10.20.193.45:6789/0 conn(0x7f44b0161d60 legacy=0x7f44b01299e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 1 monclient: found mon.c 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b013d750 con 0x7f44b01594e0 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f449e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f44b81b1640 5 monclient: authenticate success, global_id 4610 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f44b81b1640 10 monclient: _renew_subs 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f44b81b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44b013da30 con 0x7f44b01594e0 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f44b81b1640 10 client.4610.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f44b81b1640 10 monclient: _renew_subs 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f44b81b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f44b012a0f0 con 0x7f44b01594e0 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.175+0000 7f44b81b1640 1 librados: init done 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.176+0000 7f44b81b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.176+0000 7f44b81b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.176+0000 7f44b81b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.176+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b013e410 con 0x7f44b01594e0 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.181+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44a0002f80 con 0x7f44b01594e0 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.181+0000 7f449e7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.181+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f44a0003b00 con 0x7f44b01594e0 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.181+0000 7f449e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.181+0000 7f449e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.181+0000 7f449e7fc640 10 monclient: dump: 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.194 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.181+0000 7f449ffff640 4 set_mon_vals no callback set 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.184+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f44a001c7d0 con 0x7f44b01594e0 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.185+0000 7f44b5725640 10 monclient: get_auth_request con 0x7f4480077eb0 auth_method 0 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.185+0000 7f449e7fc640 10 client.4610.objecter ms_handle_connect 0x7f4480077eb0 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.185+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f44a0091fb0 con 0x7f44b01594e0 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.185+0000 7f449e7fc640 10 client.4610.objecter ms_dispatch2 0x7f44b0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.185+0000 7f449e7fc640 3 client.4610.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.185+0000 7f449e7fc640 3 client.4610.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:56.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.185+0000 7f449e7fc640 20 client.4610.objecter dump_active .. 0 homeless 2026-02-24T19:17:56.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.191+0000 7efbfd592640 10 monclient: get_monmap_and_config 2026-02-24T19:17:56.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.191+0000 7efbfd592640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.191+0000 7efbfd592640 10 monclient: monmap: 2026-02-24T19:17:56.196 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.196 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.196 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:56.192877+0000 2026-02-24T19:17:56.196 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:56.192877+0000 2026-02-24T19:17:56.196 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.196 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.197 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.197 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.197 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.197 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 1 Processor -- start 2026-02-24T19:17:56.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7fa30be6a640 10 monclient: get_monmap_and_config 2026-02-24T19:17:56.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7fa30be6a640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7fa30be6a640 10 monclient: monmap: 2026-02-24T19:17:56.197 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:56.193347+0000 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:56.193347+0000 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 1 -- start start 2026-02-24T19:17:56.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 10 monclient: init 2026-02-24T19:17:56.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7f3bcff92640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:56.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7f3bcff92640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:56.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7f3bcff92640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:56.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3bc80b5590 con 0x7f3bc8164d00 2026-02-24T19:17:56.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:56.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 10 monclient(hunting): picked mon.noname-a con 0x7efbf8157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 10 monclient(hunting): picked mon.noname-c con 0x7efbf8157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 10 monclient(hunting): picked mon.noname-b con 0x7efbf8164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf805de70 con 0x7efbf8157780 2026-02-24T19:17:56.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7fa30be6a640 1 Processor -- start 2026-02-24T19:17:56.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf8055b20 con 0x7efbf8164d00 2026-02-24T19:17:56.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf8055e00 con 0x7efbf8157b50 2026-02-24T19:17:56.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7efbfd592640 10 monclient(hunting): authenticate will time out at 3647.831873s 2026-02-24T19:17:56.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7fa30be6a640 1 -- start start 2026-02-24T19:17:56.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.192+0000 7fa30be6a640 10 monclient: init 2026-02-24T19:17:56.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7efbf77fe640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7efbf8164d00 0x7efbf81c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49356/0 (socket says 10.20.193.45:49356) 2026-02-24T19:17:56.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7efbf77fe640 1 -- 10.20.193.45:0/557285755 learned_addr learned my addr 10.20.193.45:0/557285755 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 10 monclient(hunting): picked mon.noname-c con 0x7fa30415d0d0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 10 monclient(hunting): picked mon.noname-a con 0x7fa3040b4b80 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 10 monclient(hunting): picked mon.noname-b con 0x7fa3040af470 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa30405b090 con 0x7fa3040b4b80 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa304163470 con 0x7fa3040af470 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa304163750 con 0x7fa30415d0d0 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.193+0000 7fa30be6a640 10 monclient(hunting): authenticate will time out at 3647.832515s 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.194+0000 7fa30a3e0640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fa3040af470 0x7fa3040b0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49358/0 (socket says 10.20.193.45:49358) 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.194+0000 7fa30a3e0640 1 -- 10.20.193.45:0/1018876508 learned_addr learned my addr 10.20.193.45:0/1018876508 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.194+0000 7efbf5ffb640 1 -- 10.20.193.45:0/557285755 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674793352 0 0) 0x7efbf8055b20 con 0x7efbf8164d00 2026-02-24T19:17:56.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.194+0000 7efbf5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.194+0000 7efbf5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.194+0000 7efbf5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.194+0000 7efbf5ffb640 10 monclient(hunting): my global_id is 4573 2026-02-24T19:17:56.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.194+0000 7efbf5ffb640 1 -- 10.20.193.45:0/557285755 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbe4003610 con 0x7efbf8164d00 2026-02-24T19:17:56.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7f3bb67fc640 1 -- 10.20.193.45:0/2898482222 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 1498640560) 0x7f3bc405e010 con 0x7f3bc8164d00 2026-02-24T19:17:56.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7f3bb67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:17:56.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7f3bb67fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:56.204 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:56.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 1 -- 10.20.193.45:0/557285755 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 847245125 0 0) 0x7efbe4003610 con 0x7efbf8164d00 2026-02-24T19:17:56.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 1 -- 10.20.193.45:0/557285755 >> v1:10.20.193.179:6789/0 conn(0x7efbf8157b50 legacy=0x7efbf81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:56.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 1 -- 10.20.193.45:0/557285755 >> v1:10.20.193.45:6789/0 conn(0x7efbf8157780 legacy=0x7efbf8056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 1 monclient: found mon.noname-b 2026-02-24T19:17:56.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 1 -- 10.20.193.45:0/557285755 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf80560e0 con 0x7efbf8164d00 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 1 -- 10.20.193.45:0/557285755 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7efbe8003170 con 0x7efbf8164d00 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbfd592640 5 monclient: authenticate success, global_id 4573 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbfd592640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbf5ffb640 10 monclient: dump: 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.206 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.196+0000 7efbfd592640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:56.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.197+0000 7fa308bdd640 1 -- 10.20.193.45:0/1018876508 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907102239 0 0) 0x7fa304163470 con 0x7fa3040af470 2026-02-24T19:17:56.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.197+0000 7fa308bdd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.197+0000 7fa308bdd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.197+0000 7fa308bdd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.197+0000 7fa308bdd640 10 monclient(hunting): my global_id is 4576 2026-02-24T19:17:56.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.197+0000 7fa308bdd640 1 -- 10.20.193.45:0/1018876508 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2ec003610 con 0x7fa3040af470 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbf5ffb640 1 -- 10.20.193.45:0/557285755 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efbe8003380 con 0x7efbf8164d00 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbf5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbf5ffb640 1 -- 10.20.193.45:0/557285755 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7efbe80037c0 con 0x7efbf8164d00 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbfd592640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbfd592640 4 set_mon_vals no callback set 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbf5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbf5ffb640 10 monclient: dump: 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.208 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbfd592640 10 monclient: shutdown 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbfd592640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbfd592640 1 -- 10.20.193.45:0/557285755 >> v1:10.20.193.114:6789/0 conn(0x7efbf8164d00 legacy=0x7efbf81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbfd592640 1 -- 10.20.193.45:0/557285755 shutdown_connections 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbfd592640 1 -- 10.20.193.45:0/557285755 >> 10.20.193.45:0/557285755 conn(0x7efbf80b2ef0 msgr2=0x7efbf80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbfd592640 1 -- 10.20.193.45:0/557285755 shutdown_connections 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 10 librados: watch_flush enter 2026-02-24T19:17:56.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7efbfd592640 1 -- 10.20.193.45:0/557285755 wait complete. 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 10 librados: watch_flush exit 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 20 client.4596.objecter shutdown clearing up homeless session... 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 10 client.4596.objecter successfully canceled tick 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 >> v1:10.20.193.45:6800/1599977652 conn(0x7f3b98077c20 legacy=0x7f3b980980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 10 monclient: shutdown 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 >> v1:10.20.193.45:6789/0 conn(0x7f3bc8164d00 legacy=0x7f3bc8147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 shutdown_connections 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 >> 10.20.193.45:0/2898482222 conn(0x7f3bc80b2ef0 msgr2=0x7f3bc80ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 shutdown_connections 2026-02-24T19:17:56.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 1 -- 10.20.193.45:0/2898482222 wait complete. 2026-02-24T19:17:56.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.198+0000 7f3bcff92640 1 librados: shutdown 2026-02-24T19:17:56.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient: monmap: 2026-02-24T19:17:56.211 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.211 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 1 librados: starting msgr at 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 1 librados: starting objecter 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 1 Processor -- start 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 1 -- start start 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 1 librados: setting wanted keys 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 1 librados: calling monclient init 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient: init 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient(hunting): picked mon.noname-c con 0x7efbf8157780 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient(hunting): picked mon.noname-b con 0x7efbf8157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient(hunting): picked mon.noname-a con 0x7efbf8164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf8157300 con 0x7efbf8164d00 2026-02-24T19:17:56.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf81396f0 con 0x7efbf8157b50 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf81399d0 con 0x7efbf8157780 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.199+0000 7efbfd592640 10 monclient(hunting): authenticate will time out at 3647.838793s 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 1 -- 10.20.193.45:0/1018876508 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 89309417 0 0) 0x7fa2ec003610 con 0x7fa3040af470 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 1 -- 10.20.193.45:0/1018876508 >> v1:10.20.193.179:6789/0 conn(0x7fa30415d0d0 legacy=0x7fa30415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 1 -- 10.20.193.45:0/1018876508 >> v1:10.20.193.45:6789/0 conn(0x7fa3040b4b80 legacy=0x7fa3040aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 1 monclient: found mon.noname-b 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 1 -- 10.20.193.45:0/1018876508 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa304163a30 con 0x7fa3040af470 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 1 -- 10.20.193.45:0/1018876508 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa300003170 con 0x7fa3040af470 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa308bdd640 10 monclient: dump: 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa30be6a640 5 monclient: authenticate success, global_id 4576 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7fa30be6a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7efbf67fc640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7efbf8157b50 0x7efbf8145580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49368/0 (socket says 10.20.193.45:49368) 2026-02-24T19:17:56.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.200+0000 7efbf67fc640 1 -- 10.20.193.45:0/160997922 learned_addr learned my addr 10.20.193.45:0/160997922 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7efbd77fe640 10 client.?.objecter ms_handle_connect 0x7efbf8157b50 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7efbd77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7fa308bdd640 1 -- 10.20.193.45:0/1018876508 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa300003380 con 0x7fa3040af470 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7fa308bdd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7fa308bdd640 1 -- 10.20.193.45:0/1018876508 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa3000037c0 con 0x7fa3040af470 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7fa308bdd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7fa308bdd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7fa308bdd640 10 monclient: dump: 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.215 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7fa30be6a640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.201+0000 7fa30be6a640 4 set_mon_vals no callback set 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7fa30be6a640 10 monclient: shutdown 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7fa30be6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7fa30be6a640 1 -- 10.20.193.45:0/1018876508 >> v1:10.20.193.114:6789/0 conn(0x7fa3040af470 legacy=0x7fa3040b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7fa30be6a640 1 -- 10.20.193.45:0/1018876508 shutdown_connections 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7fa30be6a640 1 -- 10.20.193.45:0/1018876508 >> 10.20.193.45:0/1018876508 conn(0x7fa3040b4070 msgr2=0x7fa3040b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7fa30be6a640 1 -- 10.20.193.45:0/1018876508 shutdown_connections 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7fa30be6a640 1 -- 10.20.193.45:0/1018876508 wait complete. 2026-02-24T19:17:56.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595921160 0 0) 0x7efbf81396f0 con 0x7efbf8157b50 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7efbd77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7efbd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7efbd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7efbd77fe640 10 monclient(hunting): my global_id is 4579 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbc4003610 con 0x7efbf8157b50 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7efbd77fe640 10 client.?.objecter ms_handle_connect 0x7efbf8164d00 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7efbd77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7fa30be6a640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.202+0000 7fa30be6a640 10 monclient: monmap: 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.217 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 1 librados: starting msgr at 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 1 librados: starting objecter 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 1 Processor -- start 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 1 -- start start 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 1 librados: setting wanted keys 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 1 librados: calling monclient init 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 10 monclient: init 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200364741 0 0) 0x7efbf8157300 con 0x7efbf8164d00 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7efbd77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7efbd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7efbd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7efbd77fe640 10 monclient(hunting): my global_id is 4611 2026-02-24T19:17:56.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbf81396f0 con 0x7efbf8164d00 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 10 monclient(hunting): picked mon.noname-b con 0x7fa3040af470 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 10 monclient(hunting): picked mon.noname-c con 0x7fa3040b4b80 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 10 monclient(hunting): picked mon.noname-a con 0x7fa30415d0d0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa304162030 con 0x7fa30415d0d0 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa304162310 con 0x7fa3040af470 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3041625f0 con 0x7fa3040b4b80 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.203+0000 7fa30be6a640 10 monclient(hunting): authenticate will time out at 3647.842898s 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.205+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2922491432 0 0) 0x7efbc4003610 con 0x7efbf8157b50 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.205+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efbf8157300 con 0x7efbf8157b50 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.205+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7efbe0002fd0 con 0x7efbf8157b50 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.205+0000 7efbd77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.205+0000 7efbd77fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.205+0000 7efbd77fe640 10 monclient(hunting): dump: 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.219 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.205+0000 7efbd77fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.205+0000 7fa309bdf640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fa3040af470 0x7fa30411ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49376/0 (socket says 10.20.193.45:49376) 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.205+0000 7fa309bdf640 1 -- 10.20.193.45:0/1654014496 learned_addr learned my addr 10.20.193.45:0/1654014496 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7fa2f27fc640 10 client.?.objecter ms_handle_connect 0x7fa3040af470 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7fa2f27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4209501832 0 0) 0x7efbf81396f0 con 0x7efbf8164d00 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efbc4003610 con 0x7efbf8164d00 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7efbe80036d0 con 0x7efbf8164d00 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7efbd77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7efbd77fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7efbd77fe640 10 monclient(hunting): dump: 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7fa2f27fc640 10 client.?.objecter ms_handle_connect 0x7fa30415d0d0 2026-02-24T19:17:56.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.206+0000 7fa2f27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.7 2026-02-24T19:17:56.222 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:56.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 610329331 0 0) 0x7efbf8157300 con 0x7efbf8157b50 2026-02-24T19:17:56.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 >> v1:10.20.193.179:6789/0 conn(0x7efbf8157780 legacy=0x7efbf8138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 >> v1:10.20.193.45:6789/0 conn(0x7efbf8164d00 legacy=0x7efbf81220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 1 monclient: found mon.b 2026-02-24T19:17:56.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf8139cb0 con 0x7efbf8157b50 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbd77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 5 monclient: authenticate success, global_id 4579 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 10 monclient: _renew_subs 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efbf8139f90 con 0x7efbf8157b50 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 10 client.4579.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 10 monclient: _renew_subs 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efbf813a550 con 0x7efbf8157b50 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 1 librados: init done 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478657282 0 0) 0x7fa304162310 con 0x7fa3040af470 2026-02-24T19:17:56.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbf80b4e50 con 0x7efbf8157b50 2026-02-24T19:17:56.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7fa2f27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7fa2f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7fa2f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7fa2f27fc640 10 monclient(hunting): my global_id is 4582 2026-02-24T19:17:56.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.208+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2d4003610 con 0x7fa3040af470 2026-02-24T19:17:56.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.209+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452873258 0 0) 0x7fa304162030 con 0x7fa30415d0d0 2026-02-24T19:17:56.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.209+0000 7fa2f27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.209+0000 7fa2f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.209+0000 7fa2f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.209+0000 7fa2f27fc640 10 monclient(hunting): my global_id is 4614 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.209+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa304162310 con 0x7fa30415d0d0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.213+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 522800885 0 0) 0x7fa304162310 con 0x7fa30415d0d0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.213+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa304162030 con 0x7fa30415d0d0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.213+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa300003530 con 0x7fa30415d0d0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.213+0000 7fa2f27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.213+0000 7fa2f27fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.213+0000 7fa2f27fc640 10 monclient(hunting): dump: 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.213+0000 7fa2f27fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3729811342 0 0) 0x7fa304162030 con 0x7fa30415d0d0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 >> v1:10.20.193.179:6789/0 conn(0x7fa3040b4b80 legacy=0x7fa304160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 >> v1:10.20.193.114:6789/0 conn(0x7fa3040af470 legacy=0x7fa30411ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 1 monclient: found mon.a 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3041628d0 con 0x7fa30415d0d0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa2f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 5 monclient: authenticate success, global_id 4614 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 10 monclient: _renew_subs 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa304162bb0 con 0x7fa30415d0d0 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 10 client.4614.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 10 monclient: _renew_subs 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3040b0fd0 con 0x7fa30415d0d0 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 1 librados: init done 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.215+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30415baf0 con 0x7fa30415d0d0 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.223+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa300003340 con 0x7fa30415d0d0 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.223+0000 7fa2f27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.223+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fa300005060 con 0x7fa30415d0d0 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.223+0000 7fa2f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.223+0000 7fa2f27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.223+0000 7fa2f3fff640 4 set_mon_vals no callback set 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.223+0000 7fa2f27fc640 10 monclient: dump: 2026-02-24T19:17:56.226 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.224+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fa30001ded0 con 0x7fa30415d0d0 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.224+0000 7fa309bdf640 10 monclient: get_auth_request con 0x7fa2d4077c70 auth_method 0 2026-02-24T19:17:56.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.225+0000 7fa2f27fc640 10 client.4614.objecter ms_handle_connect 0x7fa2d4077c70 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.225+0000 7f1389a55640 10 monclient: get_monmap_and_config 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.225+0000 7f1389a55640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.225+0000 7f1389a55640 10 monclient: monmap: 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:56.226633+0000 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:56.226633+0000 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.225+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fa300093630 con 0x7fa30415d0d0 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.225+0000 7fa2f27fc640 10 client.4614.objecter ms_dispatch2 0x7fa304000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.225+0000 7fa2f27fc640 3 client.4614.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.225+0000 7fa2f27fc640 3 client.4614.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7fa2f27fc640 20 client.4614.objecter dump_active .. 0 homeless 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 1 Processor -- start 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 1 -- start start 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 10 monclient: init 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 10 monclient(hunting): picked mon.noname-b con 0x7f138415d0c0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 10 monclient(hunting): picked mon.noname-c con 0x7f13840b0ca0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 10 monclient(hunting): picked mon.noname-a con 0x7f13840b28b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13840b8540 con 0x7f13840b28b0 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13840b5da0 con 0x7f138415d0c0 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13840b6080 con 0x7f13840b0ca0 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.226+0000 7f1389a55640 10 monclient(hunting): authenticate will time out at 3647.865615s 2026-02-24T19:17:56.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.238+0000 7faa0be5b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:56.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.238+0000 7faa0be5b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:56.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.238+0000 7faa0be5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.238+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7faa0405e250 con 0x7faa04157780 2026-02-24T19:17:56.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.268+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f44a005c9e0 con 0x7f44b01594e0 2026-02-24T19:17:56.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.268+0000 7f449e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.268+0000 7f449e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:56.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.272+0000 7fa9f27fc640 1 -- 10.20.193.45:0/373588492 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 1498640560) 0x7faa0405e250 con 0x7faa04157780 2026-02-24T19:17:56.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.272+0000 7fa9f27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:17:56.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.272+0000 7fa9f27fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:56.275 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:56.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.273+0000 7f13827fc640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f13840b0ca0 0x7f13840b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36378/0 (socket says 10.20.193.45:36378) 2026-02-24T19:17:56.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.273+0000 7f13827fc640 1 -- 10.20.193.45:0/502356113 learned_addr learned my addr 10.20.193.45:0/502356113 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 10 librados: watch_flush enter 2026-02-24T19:17:56.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 10 librados: watch_flush exit 2026-02-24T19:17:56.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 20 client.4604.objecter shutdown clearing up homeless session... 2026-02-24T19:17:56.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 10 client.4604.objecter successfully canceled tick 2026-02-24T19:17:56.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 >> v1:10.20.193.45:6800/1599977652 conn(0x7fa9d4077bf0 legacy=0x7fa9d40980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 10 monclient: shutdown 2026-02-24T19:17:56.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 >> v1:10.20.193.179:6789/0 conn(0x7faa04157780 legacy=0x7faa04129a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 shutdown_connections 2026-02-24T19:17:56.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 >> 10.20.193.45:0/373588492 conn(0x7faa040b2ef0 msgr2=0x7faa04156a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 shutdown_connections 2026-02-24T19:17:56.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 1 -- 10.20.193.45:0/373588492 wait complete. 2026-02-24T19:17:56.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.274+0000 7faa0be5b640 1 librados: shutdown 2026-02-24T19:17:56.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.275+0000 7f1381ffb640 1 -- 10.20.193.45:0/502356113 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1116707556 0 0) 0x7f13840b6080 con 0x7f13840b0ca0 2026-02-24T19:17:56.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.275+0000 7f1381ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.275+0000 7f1381ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.275+0000 7f1381ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.275+0000 7f1381ffb640 10 monclient(hunting): my global_id is 4613 2026-02-24T19:17:56.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.275+0000 7f1381ffb640 1 -- 10.20.193.45:0/502356113 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1370003610 con 0x7f13840b0ca0 2026-02-24T19:17:56.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 1 -- 10.20.193.45:0/502356113 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 287112993 0 0) 0x7f1370003610 con 0x7f13840b0ca0 2026-02-24T19:17:56.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 1 -- 10.20.193.45:0/502356113 >> v1:10.20.193.114:6789/0 conn(0x7f138415d0c0 legacy=0x7f13840b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:56.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 1 -- 10.20.193.45:0/502356113 >> v1:10.20.193.45:6789/0 conn(0x7f13840b28b0 legacy=0x7f13840b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 1 monclient: found mon.noname-c 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 1 -- 10.20.193.45:0/502356113 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1384163e10 con 0x7f13840b0ca0 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 1 -- 10.20.193.45:0/502356113 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f136c002df0 con 0x7f13840b0ca0 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:56.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1381ffb640 10 monclient: dump: 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1389a55640 5 monclient: authenticate success, global_id 4613 2026-02-24T19:17:56.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.277+0000 7f1389a55640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1381ffb640 1 -- 10.20.193.45:0/502356113 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f136c003000 con 0x7f13840b0ca0 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1381ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1381ffb640 1 -- 10.20.193.45:0/502356113 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f136c003440 con 0x7f13840b0ca0 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1381ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1381ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1381ffb640 10 monclient: dump: 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.286 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 4 set_mon_vals no callback set 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 10 monclient: shutdown 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 1 -- 10.20.193.45:0/502356113 >> v1:10.20.193.179:6789/0 conn(0x7f13840b0ca0 legacy=0x7f13840b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 1 -- 10.20.193.45:0/502356113 shutdown_connections 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 1 -- 10.20.193.45:0/502356113 >> 10.20.193.45:0/502356113 conn(0x7f13840b5290 msgr2=0x7f13840b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 1 -- 10.20.193.45:0/502356113 shutdown_connections 2026-02-24T19:17:56.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 1 -- 10.20.193.45:0/502356113 wait complete. 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 10 monclient: monmap: 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.288 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 1 librados: starting msgr at 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 1 librados: starting objecter 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.278+0000 7f1389a55640 1 Processor -- start 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 1 -- start start 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 1 librados: setting wanted keys 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 1 librados: calling monclient init 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 10 monclient: init 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 10 monclient(hunting): picked mon.noname-b con 0x7f13840b0ca0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 10 monclient(hunting): picked mon.noname-a con 0x7f13840b28b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 10 monclient(hunting): picked mon.noname-c con 0x7f138415d0c0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13841fb230 con 0x7f13840b28b0 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13841fb510 con 0x7f13840b0ca0 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13841fb7f0 con 0x7f138415d0c0 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f1389a55640 10 monclient(hunting): authenticate will time out at 3647.918435s 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f13837fe640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f138415d0c0 0x7f13840b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36382/0 (socket says 10.20.193.45:36382) 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.279+0000 7f13837fe640 1 -- 10.20.193.45:0/3955628191 learned_addr learned my addr 10.20.193.45:0/3955628191 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.280+0000 7f135bfff640 10 client.?.objecter ms_handle_connect 0x7f138415d0c0 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.280+0000 7f135bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.280+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682159115 0 0) 0x7f13841fb7f0 con 0x7f138415d0c0 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.280+0000 7f135bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.280+0000 7f135bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.280+0000 7f135bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.280+0000 7f135bfff640 10 monclient(hunting): my global_id is 4616 2026-02-24T19:17:56.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.280+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1354003610 con 0x7f138415d0c0 2026-02-24T19:17:56.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.283+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1659553751 0 0) 0x7f1354003610 con 0x7f138415d0c0 2026-02-24T19:17:56.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.283+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13841fb7f0 con 0x7f138415d0c0 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.283+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13740032d0 con 0x7f138415d0c0 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.283+0000 7f135bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.283+0000 7f135bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.283+0000 7f135bfff640 10 monclient(hunting): dump: 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.292 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.293 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.293 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.283+0000 7f135bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:56.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.6 2026-02-24T19:17:56.294 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3242010062 0 0) 0x7f13841fb7f0 con 0x7f138415d0c0 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 >> v1:10.20.193.114:6789/0 conn(0x7f13840b0ca0 legacy=0x7f1384152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 >> v1:10.20.193.45:6789/0 conn(0x7f13840b28b0 legacy=0x7f13841649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 1 monclient: found mon.c 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13841fbad0 con 0x7f138415d0c0 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f135bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 5 monclient: authenticate success, global_id 4616 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 10 monclient: _renew_subs 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13841fbdb0 con 0x7f138415d0c0 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 10 client.4616.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 10 monclient: _renew_subs 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1384152b80 con 0x7f138415d0c0 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 1 librados: init done 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.285+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138405e210 con 0x7f138415d0c0 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.293+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1374003950 con 0x7f138415d0c0 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.293+0000 7f135bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.293+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f1374004f10 con 0x7f138415d0c0 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.293+0000 7f135bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.293+0000 7f13817fa640 4 set_mon_vals no callback set 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.293+0000 7f135bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.293+0000 7f135bfff640 10 monclient: dump: 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.298 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.299 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.299 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.294+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f137401dd80 con 0x7f138415d0c0 2026-02-24T19:17:56.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.294+0000 7f1382ffd640 10 monclient: get_auth_request con 0x7f1354077c80 auth_method 0 2026-02-24T19:17:56.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.294+0000 7f135bfff640 10 client.4616.objecter ms_handle_connect 0x7f1354077c80 2026-02-24T19:17:56.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.295+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f1374093700 con 0x7f138415d0c0 2026-02-24T19:17:56.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.295+0000 7f135bfff640 10 client.4616.objecter ms_dispatch2 0x7f1384000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:56.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.295+0000 7f135bfff640 3 client.4616.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:56.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.295+0000 7f135bfff640 3 client.4616.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:56.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.295+0000 7f135bfff640 20 client.4616.objecter dump_active .. 0 homeless 2026-02-24T19:17:56.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.300+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efbe00049f0 con 0x7efbf8157b50 2026-02-24T19:17:56.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.300+0000 7efbd77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.300+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7efbe0004ba0 con 0x7efbf8157b50 2026-02-24T19:17:56.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.300+0000 7efbd77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.300+0000 7efbd77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.300+0000 7efbf57fa640 4 set_mon_vals no callback set 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.300+0000 7efbd77fe640 10 monclient: dump: 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.304 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.301+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7efbe001da10 con 0x7efbf8157b50 2026-02-24T19:17:56.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.302+0000 7efbf6ffd640 10 monclient: get_auth_request con 0x7efbc4077c40 auth_method 0 2026-02-24T19:17:56.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.302+0000 7efbd77fe640 10 client.4579.objecter ms_handle_connect 0x7efbc4077c40 2026-02-24T19:17:56.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.303+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7efbe0093310 con 0x7efbf8157b50 2026-02-24T19:17:56.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.303+0000 7efbd77fe640 10 client.4579.objecter ms_dispatch2 0x7efbf8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:56.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.303+0000 7efbd77fe640 3 client.4579.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:56.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.303+0000 7efbd77fe640 3 client.4579.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:56.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.303+0000 7efbd77fe640 20 client.4579.objecter dump_active .. 0 homeless 2026-02-24T19:17:56.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.304+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7efbe005dd40 con 0x7efbf8157b50 2026-02-24T19:17:56.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.304+0000 7efbd77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.304+0000 7efbd77fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:56.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.354+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa30005e060 con 0x7fa30415d0d0 2026-02-24T19:17:56.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.354+0000 7fa2f27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.354+0000 7fa2f27fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:56.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.375+0000 7f44b81b1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:56.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.375+0000 7f44b81b1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:56.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.375+0000 7f44b81b1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.375+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f44b015d000 con 0x7f44b01594e0 2026-02-24T19:17:56.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.379+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f137405e130 con 0x7f138415d0c0 2026-02-24T19:17:56.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.379+0000 7f135bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.379+0000 7f135bfff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:56.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.381+0000 7f449e7fc640 1 -- 10.20.193.45:0/2270069031 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 1498640560) 0x7f44a005c2e0 con 0x7f44b01594e0 2026-02-24T19:17:56.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.381+0000 7f449e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:17:56.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.381+0000 7f449e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:56.384 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-24T19:17:56.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 10 librados: watch_flush enter 2026-02-24T19:17:56.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 10 librados: watch_flush exit 2026-02-24T19:17:56.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 20 client.4610.objecter shutdown clearing up homeless session... 2026-02-24T19:17:56.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 10 client.4610.objecter successfully canceled tick 2026-02-24T19:17:56.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 >> v1:10.20.193.45:6800/1599977652 conn(0x7f4480077eb0 legacy=0x7f4480098360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 10 monclient: shutdown 2026-02-24T19:17:56.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 >> v1:10.20.193.179:6789/0 conn(0x7f44b01594e0 legacy=0x7f44b013c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 shutdown_connections 2026-02-24T19:17:56.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 >> 10.20.193.45:0/2270069031 conn(0x7f44b00b2ef0 msgr2=0x7f44b00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.383+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 shutdown_connections 2026-02-24T19:17:56.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.384+0000 7f44b81b1640 1 -- 10.20.193.45:0/2270069031 wait complete. 2026-02-24T19:17:56.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.384+0000 7f44b81b1640 1 librados: shutdown 2026-02-24T19:17:56.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.8 2026-02-24T19:17:56.396 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:56.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.410+0000 7efbfd592640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:56.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.410+0000 7efbfd592640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:56.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.410+0000 7efbfd592640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.410+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7efbf8138670 con 0x7efbf8157b50 2026-02-24T19:17:56.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.413+0000 7efbd77fe640 1 -- 10.20.193.45:0/160997922 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 1257367751) 0x7efbe005d640 con 0x7efbf8157b50 2026-02-24T19:17:56.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.413+0000 7efbd77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:17:56.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.413+0000 7efbd77fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:56.417 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-24T19:17:56.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 10 librados: watch_flush enter 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 10 librados: watch_flush exit 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 20 client.4579.objecter shutdown clearing up homeless session... 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 10 client.4579.objecter successfully canceled tick 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 >> v1:10.20.193.45:6800/1599977652 conn(0x7efbc4077c40 legacy=0x7efbc40980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 10 monclient: shutdown 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 >> v1:10.20.193.114:6789/0 conn(0x7efbf8157b50 legacy=0x7efbf8145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 shutdown_connections 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 >> 10.20.193.45:0/160997922 conn(0x7efbf80b2ef0 msgr2=0x7efbf813bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 shutdown_connections 2026-02-24T19:17:56.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 1 -- 10.20.193.45:0/160997922 wait complete. 2026-02-24T19:17:56.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.416+0000 7efbfd592640 1 librados: shutdown 2026-02-24T19:17:56.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.14 2026-02-24T19:17:56.428 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:56.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.462+0000 7fa30be6a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:56.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.462+0000 7fa30be6a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:56.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.462+0000 7fa30be6a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:17:56.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.462+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa304160d80 con 0x7fa30415d0d0 2026-02-24T19:17:56.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.465+0000 7fa2f27fc640 1 -- 10.20.193.45:0/1654014496 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 213165853) 0x7fa30005d960 con 0x7fa30415d0d0 2026-02-24T19:17:56.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.465+0000 7fa2f27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:17:56.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.465+0000 7fa2f27fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:56.469 INFO:teuthology.orchestra.run.trial045.stdout:94489280517 2026-02-24T19:17:56.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 10 librados: watch_flush enter 2026-02-24T19:17:56.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 10 librados: watch_flush exit 2026-02-24T19:17:56.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 20 client.4614.objecter shutdown clearing up homeless session... 2026-02-24T19:17:56.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 10 client.4614.objecter successfully canceled tick 2026-02-24T19:17:56.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 >> v1:10.20.193.45:6800/1599977652 conn(0x7fa2d4077c70 legacy=0x7fa2d4098120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 10 monclient: shutdown 2026-02-24T19:17:56.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 >> v1:10.20.193.45:6789/0 conn(0x7fa30415d0d0 legacy=0x7fa3040b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 shutdown_connections 2026-02-24T19:17:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 >> 10.20.193.45:0/1654014496 conn(0x7fa3040b4070 msgr2=0x7fa30415c140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 shutdown_connections 2026-02-24T19:17:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.467+0000 7fa30be6a640 1 -- 10.20.193.45:0/1654014496 wait complete. 2026-02-24T19:17:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.468+0000 7fa30be6a640 1 librados: shutdown 2026-02-24T19:17:56.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.10 2026-02-24T19:17:56.479 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:56.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.486+0000 7f1389a55640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:56.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.486+0000 7f1389a55640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:56.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.486+0000 7f1389a55640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:17:56.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.486+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f13840b4c40 con 0x7f138415d0c0 2026-02-24T19:17:56.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.488+0000 7f135bfff640 1 -- 10.20.193.45:0/3955628191 <== mon.2 v1:10.20.193.179:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 521551722) 0x7f137405da30 con 0x7f138415d0c0 2026-02-24T19:17:56.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.488+0000 7f135bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:17:56.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.488+0000 7f135bfff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:56.492 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-24T19:17:56.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 10 librados: watch_flush enter 2026-02-24T19:17:56.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 10 librados: watch_flush exit 2026-02-24T19:17:56.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 20 client.4616.objecter shutdown clearing up homeless session... 2026-02-24T19:17:56.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 10 client.4616.objecter successfully canceled tick 2026-02-24T19:17:56.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 >> v1:10.20.193.45:6800/1599977652 conn(0x7f1354077c80 legacy=0x7f1354098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 10 monclient: shutdown 2026-02-24T19:17:56.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 >> v1:10.20.193.179:6789/0 conn(0x7f138415d0c0 legacy=0x7f13840b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 shutdown_connections 2026-02-24T19:17:56.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 >> 10.20.193.45:0/3955628191 conn(0x7f13840b5290 msgr2=0x7f13840b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 shutdown_connections 2026-02-24T19:17:56.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 1 -- 10.20.193.45:0/3955628191 wait complete. 2026-02-24T19:17:56.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.490+0000 7f1389a55640 1 librados: shutdown 2026-02-24T19:17:56.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.3 2026-02-24T19:17:56.503 DEBUG:teuthology.parallel:result is None 2026-02-24T19:17:56.503 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T19:17:56.504 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:17:56.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.606+0000 7fbcd6913640 10 monclient: get_monmap_and_config 2026-02-24T19:17:56.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.606+0000 7fbcd6913640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.606+0000 7fbcd6913640 10 monclient: monmap: 2026-02-24T19:17:56.609 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.610 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.610 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:56.607609+0000 2026-02-24T19:17:56.610 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:56.607609+0000 2026-02-24T19:17:56.610 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.610 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.610 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.610 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.610 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.610 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 1 Processor -- start 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 1 -- start start 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 10 monclient: init 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 10 monclient(hunting): picked mon.noname-c con 0x7fbcd0058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 10 monclient(hunting): picked mon.noname-a con 0x7fbcd00b0410 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 10 monclient(hunting): picked mon.noname-b con 0x7fbcd01626a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd01655c0 con 0x7fbcd00b0410 2026-02-24T19:17:56.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd00b12b0 con 0x7fbcd01626a0 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd00b1590 con 0x7fbcd0058da0 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.607+0000 7fbcd6913640 10 monclient(hunting): authenticate will time out at 3648.246630s 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.608+0000 7fbcd4e89640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fbcd01626a0 0x7fbcd01c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49406/0 (socket says 10.20.193.45:49406) 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.608+0000 7fbcd4e89640 1 -- 10.20.193.45:0/706115342 learned_addr learned my addr 10.20.193.45:0/706115342 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594843511 0 0) 0x7fbcd01655c0 con 0x7fbcd00b0410 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): my global_id is 4617 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb4003610 con 0x7fbcd00b0410 2026-02-24T19:17:56.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059354740 0 0) 0x7fbcd00b12b0 con 0x7fbcd01626a0 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): my global_id is 4585 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd01655c0 con 0x7fbcd01626a0 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3056972158 0 0) 0x7fbcd00b1590 con 0x7fbcd0058da0 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 10 monclient(hunting): my global_id is 4619 2026-02-24T19:17:56.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.609+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd00b12b0 con 0x7fbcd0058da0 2026-02-24T19:17:56.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2665753324 0 0) 0x7fbcb4003610 con 0x7fbcd00b0410 2026-02-24T19:17:56.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 >> v1:10.20.193.179:6789/0 conn(0x7fbcd0058da0 legacy=0x7fbcd01647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 >> v1:10.20.193.114:6789/0 conn(0x7fbcd01626a0 legacy=0x7fbcd01c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 1 monclient: found mon.noname-a 2026-02-24T19:17:56.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:17:56.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd00b1870 con 0x7fbcd00b0410 2026-02-24T19:17:56.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbcc0002df0 con 0x7fbcd00b0410 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcceffd640 10 monclient: dump: 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.621 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcd6913640 5 monclient: authenticate success, global_id 4617 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.611+0000 7fbcd6913640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcc0002fc0 con 0x7fbcd00b0410 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcceffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcceffd640 1 -- 10.20.193.45:0/706115342 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbcc0003400 con 0x7fbcd00b0410 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 4 set_mon_vals no callback set 2026-02-24T19:17:56.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcceffd640 10 monclient: dump: 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.623 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 10 monclient: shutdown 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 1 -- 10.20.193.45:0/706115342 >> v1:10.20.193.45:6789/0 conn(0x7fbcd00b0410 legacy=0x7fbcd0164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 1 -- 10.20.193.45:0/706115342 shutdown_connections 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 1 -- 10.20.193.45:0/706115342 >> 10.20.193.45:0/706115342 conn(0x7fbcd00b65f0 msgr2=0x7fbcd00b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 1 -- 10.20.193.45:0/706115342 shutdown_connections 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 1 -- 10.20.193.45:0/706115342 wait complete. 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.612+0000 7fbcd6913640 10 monclient: monmap: 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:56.624 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 1 librados: starting msgr at 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 1 librados: starting objecter 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 1 Processor -- start 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 1 -- start start 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 1 librados: setting wanted keys 2026-02-24T19:17:56.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 1 librados: calling monclient init 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 10 monclient: init 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 10 monclient(hunting): picked mon.noname-b con 0x7fbcd0058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 10 monclient(hunting): picked mon.noname-c con 0x7fbcd00b0410 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 10 monclient(hunting): picked mon.noname-a con 0x7fbcd01626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd013d5a0 con 0x7fbcd01626a0 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd00af770 con 0x7fbcd0058da0 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd00afa50 con 0x7fbcd00b0410 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbcd6913640 10 monclient(hunting): authenticate will time out at 3648.252610s 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbccffff640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fbcd0058da0 0x7fbcd0147970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49414/0 (socket says 10.20.193.45:49414) 2026-02-24T19:17:56.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.613+0000 7fbccffff640 1 -- 10.20.193.45:0/2597443382 learned_addr learned my addr 10.20.193.45:0/2597443382 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.614+0000 7fbcccff9640 10 client.?.objecter ms_handle_connect 0x7fbcd0058da0 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.614+0000 7fbcccff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.614+0000 7fbcccff9640 10 client.?.objecter ms_handle_connect 0x7fbcd00b0410 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.614+0000 7fbcccff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.614+0000 7fbcccff9640 10 client.?.objecter ms_handle_connect 0x7fbcd01626a0 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.614+0000 7fbcccff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057861934 0 0) 0x7fbcd00af770 con 0x7fbcd0058da0 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): my global_id is 4588 2026-02-24T19:17:56.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbca0003610 con 0x7fbcd0058da0 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855119257 0 0) 0x7fbcd00afa50 con 0x7fbcd00b0410 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): my global_id is 4622 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd00af770 con 0x7fbcd00b0410 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193622862 0 0) 0x7fbcd013d5a0 con 0x7fbcd01626a0 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 10 monclient(hunting): my global_id is 4620 2026-02-24T19:17:56.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.615+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd00afa50 con 0x7fbcd01626a0 2026-02-24T19:17:56.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3622492752 0 0) 0x7fbca0003610 con 0x7fbcd0058da0 2026-02-24T19:17:56.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcd013d5a0 con 0x7fbcd0058da0 2026-02-24T19:17:56.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbcbc003170 con 0x7fbcd0058da0 2026-02-24T19:17:56.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:56.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): dump: 2026-02-24T19:17:56.631 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.631 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.631 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3458012021 0 0) 0x7fbcd00afa50 con 0x7fbcd01626a0 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbca0003610 con 0x7fbcd01626a0 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbcc4003370 con 0x7fbcd01626a0 2026-02-24T19:17:56.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): dump: 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1993373310 0 0) 0x7fbcd00af770 con 0x7fbcd00b0410 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcd00afa50 con 0x7fbcd00b0410 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbcc0003310 con 0x7fbcd00b0410 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.617+0000 7fbcccff9640 10 monclient(hunting): dump: 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.634 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1596431209 0 0) 0x7fbcd013d5a0 con 0x7fbcd0058da0 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 >> v1:10.20.193.179:6789/0 conn(0x7fbcd00b0410 legacy=0x7fbcd013daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 >> v1:10.20.193.45:6789/0 conn(0x7fbcd01626a0 legacy=0x7fbcd0057610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 1 monclient: found mon.b 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd00afd30 con 0x7fbcd0058da0 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 5 monclient: authenticate success, global_id 4588 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 10 monclient: _renew_subs 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd00b0010 con 0x7fbcd0058da0 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 10 client.4588.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 10 monclient: _renew_subs 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbcd013e390 con 0x7fbcd0058da0 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 1 librados: init done 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.619+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd0148080 con 0x7fbcd0058da0 2026-02-24T19:17:56.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.711+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcbc003310 con 0x7fbcd0058da0 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.711+0000 7fbcccff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.711+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbcbc003b50 con 0x7fbcd0058da0 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.711+0000 7fbcccff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.711+0000 7fbcce7fc640 4 set_mon_vals no callback set 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.711+0000 7fbcccff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.711+0000 7fbcccff9640 10 monclient: dump: 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.714 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.715 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.715 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.715 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.715 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.715 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.715 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.711+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fbcbc003d30 con 0x7fbcd0058da0 2026-02-24T19:17:56.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.712+0000 7fbccf7fe640 10 monclient: get_auth_request con 0x7fbca0077ed0 auth_method 0 2026-02-24T19:17:56.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.712+0000 7fbcccff9640 10 client.4588.objecter ms_handle_connect 0x7fbca0077ed0 2026-02-24T19:17:56.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.713+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fbcbc093240 con 0x7fbcd0058da0 2026-02-24T19:17:56.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.713+0000 7fbcccff9640 10 client.4588.objecter ms_dispatch2 0x7fbcd0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:56.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.713+0000 7fbcccff9640 3 client.4588.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:56.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.713+0000 7fbcccff9640 3 client.4588.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:56.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.713+0000 7fbcccff9640 20 client.4588.objecter dump_active .. 0 homeless 2026-02-24T19:17:56.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.714+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fbcbc05dc70 con 0x7fbcd0058da0 2026-02-24T19:17:56.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.714+0000 7fbcccff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.714+0000 7fbcccff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:56.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.821+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcd00b0250 con 0x7fbca0077ed0 2026-02-24T19:17:56.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.822+0000 7fbcccff9640 1 -- 10.20.193.45:0/2597443382 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42820 (unknown 2965378022 0 792627659) 0x7fbcc0007860 con 0x7fbca0077ed0 2026-02-24T19:17:56.825 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:17:56.826 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-24T19:17:56.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 10 librados: watch_flush enter 2026-02-24T19:17:56.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 10 librados: watch_flush exit 2026-02-24T19:17:56.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 20 client.4588.objecter shutdown clearing up homeless session... 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 10 client.4588.objecter successfully canceled tick 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 >> v1:10.20.193.45:6800/1599977652 conn(0x7fbca0077ed0 legacy=0x7fbca0098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 10 monclient: shutdown 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 >> v1:10.20.193.114:6789/0 conn(0x7fbcd0058da0 legacy=0x7fbcd0147970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 shutdown_connections 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 >> 10.20.193.45:0/2597443382 conn(0x7fbcd00b65f0 msgr2=0x7fbcd013ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 shutdown_connections 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 1 -- 10.20.193.45:0/2597443382 wait complete. 2026-02-24T19:17:56.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.824+0000 7fbcd6913640 1 librados: shutdown 2026-02-24T19:17:56.836 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2026-02-24T19:17:55.649372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":436756,"kb_used_data":5396,"kb_used_omap":133,"kb_used_meta":430970,"kb_avail":1509512684,"statfs":{"total":1546188226560,"available":1545740988416,"internally_reserved":0,"allocated":5525504,"data_stored":2889910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":137146,"internal_metadata":441313350},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.148359"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.730303+0000","last_change":"2026-02-24T19:17:51.735983+0000","last_active":"2026-02-24T19:17:51.730303+0000","last_peered":"2026-02-24T19:17:51.730303+0000","last_clean":"2026-02-24T19:17:51.730303+0000","last_became_active":"2026-02-24T19:17:49.848509+0000","last_became_peered":"2026-02-24T19:17:49.848509+0000","last_unstale":"2026-02-24T19:17:51.730303+0000","last_undegraded":"2026-02-24T19:17:51.730303+0000","last_fullsized":"2026-02-24T19:17:51.730303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:59:49.327706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032515259999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.929779+0000","last_change":"2026-02-24T19:17:51.929779+0000","last_active":"2026-02-24T19:17:51.929779+0000","last_peered":"2026-02-24T19:17:51.929779+0000","last_clean":"2026-02-24T19:17:51.929779+0000","last_became_active":"2026-02-24T19:17:49.636104+0000","last_became_peered":"2026-02-24T19:17:49.636104+0000","last_unstale":"2026-02-24T19:17:51.929779+0000","last_undegraded":"2026-02-24T19:17:51.929779+0000","last_fullsized":"2026-02-24T19:17:51.929779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:53:57.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036145872000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.892619+0000","last_change":"2026-02-24T19:17:51.895025+0000","last_active":"2026-02-24T19:17:51.892619+0000","last_peered":"2026-02-24T19:17:51.892619+0000","last_clean":"2026-02-24T19:17:51.892619+0000","last_became_active":"2026-02-24T19:17:49.822380+0000","last_became_peered":"2026-02-24T19:17:49.822380+0000","last_unstale":"2026-02-24T19:17:51.892619+0000","last_undegraded":"2026-02-24T19:17:51.892619+0000","last_fullsized":"2026-02-24T19:17:51.892619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:22:04.516051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031009920999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.867111+0000","last_change":"2026-02-24T19:17:51.889910+0000","last_active":"2026-02-24T19:17:51.867111+0000","last_peered":"2026-02-24T19:17:51.867111+0000","last_clean":"2026-02-24T19:17:51.867111+0000","last_became_active":"2026-02-24T19:17:49.867737+0000","last_became_peered":"2026-02-24T19:17:49.867737+0000","last_unstale":"2026-02-24T19:17:51.867111+0000","last_undegraded":"2026-02-24T19:17:51.867111+0000","last_fullsized":"2026-02-24T19:17:51.867111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:43:43.357779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041050483999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.726046+0000","last_change":"2026-02-24T19:17:51.726046+0000","last_active":"2026-02-24T19:17:51.726046+0000","last_peered":"2026-02-24T19:17:51.726046+0000","last_clean":"2026-02-24T19:17:51.726046+0000","last_became_active":"2026-02-24T19:17:49.831395+0000","last_became_peered":"2026-02-24T19:17:49.831395+0000","last_unstale":"2026-02-24T19:17:51.726046+0000","last_undegraded":"2026-02-24T19:17:51.726046+0000","last_fullsized":"2026-02-24T19:17:51.726046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:45:35.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363406999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.909002+0000","last_change":"2026-02-24T19:17:51.909002+0000","last_active":"2026-02-24T19:17:51.909002+0000","last_peered":"2026-02-24T19:17:51.909002+0000","last_clean":"2026-02-24T19:17:51.909002+0000","last_became_active":"2026-02-24T19:17:50.962180+0000","last_became_peered":"2026-02-24T19:17:50.962180+0000","last_unstale":"2026-02-24T19:17:51.909002+0000","last_undegraded":"2026-02-24T19:17:51.909002+0000","last_fullsized":"2026-02-24T19:17:51.909002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:55:24.848537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034127616999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,14],"acting":[6,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.879794+0000","last_change":"2026-02-24T19:17:51.879794+0000","last_active":"2026-02-24T19:17:51.879794+0000","last_peered":"2026-02-24T19:17:51.879794+0000","last_clean":"2026-02-24T19:17:51.879794+0000","last_became_active":"2026-02-24T19:17:49.829989+0000","last_became_peered":"2026-02-24T19:17:49.829989+0000","last_unstale":"2026-02-24T19:17:51.879794+0000","last_undegraded":"2026-02-24T19:17:51.879794+0000","last_fullsized":"2026-02-24T19:17:51.879794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:23:30.666021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032260351999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.729016+0000","last_change":"2026-02-24T19:17:51.734383+0000","last_active":"2026-02-24T19:17:51.729016+0000","last_peered":"2026-02-24T19:17:51.729016+0000","last_clean":"2026-02-24T19:17:51.729016+0000","last_became_active":"2026-02-24T19:17:49.844588+0000","last_became_peered":"2026-02-24T19:17:49.844588+0000","last_unstale":"2026-02-24T19:17:51.729016+0000","last_undegraded":"2026-02-24T19:17:51.729016+0000","last_fullsized":"2026-02-24T19:17:51.729016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:26:51.919573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039325629000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"25'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.847680+0000","last_change":"2026-02-24T19:17:41.855813+0000","last_active":"2026-02-24T19:17:51.847680+0000","last_peered":"2026-02-24T19:17:51.847680+0000","last_clean":"2026-02-24T19:17:51.847680+0000","last_became_active":"2026-02-24T19:17:41.834152+0000","last_became_peered":"2026-02-24T19:17:41.834152+0000","last_unstale":"2026-02-24T19:17:51.847680+0000","last_undegraded":"2026-02-24T19:17:51.847680+0000","last_fullsized":"2026-02-24T19:17:51.847680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_clean_scrub_stamp":"2026-02-24T19:17:39.980633+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:41:22.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":864256,"data_stored":857120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,5,6,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7476,"internal_metadata":27583180},"hb_peers":[0,1,3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[1,2,3,4,6,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6174,"internal_metadata":27584482},"hb_peers":[0,1,2,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,3,5,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,2,3,4,5,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":288,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":294912,"data_stored":127066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8770,"internal_metadata":27581886},"hb_peers":[0,2,3,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,4,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8780,"internal_metadata":27581876},"hb_peers":[0,1,2,3,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3,4,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":676,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":692224,"data_stored":524887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,2,3,4,5,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":736,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":753664,"data_stored":586327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8772,"internal_metadata":27581884},"hb_peers":[0,1,2,4,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":288,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":294912,"data_stored":127066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7480,"internal_metadata":27583176},"hb_peers":[0,3,4,5,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:17:56.838 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:17:56.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.904+0000 7fb32f98a640 10 monclient: get_monmap_and_config 2026-02-24T19:17:56.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.904+0000 7fb32f98a640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.904+0000 7fb32f98a640 10 monclient: monmap: 2026-02-24T19:17:56.907 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.907 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.907 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:56.905096+0000 2026-02-24T19:17:56.907 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:56.905096+0000 2026-02-24T19:17:56.907 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.907 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.907 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.908 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.908 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.908 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.904+0000 7fb32f98a640 1 Processor -- start 2026-02-24T19:17:56.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.904+0000 7fb32f98a640 1 -- start start 2026-02-24T19:17:56.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.904+0000 7fb32f98a640 10 monclient: init 2026-02-24T19:17:56.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.904+0000 7fb32f98a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.904+0000 7fb32f98a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.904+0000 7fb32f98a640 10 monclient(hunting): picked mon.noname-a con 0x7fb328058da0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.905+0000 7fb32f98a640 10 monclient(hunting): picked mon.noname-c con 0x7fb3280b0410 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.905+0000 7fb32f98a640 10 monclient(hunting): picked mon.noname-b con 0x7fb3281626a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.905+0000 7fb32f98a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3281655c0 con 0x7fb328058da0 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.905+0000 7fb32f98a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3280b12b0 con 0x7fb3281626a0 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.905+0000 7fb32f98a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3280b1590 con 0x7fb3280b0410 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.905+0000 7fb32f98a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.905+0000 7fb32f98a640 10 monclient(hunting): authenticate will time out at 3648.544050s 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.905+0000 7fb32df00640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fb3281626a0 0x7fb3281c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49420/0 (socket says 10.20.193.45:49420) 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.905+0000 7fb32df00640 1 -- 10.20.193.45:0/1443910468 learned_addr learned my addr 10.20.193.45:0/1443910468 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089100049 0 0) 0x7fb3281655c0 con 0x7fb328058da0 2026-02-24T19:17:56.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): my global_id is 4623 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb310003610 con 0x7fb328058da0 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182895236 0 0) 0x7fb3280b12b0 con 0x7fb3281626a0 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): my global_id is 4591 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3281655c0 con 0x7fb3281626a0 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1547373491 0 0) 0x7fb3280b1590 con 0x7fb3280b0410 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 10 monclient(hunting): my global_id is 4625 2026-02-24T19:17:56.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.906+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3280b12b0 con 0x7fb3280b0410 2026-02-24T19:17:56.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1616229960 0 0) 0x7fb3281655c0 con 0x7fb3281626a0 2026-02-24T19:17:56.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 >> v1:10.20.193.179:6789/0 conn(0x7fb3280b0410 legacy=0x7fb328164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 >> v1:10.20.193.45:6789/0 conn(0x7fb328058da0 legacy=0x7fb3281647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 1 monclient: found mon.noname-b 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3280b1870 con 0x7fb3281626a0 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb32f98a640 5 monclient: authenticate success, global_id 4591 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb32f98a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb324003170 con 0x7fb3281626a0 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:56.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb317fff640 10 monclient: dump: 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.908+0000 7fb32f98a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:56.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3240033c0 con 0x7fb3281626a0 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb317fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb317fff640 1 -- 10.20.193.45:0/1443910468 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb3240037c0 con 0x7fb3281626a0 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb317fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb317fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb317fff640 10 monclient: dump: 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.921 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb32f98a640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb32f98a640 4 set_mon_vals no callback set 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb32f98a640 10 monclient: shutdown 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb32f98a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb32f98a640 1 -- 10.20.193.45:0/1443910468 >> v1:10.20.193.114:6789/0 conn(0x7fb3281626a0 legacy=0x7fb3281c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb32f98a640 1 -- 10.20.193.45:0/1443910468 shutdown_connections 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb32f98a640 1 -- 10.20.193.45:0/1443910468 >> 10.20.193.45:0/1443910468 conn(0x7fb3280b65f0 msgr2=0x7fb3280b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb32f98a640 1 -- 10.20.193.45:0/1443910468 shutdown_connections 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.909+0000 7fb32f98a640 1 -- 10.20.193.45:0/1443910468 wait complete. 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient: build_initial_monmap 2026-02-24T19:17:56.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient: monmap: 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 1 librados: starting msgr at 2026-02-24T19:17:56.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 1 librados: starting objecter 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 1 Processor -- start 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 1 -- start start 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 1 librados: setting wanted keys 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 1 librados: calling monclient init 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient: init 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient(hunting): picked mon.noname-b con 0x7fb328058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient(hunting): picked mon.noname-a con 0x7fb3280b0410 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient(hunting): picked mon.noname-c con 0x7fb3281626a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3280aec80 con 0x7fb3280b0410 2026-02-24T19:17:56.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3280a7840 con 0x7fb328058da0 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3280a7b20 con 0x7fb3281626a0 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.910+0000 7fb32f98a640 10 monclient(hunting): authenticate will time out at 3648.549872s 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.911+0000 7fb32d6ff640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fb328058da0 0x7fb3280ae570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:49436/0 (socket says 10.20.193.45:49436) 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.911+0000 7fb32d6ff640 1 -- 10.20.193.45:0/2817428186 learned_addr learned my addr 10.20.193.45:0/2817428186 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.911+0000 7fb315ffb640 10 client.?.objecter ms_handle_connect 0x7fb328058da0 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.911+0000 7fb315ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.911+0000 7fb315ffb640 10 client.?.objecter ms_handle_connect 0x7fb3280b0410 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.911+0000 7fb315ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.911+0000 7fb315ffb640 10 client.?.objecter ms_handle_connect 0x7fb3281626a0 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.911+0000 7fb315ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206424792 0 0) 0x7fb3280a7840 con 0x7fb328058da0 2026-02-24T19:17:56.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): my global_id is 4594 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2f8003610 con 0x7fb328058da0 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3348330362 0 0) 0x7fb3280a7b20 con 0x7fb3281626a0 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): my global_id is 4628 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3280a7840 con 0x7fb3281626a0 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 805508800 0 0) 0x7fb3280aec80 con 0x7fb3280b0410 2026-02-24T19:17:56.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 10 monclient(hunting): my global_id is 4626 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.912+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3280a7b20 con 0x7fb3280b0410 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 603521402 0 0) 0x7fb2f8003610 con 0x7fb328058da0 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3280aec80 con 0x7fb328058da0 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb3180030f0 con 0x7fb328058da0 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:56.927 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 937768244 0 0) 0x7fb3280a7840 con 0x7fb3281626a0 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2f8003610 con 0x7fb3281626a0 2026-02-24T19:17:56.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb324003710 con 0x7fb3281626a0 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.929 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4150031194 0 0) 0x7fb3280a7b20 con 0x7fb3280b0410 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3280a7840 con 0x7fb3280b0410 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb31c003060 con 0x7fb3280b0410 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.914+0000 7fb315ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.930 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.931 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.931 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.931 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4144988157 0 0) 0x7fb3280aec80 con 0x7fb328058da0 2026-02-24T19:17:56.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 >> v1:10.20.193.179:6789/0 conn(0x7fb3281626a0 legacy=0x7fb32805c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 >> v1:10.20.193.45:6789/0 conn(0x7fb3280b0410 legacy=0x7fb32813d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:56.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:56.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 1 monclient: found mon.b 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3280a7e00 con 0x7fb328058da0 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb315ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 5 monclient: authenticate success, global_id 4594 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 10 monclient: _renew_subs 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb3280a80e0 con 0x7fb328058da0 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 10 client.4594.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 10 monclient: _renew_subs 2026-02-24T19:17:56.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb32813dae0 con 0x7fb328058da0 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 1 librados: init done 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.916+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb328055260 con 0x7fb328058da0 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.920+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3180034a0 con 0x7fb328058da0 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.920+0000 7fb315ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.920+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb318003b50 con 0x7fb328058da0 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.920+0000 7fb315ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.920+0000 7fb315ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:56.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.920+0000 7fb315ffb640 10 monclient: dump: 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.920+0000 7fb3177fe640 4 set_mon_vals no callback set 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.924+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fb318003b50 con 0x7fb328058da0 2026-02-24T19:17:56.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.924+0000 7fb32cefe640 10 monclient: get_auth_request con 0x7fb2f8077e20 auth_method 0 2026-02-24T19:17:56.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.924+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7fb318059480 con 0x7fb328058da0 2026-02-24T19:17:56.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.924+0000 7fb315ffb640 10 client.4594.objecter ms_dispatch2 0x7fb328000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:56.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.924+0000 7fb315ffb640 3 client.4594.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:56.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.924+0000 7fb315ffb640 3 client.4594.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:56.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.925+0000 7fb315ffb640 20 client.4594.objecter dump_active .. 0 homeless 2026-02-24T19:17:56.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:56.925+0000 7fb315ffb640 10 client.4594.objecter ms_handle_connect 0x7fb2f8077e20 2026-02-24T19:17:57.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.010+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb328055260 con 0x7fb328058da0 2026-02-24T19:17:57.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.010+0000 7fb315ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:57.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.010+0000 7fb315ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:57.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.112+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb32805a120 con 0x7fb2f8077e20 2026-02-24T19:17:57.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.113+0000 7fb315ffb640 1 -- 10.20.193.45:0/2817428186 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42820 (unknown 2965378022 0 792627659) 0x7fb32805a120 con 0x7fb2f8077e20 2026-02-24T19:17:57.116 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:17:57.118 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-24T19:17:57.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 10 librados: watch_flush enter 2026-02-24T19:17:57.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 10 librados: watch_flush exit 2026-02-24T19:17:57.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 20 client.4594.objecter shutdown clearing up homeless session... 2026-02-24T19:17:57.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 10 client.4594.objecter successfully canceled tick 2026-02-24T19:17:57.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 >> v1:10.20.193.45:6800/1599977652 conn(0x7fb2f8077e20 legacy=0x7fb2f80982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:57.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 10 monclient: shutdown 2026-02-24T19:17:57.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:57.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 >> v1:10.20.193.114:6789/0 conn(0x7fb328058da0 legacy=0x7fb3280ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:57.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 shutdown_connections 2026-02-24T19:17:57.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 >> 10.20.193.45:0/2817428186 conn(0x7fb3280b65f0 msgr2=0x7fb32813fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:57.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 shutdown_connections 2026-02-24T19:17:57.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 1 -- 10.20.193.45:0/2817428186 wait complete. 2026-02-24T19:17:57.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.114+0000 7fb32f98a640 1 librados: shutdown 2026-02-24T19:17:57.125 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2026-02-24T19:17:55.649372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":436756,"kb_used_data":5396,"kb_used_omap":133,"kb_used_meta":430970,"kb_avail":1509512684,"statfs":{"total":1546188226560,"available":1545740988416,"internally_reserved":0,"allocated":5525504,"data_stored":2889910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":137146,"internal_metadata":441313350},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.148359"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.730303+0000","last_change":"2026-02-24T19:17:51.735983+0000","last_active":"2026-02-24T19:17:51.730303+0000","last_peered":"2026-02-24T19:17:51.730303+0000","last_clean":"2026-02-24T19:17:51.730303+0000","last_became_active":"2026-02-24T19:17:49.848509+0000","last_became_peered":"2026-02-24T19:17:49.848509+0000","last_unstale":"2026-02-24T19:17:51.730303+0000","last_undegraded":"2026-02-24T19:17:51.730303+0000","last_fullsized":"2026-02-24T19:17:51.730303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:59:49.327706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032515259999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.929779+0000","last_change":"2026-02-24T19:17:51.929779+0000","last_active":"2026-02-24T19:17:51.929779+0000","last_peered":"2026-02-24T19:17:51.929779+0000","last_clean":"2026-02-24T19:17:51.929779+0000","last_became_active":"2026-02-24T19:17:49.636104+0000","last_became_peered":"2026-02-24T19:17:49.636104+0000","last_unstale":"2026-02-24T19:17:51.929779+0000","last_undegraded":"2026-02-24T19:17:51.929779+0000","last_fullsized":"2026-02-24T19:17:51.929779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:53:57.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036145872000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.892619+0000","last_change":"2026-02-24T19:17:51.895025+0000","last_active":"2026-02-24T19:17:51.892619+0000","last_peered":"2026-02-24T19:17:51.892619+0000","last_clean":"2026-02-24T19:17:51.892619+0000","last_became_active":"2026-02-24T19:17:49.822380+0000","last_became_peered":"2026-02-24T19:17:49.822380+0000","last_unstale":"2026-02-24T19:17:51.892619+0000","last_undegraded":"2026-02-24T19:17:51.892619+0000","last_fullsized":"2026-02-24T19:17:51.892619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:22:04.516051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031009920999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.867111+0000","last_change":"2026-02-24T19:17:51.889910+0000","last_active":"2026-02-24T19:17:51.867111+0000","last_peered":"2026-02-24T19:17:51.867111+0000","last_clean":"2026-02-24T19:17:51.867111+0000","last_became_active":"2026-02-24T19:17:49.867737+0000","last_became_peered":"2026-02-24T19:17:49.867737+0000","last_unstale":"2026-02-24T19:17:51.867111+0000","last_undegraded":"2026-02-24T19:17:51.867111+0000","last_fullsized":"2026-02-24T19:17:51.867111+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:43:43.357779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041050483999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.726046+0000","last_change":"2026-02-24T19:17:51.726046+0000","last_active":"2026-02-24T19:17:51.726046+0000","last_peered":"2026-02-24T19:17:51.726046+0000","last_clean":"2026-02-24T19:17:51.726046+0000","last_became_active":"2026-02-24T19:17:49.831395+0000","last_became_peered":"2026-02-24T19:17:49.831395+0000","last_unstale":"2026-02-24T19:17:51.726046+0000","last_undegraded":"2026-02-24T19:17:51.726046+0000","last_fullsized":"2026-02-24T19:17:51.726046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:45:35.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363406999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.909002+0000","last_change":"2026-02-24T19:17:51.909002+0000","last_active":"2026-02-24T19:17:51.909002+0000","last_peered":"2026-02-24T19:17:51.909002+0000","last_clean":"2026-02-24T19:17:51.909002+0000","last_became_active":"2026-02-24T19:17:50.962180+0000","last_became_peered":"2026-02-24T19:17:50.962180+0000","last_unstale":"2026-02-24T19:17:51.909002+0000","last_undegraded":"2026-02-24T19:17:51.909002+0000","last_fullsized":"2026-02-24T19:17:51.909002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:55:24.848537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034127616999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,14],"acting":[6,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.879794+0000","last_change":"2026-02-24T19:17:51.879794+0000","last_active":"2026-02-24T19:17:51.879794+0000","last_peered":"2026-02-24T19:17:51.879794+0000","last_clean":"2026-02-24T19:17:51.879794+0000","last_became_active":"2026-02-24T19:17:49.829989+0000","last_became_peered":"2026-02-24T19:17:49.829989+0000","last_unstale":"2026-02-24T19:17:51.879794+0000","last_undegraded":"2026-02-24T19:17:51.879794+0000","last_fullsized":"2026-02-24T19:17:51.879794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:23:30.666021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032260351999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.729016+0000","last_change":"2026-02-24T19:17:51.734383+0000","last_active":"2026-02-24T19:17:51.729016+0000","last_peered":"2026-02-24T19:17:51.729016+0000","last_clean":"2026-02-24T19:17:51.729016+0000","last_became_active":"2026-02-24T19:17:49.844588+0000","last_became_peered":"2026-02-24T19:17:49.844588+0000","last_unstale":"2026-02-24T19:17:51.729016+0000","last_undegraded":"2026-02-24T19:17:51.729016+0000","last_fullsized":"2026-02-24T19:17:51.729016+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:26:51.919573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039325629000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"25'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:17:51.847680+0000","last_change":"2026-02-24T19:17:41.855813+0000","last_active":"2026-02-24T19:17:51.847680+0000","last_peered":"2026-02-24T19:17:51.847680+0000","last_clean":"2026-02-24T19:17:51.847680+0000","last_became_active":"2026-02-24T19:17:41.834152+0000","last_became_peered":"2026-02-24T19:17:41.834152+0000","last_unstale":"2026-02-24T19:17:51.847680+0000","last_undegraded":"2026-02-24T19:17:51.847680+0000","last_fullsized":"2026-02-24T19:17:51.847680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_clean_scrub_stamp":"2026-02-24T19:17:39.980633+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:41:22.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":864256,"data_stored":857120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,5,6,7,8,9,10,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7476,"internal_metadata":27583180},"hb_peers":[0,1,3,4,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[1,2,3,4,6,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6174,"internal_metadata":27584482},"hb_peers":[0,1,2,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,3,5,6,7,8,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,2,3,4,5,7,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":288,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":294912,"data_stored":127066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8770,"internal_metadata":27581886},"hb_peers":[0,2,3,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,4,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8780,"internal_metadata":27581876},"hb_peers":[0,1,2,3,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,3,4,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":676,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":692224,"data_stored":524887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,2,3,4,5,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":736,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":753664,"data_stored":586327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8772,"internal_metadata":27581884},"hb_peers":[0,1,2,4,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":127047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":288,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":294912,"data_stored":127066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7480,"internal_metadata":27583176},"hb_peers":[0,3,4,5,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:17:57.127 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T19:17:57.127 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T19:17:57.127 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-24T19:17:57.127 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-24T19:17:57.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.190+0000 7f2440f33640 10 monclient: get_monmap_and_config 2026-02-24T19:17:57.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.190+0000 7f2440f33640 10 monclient: build_initial_monmap 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.190+0000 7f2440f33640 10 monclient: monmap: 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:17:57.191741+0000 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:17:57.191741+0000 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:57.194 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:57.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 1 Processor -- start 2026-02-24T19:17:57.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 1 -- start start 2026-02-24T19:17:57.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 10 monclient: init 2026-02-24T19:17:57.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:57.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:57.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 10 monclient(hunting): picked mon.noname-a con 0x7f243c058da0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:57.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 10 monclient(hunting): picked mon.noname-c con 0x7f243c0b0410 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:57.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 10 monclient(hunting): picked mon.noname-b con 0x7f243c1626a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:57.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c1655c0 con 0x7f243c058da0 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c0b12b0 con 0x7f243c1626a0 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c0b1590 con 0x7f243c0b0410 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.191+0000 7f2440f33640 10 monclient(hunting): authenticate will time out at 3648.830642s 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.192+0000 7f2439d74640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f243c0b0410 0x7f243c164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:36412/0 (socket says 10.20.193.45:36412) 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.192+0000 7f2439d74640 1 -- 10.20.193.45:0/750928339 learned_addr learned my addr 10.20.193.45:0/750928339 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264141209 0 0) 0x7f243c0b1590 con 0x7f243c0b0410 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): my global_id is 4631 2026-02-24T19:17:57.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2428003610 con 0x7f243c0b0410 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995777297 0 0) 0x7f243c1655c0 con 0x7f243c058da0 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): my global_id is 4629 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f243c0b1590 con 0x7f243c058da0 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725122479 0 0) 0x7f243c0b12b0 con 0x7f243c1626a0 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 10 monclient(hunting): my global_id is 4597 2026-02-24T19:17:57.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.193+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f243c1655c0 con 0x7f243c1626a0 2026-02-24T19:17:57.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.194+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2867677069 0 0) 0x7f2428003610 con 0x7f243c0b0410 2026-02-24T19:17:57.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.194+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 >> v1:10.20.193.114:6789/0 conn(0x7f243c1626a0 legacy=0x7f243c1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:57.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.194+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 >> v1:10.20.193.45:6789/0 conn(0x7f243c058da0 legacy=0x7f243c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:57.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.194+0000 7f2439573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:57.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.194+0000 7f2439573640 1 monclient: found mon.noname-c 2026-02-24T19:17:57.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.194+0000 7f2439573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:57.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.194+0000 7f2439573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:17:57.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.194+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c0b1870 con 0x7f243c0b0410 2026-02-24T19:17:57.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 10 monclient: _finish_auth 0 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2424002df0 con 0x7f243c0b0410 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 10 monclient: dump: 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:57.207 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2440f33640 5 monclient: authenticate success, global_id 4631 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2440f33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2424003040 con 0x7f243c0b0410 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 1 -- 10.20.193.45:0/750928339 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2424003480 con 0x7f243c0b0410 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:57.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2439573640 10 monclient: dump: 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2440f33640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:57.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.195+0000 7f2440f33640 4 set_mon_vals no callback set 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 10 monclient: shutdown 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 -- 10.20.193.45:0/750928339 >> v1:10.20.193.179:6789/0 conn(0x7f243c0b0410 legacy=0x7f243c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 -- 10.20.193.45:0/750928339 shutdown_connections 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 -- 10.20.193.45:0/750928339 >> 10.20.193.45:0/750928339 conn(0x7f243c0b65f0 msgr2=0x7f243c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 -- 10.20.193.45:0/750928339 shutdown_connections 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 -- 10.20.193.45:0/750928339 wait complete. 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 10 monclient: build_initial_monmap 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 10 monclient: monmap: 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:57.210 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 librados: starting msgr at 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 librados: starting objecter 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 Processor -- start 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 -- start start 2026-02-24T19:17:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 librados: setting wanted keys 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 1 librados: calling monclient init 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.196+0000 7f2440f33640 10 monclient: init 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 10 monclient(hunting): picked mon.noname-a con 0x7f243c058da0 addr v1:10.20.193.45:6789/0 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 10 monclient(hunting): picked mon.noname-b con 0x7f243c0b0410 addr v1:10.20.193.114:6789/0 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 10 monclient(hunting): picked mon.noname-c con 0x7f243c1626a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c1fb9e0 con 0x7f243c058da0 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c1fbcc0 con 0x7f243c0b0410 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c138be0 con 0x7f243c1626a0 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2440f33640 10 monclient(hunting): authenticate will time out at 3648.836288s 2026-02-24T19:17:57.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f243a575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f243c058da0 0x7f243c136d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44564/0 (socket says 10.20.193.45:44564) 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f243a575640 1 -- 10.20.193.45:0/2151444055 learned_addr learned my addr 10.20.193.45:0/2151444055 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2422ffd640 10 client.?.objecter ms_handle_connect 0x7f243c058da0 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2422ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2422ffd640 10 client.?.objecter ms_handle_connect 0x7f243c1626a0 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2422ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2422ffd640 10 client.?.objecter ms_handle_connect 0x7f243c0b0410 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.197+0000 7f2422ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064179173 0 0) 0x7f243c138be0 con 0x7f243c1626a0 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:57.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): my global_id is 4634 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2408003610 con 0x7f243c1626a0 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876704669 0 0) 0x7f243c1fb9e0 con 0x7f243c058da0 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): my global_id is 4632 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f243c138be0 con 0x7f243c058da0 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4145796804 0 0) 0x7f243c1fbcc0 con 0x7f243c0b0410 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:57.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 10 monclient(hunting): my global_id is 4600 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.198+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f243c1fb9e0 con 0x7f243c0b0410 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.200+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 958866497 0 0) 0x7f243c1fb9e0 con 0x7f243c0b0410 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.200+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f243c1fbcc0 con 0x7f243c0b0410 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f24240033b0 con 0x7f243c0b0410 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:57.215 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1691471500 0 0) 0x7f2408003610 con 0x7f243c1626a0 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f243c1fb9e0 con 0x7f243c1626a0 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f242c003330 con 0x7f243c1626a0 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:57.216 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 158969100 0 0) 0x7f243c138be0 con 0x7f243c058da0 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2408003610 con 0x7f243c058da0 2026-02-24T19:17:57.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2430003070 con 0x7f243c058da0 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.201+0000 7f2422ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:57.218 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1663583083 0 0) 0x7f243c1fbcc0 con 0x7f243c0b0410 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 >> v1:10.20.193.179:6789/0 conn(0x7f243c1626a0 legacy=0x7f243c0a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 >> v1:10.20.193.45:6789/0 conn(0x7f243c058da0 legacy=0x7f243c136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 1 monclient: found mon.b 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c138ec0 con 0x7f243c0b0410 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2422ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2440f33640 5 monclient: authenticate success, global_id 4600 2026-02-24T19:17:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2440f33640 10 monclient: _renew_subs 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2440f33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f243c1391a0 con 0x7f243c0b0410 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2440f33640 10 client.4600.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2440f33640 10 monclient: _renew_subs 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2440f33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f243c138870 con 0x7f243c0b0410 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.202+0000 7f2440f33640 1 librados: init done 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.203+0000 7f2440f33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.203+0000 7f2440f33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.203+0000 7f2440f33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:57.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.203+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243c15ebd0 con 0x7f243c0b0410 2026-02-24T19:17:57.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.273+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2424002ff0 con 0x7f243c0b0410 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.273+0000 7f2422ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.273+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2424004ce0 con 0x7f243c0b0410 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.273+0000 7f2422ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.273+0000 7f2422ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.273+0000 7f2422ffd640 10 monclient: dump: 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:57.277 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:17:57.278 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:17:57.278 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:17:57.278 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:17:57.278 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:17:57.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.273+0000 7f2438d72640 4 set_mon_vals no callback set 2026-02-24T19:17:57.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.274+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f242401db50 con 0x7f243c0b0410 2026-02-24T19:17:57.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.275+0000 7f243a575640 10 monclient: get_auth_request con 0x7f2408077ea0 auth_method 0 2026-02-24T19:17:57.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.275+0000 7f2422ffd640 10 client.4600.objecter ms_handle_connect 0x7f2408077ea0 2026-02-24T19:17:57.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.276+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3261257824 0 0) 0x7f24240931b0 con 0x7f243c0b0410 2026-02-24T19:17:57.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.276+0000 7f2422ffd640 10 client.4600.objecter ms_dispatch2 0x7f243c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:17:57.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.276+0000 7f2422ffd640 3 client.4600.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:17:57.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.276+0000 7f2422ffd640 3 client.4600.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:17:57.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.276+0000 7f2422ffd640 20 client.4600.objecter dump_active .. 0 homeless 2026-02-24T19:17:57.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.296+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f242405dbe0 con 0x7f243c0b0410 2026-02-24T19:17:57.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.296+0000 7f2422ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:57.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.296+0000 7f2422ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:57.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.426+0000 7f2440f33640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-24T19:17:57.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.426+0000 7f2440f33640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-24T19:17:57.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.426+0000 7f2440f33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:17:57.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.426+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f243c0b6af0 con 0x7f243c0b0410 2026-02-24T19:17:57.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.431+0000 7f2422ffd640 1 -- 10.20.193.45:0/2151444055 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f242405d4e0 con 0x7f243c0b0410 2026-02-24T19:17:57.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.431+0000 7f2422ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-24T19:17:57.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.431+0000 7f2422ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:57.434 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:17:57.434 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 10 librados: watch_flush enter 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 10 librados: watch_flush exit 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 20 client.4600.objecter shutdown clearing up homeless session... 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 10 client.4600.objecter successfully canceled tick 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 >> v1:10.20.193.45:6800/1599977652 conn(0x7f2408077ea0 legacy=0x7f2408098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 10 monclient: shutdown 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 >> v1:10.20.193.114:6789/0 conn(0x7f243c0b0410 legacy=0x7f243c1fae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 shutdown_connections 2026-02-24T19:17:57.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 >> 10.20.193.45:0/2151444055 conn(0x7f243c0b65f0 msgr2=0x7f243c13ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:57.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 shutdown_connections 2026-02-24T19:17:57.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 1 -- 10.20.193.45:0/2151444055 wait complete. 2026-02-24T19:17:57.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:17:57.432+0000 7f2440f33640 1 librados: shutdown 2026-02-24T19:17:57.445 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-24T19:17:57.445 INFO:teuthology.run_tasks:Running task workunit... 2026-02-24T19:17:57.465 INFO:tasks.workunit:Pulling workunits from ref 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:17:57.466 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-24T19:17:57.466 DEBUG:teuthology.orchestra.run.trial194:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-24T19:17:57.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:17:57.485 INFO:teuthology.orchestra.run.trial194.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-24T19:17:57.486 DEBUG:teuthology.orchestra.run.trial194:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T19:17:57.541 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-24T19:17:57.542 DEBUG:teuthology.orchestra.run.trial194:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-24T19:17:57.597 INFO:tasks.workunit:timeout=6h 2026-02-24T19:17:57.597 INFO:tasks.workunit:cleanup=True 2026-02-24T19:17:57.598 DEBUG:teuthology.orchestra.run.trial194:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:17:57.660 INFO:tasks.workunit.client.0.trial194.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-24T19:17:58.959 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:03.767 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:58.983 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:01:03.789 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:58.984 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:01:03.753 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:59.009 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:03.817 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:59.035 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:01:03.841 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:59.035 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:01:03.804 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:59.132 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:03.940 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:59.157 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:01:03.963 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:59.163 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:01:03.932 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:18.925 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:23.732 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:18.951 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:23.759 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:18.970 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:23.777 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:18.978 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:01:23.783 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:18.978 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:01:23.747 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:18.978 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:01:23.784 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:18.979 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:01:23.748 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:18.996 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:01:23.802 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:18.997 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:01:23.766 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:25.194 INFO:tasks.workunit.client.0.trial194.stderr:Note: switching to '36d388f27052dd940bdbaf543bb05bdba0acc155'. 2026-02-24T19:18:25.194 INFO:tasks.workunit.client.0.trial194.stderr: 2026-02-24T19:18:25.194 INFO:tasks.workunit.client.0.trial194.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-24T19:18:25.194 INFO:tasks.workunit.client.0.trial194.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-24T19:18:25.194 INFO:tasks.workunit.client.0.trial194.stderr:state without impacting any branches by switching back to a branch. 2026-02-24T19:18:25.194 INFO:tasks.workunit.client.0.trial194.stderr: 2026-02-24T19:18:25.194 INFO:tasks.workunit.client.0.trial194.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-24T19:18:25.194 INFO:tasks.workunit.client.0.trial194.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr: 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr: git switch -c 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr: 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr:Or undo this operation with: 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr: 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr: git switch - 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr: 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr: 2026-02-24T19:18:25.195 INFO:tasks.workunit.client.0.trial194.stderr:HEAD is now at 36d388f2705 Merge branch 'aclamk-rocksdb-binned-cache-perf-counters-tentacle' of https://github.com/aclamk/ceph into wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-24T19:18:25.202 DEBUG:teuthology.orchestra.run.trial194:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-24T19:18:25.260 INFO:tasks.workunit.client.0.trial194.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-24T19:18:25.262 INFO:tasks.workunit.client.0.trial194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T19:18:25.262 INFO:tasks.workunit.client.0.trial194.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-24T19:18:25.351 INFO:tasks.workunit.client.0.trial194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-24T19:18:25.381 INFO:tasks.workunit.client.0.trial194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-24T19:18:25.405 INFO:tasks.workunit.client.0.trial194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T19:18:25.407 INFO:tasks.workunit.client.0.trial194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T19:18:25.407 INFO:tasks.workunit.client.0.trial194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-24T19:18:25.433 INFO:tasks.workunit.client.0.trial194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T19:18:25.437 DEBUG:teuthology.orchestra.run.trial194:> set -ex 2026-02-24T19:18:25.437 DEBUG:teuthology.orchestra.run.trial194:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-24T19:18:25.494 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-24T19:18:25.496 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-24T19:18:25.497 DEBUG:teuthology.orchestra.run.trial194:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36d388f27052dd940bdbaf543bb05bdba0acc155 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2026-02-24T19:18:25.555 INFO:tasks.workunit.client.0.trial194.stderr:+ parallel=1 2026-02-24T19:18:25.555 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' '' = --serial ']' 2026-02-24T19:18:25.555 INFO:tasks.workunit.client.0.trial194.stderr:+ crimson=0 2026-02-24T19:18:25.555 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' '' = --crimson ']' 2026-02-24T19:18:25.555 INFO:tasks.workunit.client.0.trial194.stderr:+ color= 2026-02-24T19:18:25.555 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -t 1 ']' 2026-02-24T19:18:25.556 INFO:tasks.workunit.client.0.trial194.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-24T19:18:25.556 INFO:tasks.workunit.client.0.trial194.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T19:18:25.556 INFO:tasks.workunit.client.0.trial194.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T19:18:25.557 INFO:tasks.workunit.client.0.trial194.stderr:+ declare -A pids 2026-02-24T19:18:25.557 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.557 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.557 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_aio 2026-02-24T19:18:25.557 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_aio' 2026-02-24T19:18:25.557 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_aio 2026-02-24T19:18:25.557 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.558 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_aio 2026-02-24T19:18:25.558 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=47991 2026-02-24T19:18:25.558 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_aio on pid 47991' 2026-02-24T19:18:25.559 INFO:tasks.workunit.client.0.trial194.stdout:test api_aio on pid 47991 2026-02-24T19:18:25.561 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=47991 2026-02-24T19:18:25.561 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_aio_pp 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_aio_pp' 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_aio_pp 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.562 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.563 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.564 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.564 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.564 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.564 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.564 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_aio_pp 2026-02-24T19:18:25.564 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=47999 2026-02-24T19:18:25.564 INFO:tasks.workunit.client.0.trial194.stdout:test api_aio_pp on pid 47999 2026-02-24T19:18:25.569 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_aio_pp on pid 47999' 2026-02-24T19:18:25.569 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=47999 2026-02-24T19:18:25.569 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.569 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.569 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_io 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_io' 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_io 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.570 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.571 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.572 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_io 2026-02-24T19:18:25.573 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48008 2026-02-24T19:18:25.574 INFO:tasks.workunit.client.0.trial194.stdout:test api_io on pid 48008 2026-02-24T19:18:25.579 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_io on pid 48008' 2026-02-24T19:18:25.579 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48008 2026-02-24T19:18:25.579 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.579 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.579 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_io_pp 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_io_pp' 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_io_pp 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.580 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.581 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.582 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.583 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.584 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.584 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.584 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.584 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.584 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_io_pp 2026-02-24T19:18:25.584 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48020 2026-02-24T19:18:25.584 INFO:tasks.workunit.client.0.trial194.stdout:test api_io_pp on pid 48020 2026-02-24T19:18:25.591 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_io_pp on pid 48020' 2026-02-24T19:18:25.591 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48020 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_asio 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.592 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_asio' 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_asio 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.593 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.594 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.595 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.596 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.597 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_asio 2026-02-24T19:18:25.597 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48036 2026-02-24T19:18:25.597 INFO:tasks.workunit.client.0.trial194.stdout:test api_asio on pid 48036 2026-02-24T19:18:25.601 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_asio on pid 48036' 2026-02-24T19:18:25.601 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48036 2026-02-24T19:18:25.601 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.601 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.601 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2026-02-24T19:18:25.601 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_list 2026-02-24T19:18:25.601 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_list' 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.602 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/47991/exe ']' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_list 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.603 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.604 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/47991/exe 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.605 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_list 2026-02-24T19:18:25.606 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.607 INFO:tasks.workunit.client.0.trial194.stdout:test api_list on pid 48052 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48052 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_list on pid 48052' 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48052 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_lock 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.611 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_lock' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_lock 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_aio.log 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_aio: /' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.612 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.613 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/47999/exe ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.614 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/47999/exe 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_lock 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48070 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_lock on pid 48070' 2026-02-24T19:18:25.615 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48070 2026-02-24T19:18:25.616 INFO:tasks.workunit.client.0.trial194.stdout:test api_lock on pid 48070 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_lock_pp 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.619 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_lock_pp' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_lock_pp 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.620 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_aio_pp.log 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48008/exe ']' 2026-02-24T19:18:25.621 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_aio_pp: /' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.622 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48008/exe 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_lock_pp 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48091 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_lock_pp on pid 48091' 2026-02-24T19:18:25.623 INFO:tasks.workunit.client.0.trial194.stdout:test api_lock_pp on pid 48091 2026-02-24T19:18:25.626 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48091 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_misc 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_misc' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.627 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48020/exe ']' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_misc 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48020/exe 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.628 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_io.log 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.629 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_io: /' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.630 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.631 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_misc 2026-02-24T19:18:25.631 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.631 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.631 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.631 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48112 2026-02-24T19:18:25.631 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_misc on pid 48112' 2026-02-24T19:18:25.631 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48112 2026-02-24T19:18:25.631 INFO:tasks.workunit.client.0.trial194.stdout:test api_misc on pid 48112 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_io_pp.log 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_misc_pp 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_io_pp: /' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_misc_pp' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_misc_pp 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.633 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.634 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48036/exe ']' 2026-02-24T19:18:25.635 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48036/exe 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_misc_pp 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48133 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_misc_pp on pid 48133' 2026-02-24T19:18:25.636 INFO:tasks.workunit.client.0.trial194.stdout:test api_misc_pp on pid 48133 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48133 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.639 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_pool 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_pool' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_asio.log 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_asio: /' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.640 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_pool 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48052/exe ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.641 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48052/exe 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_pool 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48152 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.642 INFO:tasks.workunit.client.0.trial194.stdout:test api_pool on pid 48152 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_pool on pid 48152' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48152 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_snapshots 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.645 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_snapshots' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48070/exe ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_snapshots 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48070/exe 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_list.log 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.646 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_list: /' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_snapshots 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.647 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48171 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_snapshots on pid 48171' 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.648 INFO:tasks.workunit.client.0.trial194.stdout:test api_snapshots on pid 48171 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48171 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_lock.log 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_snapshots_pp 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_lock: /' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.650 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48091/exe ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_snapshots_pp' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48091/exe 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_snapshots_pp 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.651 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_snapshots_pp 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48198 2026-02-24T19:18:25.652 INFO:tasks.workunit.client.0.trial194.stdout:test api_snapshots_pp on pid 48198 2026-02-24T19:18:25.654 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_snapshots_pp on pid 48198' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48198 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_stat 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_stat' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_lock_pp.log 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_lock_pp: /' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48112/exe ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_stat 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.655 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48112/exe 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.656 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_stat 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48225 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_stat on pid 48225' 2026-02-24T19:18:25.657 INFO:tasks.workunit.client.0.trial194.stdout:test api_stat on pid 48225 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48225 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_stat_pp 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_stat_pp' 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_misc.log 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_misc: /' 2026-02-24T19:18:25.659 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_stat_pp 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48133/exe ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.660 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48133/exe 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.661 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.662 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.662 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_stat_pp 2026-02-24T19:18:25.662 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48257 2026-02-24T19:18:25.662 INFO:tasks.workunit.client.0.trial194.stdout:test api_stat_pp on pid 48257 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_stat_pp on pid 48257' 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48257 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_watch_notify 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_watch_notify' 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.664 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_watch_notify 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_misc_pp.log 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_misc_pp: /' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.665 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.666 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48152/exe ']' 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48152/exe 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_watch_notify 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48296 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_watch_notify on pid 48296' 2026-02-24T19:18:25.667 INFO:tasks.workunit.client.0.trial194.stdout:test api_watch_notify on pid 48296 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48296 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_watch_notify_pp 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_watch_notify_pp' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_watch_notify_pp 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.669 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48171/exe ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.670 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48171/exe 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_pool.log 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_pool: /' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_watch_notify_pp 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48318 2026-02-24T19:18:25.671 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_watch_notify_pp on pid 48318' 2026-02-24T19:18:25.672 INFO:tasks.workunit.client.0.trial194.stdout:test api_watch_notify_pp on pid 48318 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48318 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_cmd 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_cmd' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_cmd 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.674 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_snapshots.log 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_snapshots: /' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.675 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48198/exe ']' 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48198/exe 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_cmd 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48340 2026-02-24T19:18:25.676 INFO:tasks.workunit.client.0.trial194.stdout:test api_cmd on pid 48340 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_cmd on pid 48340' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48340 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_cmd_pp 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_cmd_pp' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.679 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_cmd_pp 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_snapshots_pp: /' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48225/exe ']' 2026-02-24T19:18:25.680 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48225/exe 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_cmd_pp 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48372 2026-02-24T19:18:25.681 INFO:tasks.workunit.client.0.trial194.stdout:test api_cmd_pp on pid 48372 2026-02-24T19:18:25.683 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.683 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_cmd_pp on pid 48372' 2026-02-24T19:18:25.683 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.683 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48372 2026-02-24T19:18:25.683 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.683 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.683 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.683 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_service 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_service' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.684 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48257/exe ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_service 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48257/exe 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.685 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_stat.log 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_stat: /' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_service 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48410 2026-02-24T19:18:25.686 INFO:tasks.workunit.client.0.trial194.stdout:test api_service on pid 48410 2026-02-24T19:18:25.689 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_service on pid 48410' 2026-02-24T19:18:25.689 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48410 2026-02-24T19:18:25.689 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_service_pp 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48296/exe ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_stat_pp.log 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_stat_pp: /' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.690 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48296/exe 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.691 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_service_pp' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_service_pp 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_watch_notify.log 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_watch_notify: /' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.692 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_service_pp 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48456 2026-02-24T19:18:25.693 INFO:tasks.workunit.client.0.trial194.stdout:test api_service_pp on pid 48456 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_service_pp on pid 48456' 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48456 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_c_write_operations 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_c_write_operations' 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.695 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48318/exe ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_c_write_operations 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48318/exe 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.696 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_c_write_operations 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48493 2026-02-24T19:18:25.697 INFO:tasks.workunit.client.0.trial194.stdout:test api_c_write_operations on pid 48493 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_c_write_operations on pid 48493' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48493 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s api_c_read_operations 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' api_c_read_operations' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.700 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48340/exe ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ echo api_c_read_operations 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48340/exe 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48372/exe ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.701 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48372/exe 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.702 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.703 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.703 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=api_c_read_operations 2026-02-24T19:18:25.703 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48515 2026-02-24T19:18:25.703 INFO:tasks.workunit.client.0.trial194.stdout:test api_c_read_operations on pid 48515 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test api_c_read_operations on pid 48515' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48515 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s list_parallel 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' list_parallel' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_cmd.log 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.705 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ echo list_parallel 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_cmd: /' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_cmd_pp: /' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.706 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48410/exe ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48410/exe 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=list_parallel 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48551 2026-02-24T19:18:25.707 INFO:tasks.workunit.client.0.trial194.stdout:test list_parallel on pid 48551 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test list_parallel on pid 48551' 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48551 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.709 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s open_pools_parallel 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' open_pools_parallel' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ echo open_pools_parallel 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.710 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_service.log 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_service: /' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=open_pools_parallel 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48580 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.711 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.712 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test open_pools_parallel on pid 48580' 2026-02-24T19:18:25.712 INFO:tasks.workunit.client.0.trial194.stdout:test open_pools_parallel on pid 48580 2026-02-24T19:18:25.713 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.713 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48580 2026-02-24T19:18:25.713 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.713 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:25.713 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.713 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2026-02-24T19:18:25.713 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.713 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s delete_pools_parallel 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' delete_pools_parallel' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ echo delete_pools_parallel 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.714 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=delete_pools_parallel 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48603 2026-02-24T19:18:25.715 INFO:tasks.workunit.client.0.trial194.stdout:test delete_pools_parallel on pid 48603 2026-02-24T19:18:25.717 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test delete_pools_parallel on pid 48603' 2026-02-24T19:18:25.717 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48456/exe ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48603 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s cls 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' cls' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48456/exe 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ echo cls 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.718 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.719 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48493/exe ']' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48493/exe 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_service_pp.log 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_service_pp: /' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=cls 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48632 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test cls on pid 48632' 2026-02-24T19:18:25.720 INFO:tasks.workunit.client.0.trial194.stdout:test cls on pid 48632 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48632 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s cmd 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' cmd' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ echo cmd 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.722 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48515/exe ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [==========] Running 29 tests from 1 test suite. 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [----------] Global test environment set-up. 2026-02-24T19:18:25.723 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [----------] 29 tests from AsioRados 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.609+0000 7ff2aa354880 10 monclient: get_monmap_and_config 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.609+0000 7ff2aa354880 10 monclient: build_initial_monmap 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.609+0000 7ff2aa354880 10 monclient: monmap: 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: epoch 0 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: last_changed 0.000000 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: created 0.000000 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: election_strategy: 1 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.609+0000 7ff2aa354880 1 Processor -- start 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.609+0000 7ff2aa354880 1 -- start start 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.609+0000 7ff2aa354880 10 monclient: init 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 10 monclient: _reopen_session rank -1 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 10 monclient(hunting): picked mon.noname-a con 0x5584b6f7ac20 addr v1:10.20.193.45:6789/0 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 10 monclient(hunting): picked mon.noname-c con 0x5584b706d8e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 10 monclient(hunting): picked mon.noname-b con 0x5584b7013670 addr v1:10.20.193.114:6789/0 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5584b7065b90 con 0x5584b6f7ac20 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5584b7066d70 con 0x5584b7013670 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5584b7067f70 con 0x5584b706d8e0 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 10 monclient(hunting): _renew_subs 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.610+0000 7ff2aa354880 10 monclient(hunting): authenticate will time out at 3679.267192s 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.617+0000 7ff2a2ffd640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x5584b706d8e0 0x5584b7062c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.194:52320/0 (socket says 10.20.193.194:52320) 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.617+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/641848905 learned_addr learned my addr 10.20.193.194:0/641848905 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.625+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843592580 0 0) 0x5584b7067f70 con 0x5584b706d8e0 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.625+0000 7ff2a1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.625+0000 7ff2a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.625+0000 7ff2a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:25.724 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.625+0000 7ff2a1ffb640 10 monclient(hunting): my global_id is 4673 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48515/exe 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_c_write_operations: /' 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.725 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=cmd 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48653 2026-02-24T19:18:25.726 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.625+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 --> v1:1test cmd on pid 48653 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test cmd on pid 48653' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48653 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s handler_error 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' handler_error' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.728 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48551/exe ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ echo handler_error 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.729 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48551/exe 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ api_c_read_operations: /' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.730 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=handler_error 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48680 2026-02-24T19:18:25.731 INFO:tasks.workunit.client.0.trial194.stdout:test handler_error on pid 48680 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test handler_error on pid 48680' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48680 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s io 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_list_parallel.log 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' io' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ list_parallel: /' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ echo io 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.733 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48580/exe ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.734 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48580/exe 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=io 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48711 2026-02-24T19:18:25.735 INFO:tasks.workunit.client.0.trial194.stdout:test io on pid 48711 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test io on pid 48711' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48711 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s ec_io 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' ec_io' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.738 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ echo ec_io 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ open_pools_parallel: /' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.739 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48603/exe ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48603/exe 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=ec_io 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48736 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test ec_io on pid 48736' 2026-02-24T19:18:25.740 INFO:tasks.workunit.client.0.trial194.stdout:test ec_io on pid 48736 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48736 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s list 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' list' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ echo list 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.743 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48632/exe ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.744 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ delete_pools_parallel: /' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48632/exe 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=list 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48758 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test list on pid 48758' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.745 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.746 INFO:tasks.workunit.client.0.trial194.stdout:test list on pid 48758 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48758 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.748 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s ec_list 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48653/exe ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' ec_list' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ echo ec_list 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_cls 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.749 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_cls.log 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48653/exe 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ cls: /' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.750 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=ec_list 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_cmd 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48794 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test ec_list on pid 48794' 2026-02-24T19:18:25.751 INFO:tasks.workunit.client.0.trial194.stdout:test ec_list on pid 48794 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48794 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_cmd.log 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ cmd: /' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s misc 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' misc' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.753 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48680/exe ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ echo misc 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.754 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48680/exe 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=misc 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48818 2026-02-24T19:18:25.755 INFO:tasks.workunit.client.0.trial194.stdout:test misc on pid 48818 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test misc on pid 48818' 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48818 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s pool 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_handler_error 2026-02-24T19:18:25.758 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_handler_error.log 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48711/exe ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' pool' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ handler_error: /' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.759 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48711/exe 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ echo pool 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.760 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=pool 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48844 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test pool on pid 48844' 2026-02-24T19:18:25.761 INFO:tasks.workunit.client.0.trial194.stdout:test pool on pid 48844 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48844 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_io 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_io.log 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s read_operations 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ io: /' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' read_operations' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:++ echo read_operations 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.763 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48736/exe ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.764 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48736/exe 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=read_operations 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48895 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test read_operations on pid 48895' 2026-02-24T19:18:25.765 INFO:tasks.workunit.client.0.trial194.stdout:test read_operations on pid 48895 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48895 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s snapshots 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' snapshots' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.766 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48758/exe ']' 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:++ echo snapshots 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout:0.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff290001e10 con 0x5584b706d8e0 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.632+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123429572 0 0) 0x5584b7065b90 con 0x5584b6f7ac20 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.632+0000 7ff2a1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.632+0000 7ff2a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.632+0000 7ff2a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.632+0000 7ff2a1ffb640 10 monclient(hunting): my global_id is 4677 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.632+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5584b7067f70 con 0x5584b6f7ac20 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.647+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409020743 0 0) 0x5584b7066d70 con 0x5584b7013670 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.647+0000 7ff2a1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.647+0000 7ff2a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.647+0000 7ff2a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.647+0000 7ff2a1ffb640 10 monclient(hunting): my global_id is 4636 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.647+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5584b7065b90 con 0x5584b7013670 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 277424500 0 0) 0x7ff290001e10 con 0x5584b706d8e0 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 >> v1:10.20.193.114:6789/0 conn(0x5584b7013670 legacy=0x5584b7064380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 >> v1:10.20.193.45:6789/0 conn(0x5584b6f7ac20 legacy=0x5584b7012e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 1 monclient: found mon.noname-c 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b7069210 con 0x5584b706d8e0 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff298001700 con 0x5584b706d8e0 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:25.767 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.769 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48758/exe 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_ec_io 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_ec_io.log 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ ec_io: /' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.770 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=snapshots 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48923 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test snapshots on pid 48923' 2026-02-24T19:18:25.771 INFO:tasks.workunit.client.0.trial194.stdout: aptest snapshots on pid 48923 2026-02-24T19:18:25.773 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48923 2026-02-24T19:18:25.773 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.773 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.773 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_list 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s watch_notify 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_list.log 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ list: /' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' watch_notify' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ echo watch_notify 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.774 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.775 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48794/exe ']' 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=watch_notify 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48794/exe 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48961 2026-02-24T19:18:25.776 INFO:tasks.workunit.client.0.trial194.stdout:test watch_notify on pid 48961 2026-02-24T19:18:25.778 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test watch_notify on pid 48961' 2026-02-24T19:18:25.778 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48961 2026-02-24T19:18:25.778 INFO:tasks.workunit.client.0.trial194.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:25.778 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.778 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2026-02-24T19:18:25.778 INFO:tasks.workunit.client.0.trial194.stderr:++ printf %25s write_operations 2026-02-24T19:18:25.778 INFO:tasks.workunit.client.0.trial194.stderr:+ r=' write_operations' 2026-02-24T19:18:25.778 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ echo write_operations 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48818/exe ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ awk '{print $1}' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.779 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48818/exe 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.780 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_ec_list 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_ec_list.log 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ ec_list: /' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.781 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:+ ff=write_operations 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48997 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:+ echo 'test write_operations on pid 48997' 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2026-02-24T19:18:25.782 INFO:tasks.workunit.client.0.trial194.stdout:test write_operations on pid 48997 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ pids[$f]=48997 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ ret=0 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48036 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48036 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_misc 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_misc.log 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ misc: /' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.789 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+ . /etc/bashrc 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -z '' ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ shopt -q login_shell 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ umask 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48844/exe ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:25.790 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48844/exe 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48895/exe ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48895/exe 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.791 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_pool 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_pool.log 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ return 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ pool: /' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ S_COLORS=auto 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.792 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_read_operations 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_read_operations.log 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ read_operations: /' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.793 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48923/exe ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48923/exe 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.794 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_snapshots 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48961/exe ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_snapshots.log 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48961/exe 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ prefix=/usr 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ snapshots: /' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset prefix 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/locale 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:25.795 INFO:tasks.workunit.client.0.trial194.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_watch_notify 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_watch_notify.log 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ watch_notify: /' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ unset LANG_backup config 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ '[' '' ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ '[' -r /proc/48997/exe ']' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++++ readlink /proc/48997/exe 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ which_opt=-f 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ export which_declare 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+++ export -f which 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ unset i 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:++ unset -f pathmunge 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ export PATH 2026-02-24T19:18:25.796 INFO:tasks.workunit.client.0.trial194.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stderr:+ unset rc 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stderr:+ ceph_test_neorados_write_operations 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stderr:+ tee ceph_test_neorados_write_operations.log 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stderr:+ sed 's/^/ write_operations: /' 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout:i_asio: 2026-02-24T19:18:25.651+0000 7ff2a1ffb640 10 monclient: dump: 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: epoch 1 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2aa354880 5 monclient: authenticate success, global_id 4673 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.651+0000 7ff2aa354880 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.714+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2980018d0 con 0x5584b706d8e0 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.714+0000 7ff2a1ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.714+0000 7ff2a1ffb640 1 -- 10.20.193.194:0/641848905 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff298001ce0 con 0x5584b706d8e0 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.714+0000 7ff2a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.714+0000 7ff2a1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.714+0000 7ff2a1ffb640 10 monclient: dump: 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: epoch 1 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.714+0000 7ff2aa354880 10 monclient: get_monmap_and_config success 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.714+0000 7ff2aa354880 4 set_mon_vals no callback set 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient: shutdown 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:25.797 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 -- 10.20.193.194:0/641848905 >> v1:10.20.193.179:6789/0 conn(0x5584b706d8e0 legacy=0x5584b7062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 -- 10.20.193.194:0/641848905 shutdown_connections 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 -- 10.20.193.194:0/641848905 >> 10.20.193.194:0/641848905 conn(0x5584b7000a90 msgr2=0x5584b700d770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 -- 10.20.193.194:0/641848905 shutdown_connections 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 -- 10.20.193.194:0/641848905 wait complete. 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient: build_initial_monmap 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient: monmap: 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: epoch 0 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: last_changed 0.000000 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: created 0.000000 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: election_strategy: 1 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 librados: starting msgr at 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 librados: starting objecter 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 Processor -- start 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 -- start start 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 librados: setting wanted keys 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 librados: calling monclient init 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient: init 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient: _reopen_session rank -1 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient(hunting): picked mon.noname-a con 0x5584b6f7ac20 addr v1:10.20.193.45:6789/0 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient(hunting): picked mon.noname-b con 0x5584b7013670 addr v1:10.20.193.114:6789/0 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient(hunting): picked mon.noname-c con 0x5584b706d8e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5584b70128b0 con 0x5584b6f7ac20 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5584b7014ce0 con 0x5584b7013670 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5584b7015ec0 con 0x5584b706d8e0 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient(hunting): _renew_subs 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.715+0000 7ff2aa354880 10 monclient(hunting): authenticate will time out at 3679.372712s 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.735+0000 7ff2a3fff640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x5584b706d8e0 0x5584b7064380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.194:52708/0 (socket says 10.20.193.194:52708) 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.735+0000 7ff2a3fff640 1 -- 10.20.193.194:0/181633659 learned_addr learned my addr 10.20.193.194:0/181633659 (peer_addr_for_me v1:10.20.193.194:0/0) 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.736+0000 7ff2a0ff9640 10 client.?.objecter ms_handle_connect 0x5584b706d8e0 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.736+0000 7ff2a0ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.753+0000 7ff2a0ff9640 10 client.?.objecter ms_handle_connect 0x5584b6f7ac20 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.753+0000 7ff2a0ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.762+0000 7ff2a0ff9640 10 client.?.objecter ms_handle_connect 0x5584b7013670 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.762+0000 7ff2a0ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.764+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358311337 0 0) 0x5584b7015ec0 con 0x5584b706d8e0 2026-02-24T19:18:25.798 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.764+0000 7ff2a0ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:25.819 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.764+0000 7ff2a0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:25.819 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.764+0000 7ff2a0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:25.819 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.764+0000 7ff2a0ff9640 10 monclient(hunting): my global_id is 4796 2026-02-24T19:18:25.819 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.764+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff290001b30 con 0x5584b706d8e0 2026-02-24T19:18:25.819 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.788+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330148619 0 0) 0x5584b7014ce0 con 0x5584b7013670 2026-02-24T19:18:25.819 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.788+0000 7ff2a0ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:25.819 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.788+0000 7ff2a0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:25.819 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.788+0000 7ff2a0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:25.819 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.788+0000 7ff2a0ff9640 10 monclient(hunting): my global_id is 4765 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.788+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5584b7015ec0 con 0x5584b7013670 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.798+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438635589 0 0) 0x5584b70128b0 con 0x5584b6f7ac20 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.798+0000 7ff2a0ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.798+0000 7ff2a0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.798+0000 7ff2a0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.798+0000 7ff2a0ff9640 10 monclient(hunting): my global_id is 4800 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.798+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x5584b7014ce0 con 0x5584b6f7ac20 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.802+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2572507367 0 0) 0x7ff290001b30 con 0x5584b706d8e0 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.802+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5584b70128b0 con 0x5584b706d8e0 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.802+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff29c001c00 con 0x5584b706d8e0 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.802+0000 7ff2a0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.802+0000 7ff2a0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.802+0000 7ff2a0ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: epoch 1 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.820 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.802+0000 7ff2a0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.817+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2895413424 0 0) 0x5584b7015ec0 con 0x5584b7013670 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.817+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff290001b30 con 0x5584b7013670 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.817+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff298001a60 con 0x5584b7013670 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.817+0000 7ff2a0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.817+0000 7ff2a0ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.817+0000 7ff2a0ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: epoch 1 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1373623781 0 0) 0x5584b70128b0 con 0x5584b706d8e0 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 >> v1:10.20.193.114:6789/0 conn(0x5584b7013670 legacy=0x5584b7062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 >> v1:10.20.193.45:6789/0 conn(0x5584b6f7ac20 legacy=0x5584b7011e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 1 monclient: found mon.c 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b70170f0 con 0x5584b706d8e0 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 10 monclient: _finish_auth 0 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2a0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 5 monclient: authenticate success, global_id 4796 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 10 monclient: _renew_subs 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x5584b7013cd0 con 0x5584b706d8e0 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 10 client.4796.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 10 monclient: _renew_subs 2026-02-24T19:18:25.851 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x5584b70141a0 con 0x5584b706d8e0 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 1 librados: init done 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.848+0000 7ff2aa354880 10 librados: wait_for_osdmap waiting 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.880+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff29c002220 con 0x5584b706d8e0 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.880+0000 7ff2a0ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.880+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff29c003970 con 0x5584b706d8e0 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.880+0000 7ff2a0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.880+0000 7ff2a0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.880+0000 7ff2a0ff9640 10 monclient: dump: 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: epoch 1 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.040 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.880+0000 7ff2a1ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.881+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7ff29c01c7e0 con 0x5584b706d8e0 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.881+0000 7ff2a37fe640 10 monclient: get_auth_request con 0x7ff290076a30 auth_method 0 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.881+0000 7ff2a0ff9640 10 client.4796.objecter ms_handle_connect 0x7ff290076a30 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.882+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 3615916088 0 0) 0x7ff29c091eb0 con 0x5584b706d8e0 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.882+0000 7ff2a0ff9640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_map(30..30 src has 1..30) 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.882+0000 7ff2a0ff9640 3 client.4796.objecter handle_osd_map got epochs [30,30] > 0 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.882+0000 7ff2a0ff9640 3 client.4796.objecter handle_osd_map decoding full epoch 30 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.882+0000 7ff2a0ff9640 20 client.4796.objecter dump_active .. 0 homeless 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.882+0000 7ff2aa354880 10 librados: wait_for_osdmap done waiting 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.882+0000 7ff2aa354880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:25.882+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x5584b6f28da0 con 0x5584b706d8e0 2026-02-24T19:18:26.041 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.037+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (unknown 1262516695 0 0) 0x7ff29c05bfb0 con 0x5584b706d8e0 2026-02-24T19:18:26.042 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.037+0000 7ff2a0ff9640 10 monclient: handle_get_version_reply finishing 1 version 30 2026-02-24T19:18:26.569 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.037+0000 7ff2a17fa640 10 client.4796.objecter _get_latest_version latest 30, have it 2026-02-24T19:18:26.570 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.037+0000 7ff2aa354880 10 client.4796.objecter create_pool name=ceph_test_rados_api_asio 2026-02-24T19:18:26.570 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.037+0000 7ff2aa354880 10 client.4796.objecter pool_op_submit 1 2026-02-24T19:18:26.570 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.037+0000 7ff2aa354880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:18:26.570 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.037+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.179:6789/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x5584b6ead570 con 0x5584b706d8e0 2026-02-24T19:18:26.570 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 10 ==== pool_op_reply(tid 1 (0) Success v31) ==== 43+0+0 (unknown 669827117 0 0) 0x7ff29c05c8e0 con 0x5584b706d8e0 2026-02-24T19:18:26.570 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 pool_op_reply(tid 1 (0) Success v31) 2026-02-24T19:18:26.570 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 10 client.4796.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v31) 2026-02-24T19:18:26.570 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 10 client.4796.objecter have request 1 at 0x5584b708fba0 Op: create 2026-02-24T19:18:26.570 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 20 client.4796.objecter waiting for client to reach epoch 31 before calling back 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 10 client.4796.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 10 monclient: _renew_subs 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=31}) -- 0x5584b70128b0 con 0x5584b706d8e0 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.559+0000 7ff2a0ff9640 10 client.4796.objecter done 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== mon.2 v1:10.20.193.179:6789/0 11 ==== osd_map(31..31 src has 1..31) ==== 8381+0+0 (unknown 417873938 0 0) 0x7ff29c058170 con 0x5584b706d8e0 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2a0ff9640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_map(31..31 src has 1..31) 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2a0ff9640 3 client.4796.objecter handle_osd_map got epochs [31,31] > 30 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2a0ff9640 3 client.4796.objecter handle_osd_map decoding incremental epoch 31 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2a0ff9640 20 client.4796.objecter dump_active .. 0 homeless 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 10 librados: set snap read head -> 1 2026-02-24T19:18:26.571 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 10 librados: writefull oid=exist nspace= 2026-02-24T19:18:26.572 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b7014490 2026-02-24T19:18:26.572 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 31 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:26.572 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:26.572 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:26.572 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:26.572 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 2 osd.7 2026-02-24T19:18:29.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:29.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 2 2026-02-24T19:18:29.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 15 client.4796.objecter _send_op 2 to 21.1 on osd.7 2026-02-24T19:18:29.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:2 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5584b70182d0 con 0x5584b70165a0 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.567+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.603+0000 7ff2a2ffd640 10 monclient: get_auth_request con 0x5584b70165a0 auth_method 0 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:26.616+0000 7ff2a0ff9640 10 client.4796.objecter ms_handle_connect 0x5584b70165a0 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.682+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 1 ==== osd_map(32..32 src has 1..32) ==== 13597+0+0 (unknown 3337620883 0 0) 0x7ff298001c80 con 0x5584b70165a0 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.682+0000 7ff2a0ff9640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_map(32..32 src has 1..32) 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.682+0000 7ff2a0ff9640 3 client.4796.objecter handle_osd_map got epochs [32,32] > 31 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.682+0000 7ff2a0ff9640 3 client.4796.objecter handle_osd_map decoding incremental epoch 32 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.682+0000 7ff2a0ff9640 10 client.4796.objecter checking op 2 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.682+0000 7ff2a0ff9640 20 client.4796.objecter _calc_target epoch 32 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.682+0000 7ff2a0ff9640 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:29.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.682+0000 7ff2a0ff9640 20 client.4796.objecter dump_active .. 0 homeless 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.682+0000 7ff2a0ff9640 20 client.4796.objecter 2 21.d3a59201 osd.7 exist [writefull 0~5 in=5b] 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.715+0000 7ff28b7fe640 10 monclient: tick 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.715+0000 7ff28b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.715+0000 7ff28b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:28.715+0000 7ff28b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 2 ==== osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) ==== 149+0+0 (unknown 4026376448 0 0) 0x7ff298004340 con 0x5584b70165a0 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 2 ondisk uv 1 in 21.1 attempt 0 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 2 2026-02-24T19:18:29.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 2 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 2 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 10 librados: Objecter returned from writefull r=0 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b7014eb0 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 32 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 10 client.4796.objecter chose random osd.9 of [7,9] 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 3 osd.9 2026-02-24T19:18:29.357 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 9 3 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 15 client.4796.objecter _send_op 3 to 21.1 on osd.9 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6800/2864194603 -- osd_op(unknown.0.0:3 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x5584b7019db0 con 0x5584b7015870 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701a2c0 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 32 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:29.358 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~256] tid 4 osd.7 2026-02-24T19:18:29.359 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:29.359 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 4 2026-02-24T19:18:29.359 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 15 client.4796.objecter _send_op 4 to 21.1 on osd.7 2026-02-24T19:18:29.359 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:4 21.1 21:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x5584b701a770 con 0x5584b70165a0 2026-02-24T19:18:29.910 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:29.910 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.351+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2046856225 0 0) 0x7ff298004340 con 0x5584b70165a0 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 4 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 4 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 4 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:29.911 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 4 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.372+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.650+0000 7ff2a37fe640 10 monclient: get_auth_request con 0x5584b7015870 auth_method 0 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.661+0000 7ff2a0ff9640 10 client.4796.objecter ms_handle_connect 0x5584b7015870 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.715+0000 7ff28b7fe640 10 monclient: tick 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.715+0000 7ff28b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.715+0000 7ff28b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.906+0000 7ff2a0ff9640 1 -- 10.20.193.194:0/181633659 <== osd.9 v1:10.20.193.114:6800/2864194603 1 ==== osd_map(33..33 src has 1..33) ==== 5449+0+0 (unknown 892178151 0 0) 0x7ff294002c20 con 0x5584b7015870 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.906+0000 7ff2a0ff9640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_map(33..33 src has 1..33) 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.906+0000 7ff2a0ff9640 3 client.4796.objecter handle_osd_map got epochs [33,33] > 32 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.906+0000 7ff2a0ff9640 3 client.4796.objecter handle_osd_map decoding incremental epoch 33 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.906+0000 7ff2a0ff9640 10 client.4796.objecter checking op 3 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.906+0000 7ff2a0ff9640 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:29.912 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.906+0000 7ff2a0ff9640 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:29.913 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.906+0000 7ff2a0ff9640 20 client.4796.objecter dump_active .. 0 homeless 2026-02-24T19:18:29.913 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.906+0000 7ff2a0ff9640 20 client.4796.objecter 3 21.d3a59201 osd.9 exist [read 0~256] 2026-02-24T19:18:30.140 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 <== osd.9 v1:10.20.193.114:6800/2864194603 2 ==== osd_op_reply(3 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 828533565 0 0) 0x7ff294006060 con 0x5584b7015870 2026-02-24T19:18:30.140 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(3 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:30.140 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 7 client.4796.objecter handle_osd_op_reply 3 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 7 client.4796.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 15 client.4796.objecter _session_op_remove 9 3 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 10 client.4796.objecter _op_submit op 0x5584b7014eb0 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 5 osd.7 2026-02-24T19:18:30.141 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 15 client.4796.objecter _session_op_assign 7 5 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 15 client.4796.objecter _send_op 5 to 21.1 on osd.7 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:5 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b7019db0 con 0x5584b70165a0 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:29.907+0000 7ff2a37fe640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.137+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 3741457435 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.137+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.137+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.137+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 5 ondisk uv 1 in 21.1 attempt 1 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.137+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.137+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 5 2026-02-24T19:18:30.142 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.137+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 5 2026-02-24T19:18:30.143 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.137+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.143 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.137+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 5 2026-02-24T19:18:30.215 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.215 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (786 ms) 2026-02-24T19:18:30.215 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadDeferred 2026-02-24T19:18:30.215 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b7014eb0 2026-02-24T19:18:30.215 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.215 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 10 client.4796.objecter chose random osd.9 of [7,9] 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 6 osd.9 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 9 6 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 15 client.4796.objecter _send_op 6 to 21.1 on osd.9 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6800/2864194603 -- osd_op(unknown.0.0:6 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701a2a0 con 0x5584b7015870 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701ac40 2026-02-24T19:18:30.216 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~256] tid 7 osd.7 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 7 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 15 client.4796.objecter _send_op 7 to 21.1 on osd.7 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:7 21.1 21:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701b0f0 con 0x5584b70165a0 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.217 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.138+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.225 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 5 ==== osd_op_reply(7 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4228161419 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.225 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(7 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.225 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.225 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 7 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.225 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.225 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.225 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 7 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 7 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 7 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.212+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 <== osd.9 v1:10.20.193.114:6800/2864194603 3 ==== osd_op_reply(6 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 828533565 0 0) 0x7ff294006060 con 0x5584b7015870 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(6 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 7 client.4796.objecter handle_osd_op_reply 6 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 7 client.4796.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 15 client.4796.objecter _session_op_remove 9 6 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 10 client.4796.objecter _op_submit op 0x5584b7014eb0 2026-02-24T19:18:30.226 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.227 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.227 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.227 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.227 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 8 osd.7 2026-02-24T19:18:30.227 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.227 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 15 client.4796.objecter _session_op_assign 7 8 2026-02-24T19:18:30.227 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 15 client.4796.objecter _send_op 8 to 21.1 on osd.7 2026-02-24T19:18:30.247 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:8 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b701a2a0 con 0x5584b70165a0 2026-02-24T19:18:30.247 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.247 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.222+0000 7ff2a37fe640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 6 ==== osd_op_reply(8 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 3741457435 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(8 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 8 ondisk uv 1 in 21.1 attempt 1 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 8 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 8 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 8 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadDeferred (107 ms) 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2026-02-24T19:18:30.248 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b7014eb0 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 9 osd.7 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 9 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 15 client.4796.objecter _send_op 9 to 21.1 on osd.7 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:9 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ac40 con 0x5584b70165a0 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.249 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701b5c0 2026-02-24T19:18:30.258 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.258 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.258 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.258 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.258 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.258 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~256] tid 10 osd.7 2026-02-24T19:18:30.258 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 10 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 15 client.4796.objecter _send_op 10 to 21.1 on osd.7 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:10 21.1 21:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ba70 con 0x5584b70165a0 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.245+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 7 ==== osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 1809804114 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 9 ondisk uv 1 in 21.1 attempt 0 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 9 2026-02-24T19:18:30.259 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 9 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 9 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.254+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 8 ==== osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4228161419 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 10 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 10 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 10 2026-02-24T19:18:30.260 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 10 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (10 ms) 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701b570 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 11 osd.7 2026-02-24T19:18:30.261 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 11 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 15 client.4796.objecter _send_op 11 to 21.1 on osd.7 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:11 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b7014fc0 con 0x5584b70165a0 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701c090 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~256] tid 12 osd.7 2026-02-24T19:18:30.262 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.263 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 12 2026-02-24T19:18:30.286 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 15 client.4796.objecter _send_op 12 to 21.1 on osd.7 2026-02-24T19:18:30.286 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:12 21.1 21:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701c540 con 0x5584b70165a0 2026-02-24T19:18:30.286 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.286 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.255+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.286 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 9 ==== osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 1809804114 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.286 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:30.286 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 11 ondisk uv 1 in 21.1 attempt 0 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 11 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 11 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 11 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 10 ==== osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4228161419 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 12 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.287 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.288 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.288 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 12 2026-02-24T19:18:30.288 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 12 2026-02-24T19:18:30.288 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.288 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (28 ms) 2026-02-24T19:18:30.288 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 12 2026-02-24T19:18:30.288 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.288 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadAwaitable 2026-02-24T19:18:30.288 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701b570 2026-02-24T19:18:30.299 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.299 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.299 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.299 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.299 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 13 osd.7 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 13 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 15 client.4796.objecter _send_op 13 to 21.1 on osd.7 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:13 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701c070 con 0x5584b70165a0 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701c570 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.300 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 10 client.4796.objecter chose random osd.9 of [7,9] 2026-02-24T19:18:30.301 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.301 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~256] tid 14 osd.9 2026-02-24T19:18:30.301 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.301 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 9 14 2026-02-24T19:18:30.301 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 15 client.4796.objecter _send_op 14 to 21.1 on osd.9 2026-02-24T19:18:30.301 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6800/2864194603 -- osd_op(unknown.0.0:14 21.1 21:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ca20 con 0x5584b7015870 2026-02-24T19:18:30.301 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.301 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.283+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.301 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 11 ==== osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 1809804114 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 13 ondisk uv 1 in 21.1 attempt 0 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 13 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 13 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 13 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.296+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.302 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 <== osd.9 v1:10.20.193.114:6800/2864194603 4 ==== osd_op_reply(14 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4228161419 0 0) 0x7ff294006060 con 0x5584b7015870 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(14 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 7 client.4796.objecter handle_osd_op_reply 14 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 15 client.4796.objecter handle_osd_op_reply completed tid 14 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 15 client.4796.objecter _finish_op 14 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 15 client.4796.objecter _session_op_remove 9 14 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2a37fe640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadAwaitable (13 ms) 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2026-02-24T19:18:30.303 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:30.304 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b701c070 write_seq 1 2026-02-24T19:18:30.304 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701c570 2026-02-24T19:18:30.304 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.304 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.304 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.304 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.304 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [write 0~5 in=5b] tid 15 osd.7 2026-02-24T19:18:30.304 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.337 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 15 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 15 client.4796.objecter _send_op 15 to 21.1 on osd.7 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:15 21.1 21:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b701b570 con 0x5584b70165a0 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.297+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 12 ==== osd_op_reply(15 exist [write 0~5] v33'2 uv2 ondisk = 0) ==== 149+0+0 (unknown 719135878 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(15 exist [write 0~5] v33'2 uv2 ondisk = 0) 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 15 ondisk uv 2 in 21.1 attempt 0 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.338 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 15 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 15 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 15 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b701c070 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (37 ms) 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteDeferred 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b701c1a0 write_seq 2 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701c570 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.339 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.340 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.340 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.340 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [write 0~5 in=5b] tid 16 osd.7 2026-02-24T19:18:30.340 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.340 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 16 2026-02-24T19:18:30.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 15 client.4796.objecter _send_op 16 to 21.1 on osd.7 2026-02-24T19:18:30.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:16 21.1 21:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b701b570 con 0x5584b70165a0 2026-02-24T19:18:30.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.335+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:30.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 13 ==== osd_op_reply(16 exist [write 0~5] v33'3 uv3 ondisk = 0) ==== 149+0+0 (unknown 1583193938 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(16 exist [write 0~5] v33'3 uv3 ondisk = 0) 2026-02-24T19:18:30.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.354 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 16 ondisk uv 3 in 21.1 attempt 0 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 16 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 16 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 16 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b701c1a0 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteDeferred (16 ms) 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b701c2d0 write_seq 3 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701c570 2026-02-24T19:18:30.355 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [write 0~5 in=5b] tid 17 osd.7 2026-02-24T19:18:30.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 17 2026-02-24T19:18:30.356 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 15 client.4796.objecter _send_op 17 to 21.1 on osd.7 2026-02-24T19:18:30.366 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:17 21.1 21:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b701b570 con 0x5584b70165a0 2026-02-24T19:18:30.366 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.351+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 14 ==== osd_op_reply(17 exist [write 0~5] v33'4 uv4 ondisk = 0) ==== 149+0+0 (unknown 338872975 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(17 exist [write 0~5] v33'4 uv4 ondisk = 0) 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 17 ondisk uv 4 in 21.1 attempt 0 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 17 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 17 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.367 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 17 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b701c2d0 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (12 ms) 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b701df00 write_seq 4 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701c570 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [write 0~5 in=5b] tid 18 osd.7 2026-02-24T19:18:30.368 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.369 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 18 2026-02-24T19:18:30.369 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 15 client.4796.objecter _send_op 18 to 21.1 on osd.7 2026-02-24T19:18:30.369 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:18 21.1 21:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b71bc0d0 con 0x5584b70165a0 2026-02-24T19:18:30.396 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.396 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.396 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.364+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:30.396 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 15 ==== osd_op_reply(18 exist [write 0~5] v33'5 uv5 ondisk = 0) ==== 149+0+0 (unknown 1622307163 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.396 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(18 exist [write 0~5] v33'5 uv5 ondisk = 0) 2026-02-24T19:18:30.396 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.396 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 18 ondisk uv 5 in 21.1 attempt 0 2026-02-24T19:18:30.397 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.397 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 18 2026-02-24T19:18:30.397 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 18 2026-02-24T19:18:30.397 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.397 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 18 2026-02-24T19:18:30.397 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.397 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b701df00 2026-02-24T19:18:30.397 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (29 ms) 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b71bc470 write_seq 5 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [write 0~5 in=5b] tid 19 osd.7 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 19 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 15 client.4796.objecter _send_op 19 to 21.1 on osd.7 2026-02-24T19:18:30.398 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:19 21.1 21:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b717c560 con 0x5584b70165a0 2026-02-24T19:18:30.399 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.399 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.413 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.393+0000 7ff2aa354880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:30.413 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 16 ==== osd_op_reply(19 exist [write 0~5] v33'6 uv6 ondisk = 0) ==== 149+0+0 (unknown 4248026407 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.413 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(19 exist [write 0~5] v33'6 uv6 ondisk = 0) 2026-02-24T19:18:30.413 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.413 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 19 ondisk uv 6 in 21.1 attempt 0 2026-02-24T19:18:30.413 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.413 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 19 2026-02-24T19:18:30.413 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 19 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 19 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b71bc470 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteAwaitable (16 ms) 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 10 client.4796.objecter chose random osd.9 of [7,9] 2026-02-24T19:18:30.414 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 20 osd.9 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 9 20 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 15 client.4796.objecter _send_op 20 to 21.1 on osd.9 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6800/2864194603 -- osd_op(unknown.0.0:20 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b717c560 con 0x5584b7015870 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701ce10 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.415 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.416 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.416 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.416 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~0] tid 21 osd.7 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 21 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 15 client.4796.objecter _send_op 21 to 21.1 on osd.7 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:21 21.1 21:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701d2c0 con 0x5584b70165a0 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.410+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 17 ==== osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2441912755 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 21 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.417 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 21 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 21 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 21 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.413+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 <== osd.9 v1:10.20.193.114:6800/2864194603 5 ==== osd_op_reply(20 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 1558861061 0 0) 0x7ff294006060 con 0x5584b7015870 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(20 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 7 client.4796.objecter handle_osd_op_reply 20 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.418 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 7 client.4796.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 15 client.4796.objecter _session_op_remove 9 20 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 22 osd.7 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.420 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 15 client.4796.objecter _session_op_assign 7 22 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 15 client.4796.objecter _send_op 22 to 21.1 on osd.7 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:22 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b717c560 con 0x5584b70165a0 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.414+0000 7ff2a37fe640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 18 ==== osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 2574368800 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 22 ondisk uv 6 in 21.1 attempt 1 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 22 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 22 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.421 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 22 2026-02-24T19:18:30.422 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.422 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (6 ms) 2026-02-24T19:18:30.422 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-24T19:18:30.422 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.422 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.422 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.424 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.424 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.424 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.424 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 23 osd.7 2026-02-24T19:18:30.424 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 23 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 15 client.4796.objecter _send_op 23 to 21.1 on osd.7 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:23 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.425 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~0] tid 24 osd.7 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 24 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 15 client.4796.objecter _send_op 24 to 21.1 on osd.7 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:24 21.1 21:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701d2c0 con 0x5584b70165a0 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.417+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 19 ==== osd_op_reply(23 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 766293865 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(23 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.426 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 23 ondisk uv 6 in 21.1 attempt 0 2026-02-24T19:18:30.427 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.427 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 23 2026-02-24T19:18:30.427 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 23 2026-02-24T19:18:30.427 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.427 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 23 2026-02-24T19:18:30.427 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.427 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 20 ==== osd_op_reply(24 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2441912755 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.427 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(24 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.427 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 24 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 24 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 24 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 24 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationDeferred (5 ms) 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.428 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.429 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.429 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.429 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.429 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 25 osd.7 2026-02-24T19:18:30.429 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.429 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 25 2026-02-24T19:18:30.429 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 15 client.4796.objecter _send_op 25 to 21.1 on osd.7 2026-02-24T19:18:30.431 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:25 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.431 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.431 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.431 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.431 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.431 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 10 client.4796.objecter chose random osd.9 of [7,9] 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~0] tid 26 osd.9 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 9 26 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 15 client.4796.objecter _send_op 26 to 21.1 on osd.9 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6800/2864194603 -- osd_op(unknown.0.0:26 21.1 21:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b717c560 con 0x5584b7015870 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.422+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 <== osd.9 v1:10.20.193.114:6800/2864194603 6 ==== osd_op_reply(26 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2441912755 0 0) 0x7ff294006060 con 0x5584b7015870 2026-02-24T19:18:30.432 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(26 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 7 client.4796.objecter handle_osd_op_reply 26 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 15 client.4796.objecter handle_osd_op_reply completed tid 26 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 15 client.4796.objecter _finish_op 26 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 15 client.4796.objecter _session_op_remove 9 26 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.426+0000 7ff2a37fe640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 21 ==== osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 766293865 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:30.433 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 25 ondisk uv 6 in 21.1 attempt 0 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 25 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 25 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 25 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (6 ms) 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.434 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 10 client.4796.objecter chose random osd.9 of [7,9] 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 27 osd.9 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 9 27 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 15 client.4796.objecter _send_op 27 to 21.1 on osd.9 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6800/2864194603 -- osd_op(unknown.0.0:27 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b7015870 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.435 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.436 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.436 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.436 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~0] tid 28 osd.7 2026-02-24T19:18:30.436 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.436 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 28 2026-02-24T19:18:30.436 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 15 client.4796.objecter _send_op 28 to 21.1 on osd.7 2026-02-24T19:18:30.436 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:28 21.1 21:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b719cb30 con 0x5584b70165a0 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.428+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 <== osd.9 v1:10.20.193.114:6800/2864194603 7 ==== osd_op_reply(27 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 1558861061 0 0) 0x7ff294006060 con 0x5584b7015870 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(27 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 7 client.4796.objecter handle_osd_op_reply 27 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 7 client.4796.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 15 client.4796.objecter _session_op_remove 9 27 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.437 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.438 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.438 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.438 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 29 osd.7 2026-02-24T19:18:30.438 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.438 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 15 client.4796.objecter _session_op_assign 7 29 2026-02-24T19:18:30.438 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 15 client.4796.objecter _send_op 29 to 21.1 on osd.7 2026-02-24T19:18:30.438 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:29 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.438 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.439 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.431+0000 7ff2a37fe640 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.439 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 22 ==== osd_op_reply(28 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2441912755 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.439 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(28 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.439 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.439 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 28 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.439 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.439 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.439 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 28 2026-02-24T19:18:30.439 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 28 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 28 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.432+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 23 ==== osd_op_reply(29 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 2574368800 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(29 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 29 ondisk uv 6 in 21.1 attempt 1 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 29 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 29 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 29 2026-02-24T19:18:30.440 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (5 ms) 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 10 client.4796.objecter chose random osd.9 of [7,9] 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 30 osd.9 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 9 30 2026-02-24T19:18:30.441 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 15 client.4796.objecter _send_op 30 to 21.1 on osd.9 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6800/2864194603 -- osd_op(unknown.0.0:30 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b7015870 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 10 client.4796.objecter chose random osd.7 of [7,9] 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [read 0~0] tid 31 osd.7 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.442 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 31 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 15 client.4796.objecter _send_op 31 to 21.1 on osd.7 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:31 21.1 21:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b717cb20 con 0x5584b70165a0 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.434+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 24 ==== osd_op_reply(31 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2441912755 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(31 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 31 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.443 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 31 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 31 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 31 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 <== osd.9 v1:10.20.193.114:6800/2864194603 8 ==== osd_op_reply(30 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 1558861061 0 0) 0x7ff294006060 con 0x5584b7015870 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(30 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 7 client.4796.objecter handle_osd_op_reply 30 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.444 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 7 client.4796.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 15 client.4796.objecter _session_op_remove 9 30 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 10 client.4796.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 32 osd.7 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 15 client.4796.objecter _session_op_assign 7 32 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 15 client.4796.objecter _send_op 32 to 21.1 on osd.7 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:32 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.445 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.446 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.436+0000 7ff2a37fe640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.446 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 25 ==== osd_op_reply(32 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 2574368800 0 3741568377) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.446 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(32 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:30.457 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 32 ondisk uv 6 in 21.1 attempt 1 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 5 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 32 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 32 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 32 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationAwaitable (5 ms) 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b701c850 write_seq 6 2026-02-24T19:18:30.458 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 33 osd.7 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 33 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 15 client.4796.objecter _send_op 33 to 21.1 on osd.7 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:33 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b717cb20 con 0x5584b70165a0 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.439+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.459 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 26 ==== osd_op_reply(33 exist [writefull 0~5] v33'7 uv7 ondisk = 0) ==== 149+0+0 (unknown 344240231 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.460 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(33 exist [writefull 0~5] v33'7 uv7 ondisk = 0) 2026-02-24T19:18:30.460 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.460 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 33 ondisk uv 7 in 21.1 attempt 0 2026-02-24T19:18:30.460 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.460 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 33 2026-02-24T19:18:30.460 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 33 2026-02-24T19:18:30.470 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.470 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 33 2026-02-24T19:18:30.470 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b701c850 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (15 ms) 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b701d300 write_seq 7 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 34 osd.7 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.471 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 34 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 15 client.4796.objecter _send_op 34 to 21.1 on osd.7 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:34 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.455+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 27 ==== osd_op_reply(34 exist [writefull 0~5] v33'8 uv8 ondisk = 0) ==== 149+0+0 (unknown 4107968521 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(34 exist [writefull 0~5] v33'8 uv8 ondisk = 0) 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 34 ondisk uv 8 in 21.1 attempt 0 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 34 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 34 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.472 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 34 2026-02-24T19:18:30.473 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationDeferred (12 ms) 2026-02-24T19:18:30.473 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-24T19:18:30.482 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.482 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b701d300 2026-02-24T19:18:30.482 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b701c850 write_seq 8 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 35 osd.7 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 35 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 15 client.4796.objecter _send_op 35 to 21.1 on osd.7 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:35 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.483 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.468+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 28 ==== osd_op_reply(35 exist [writefull 0~5] v33'9 uv9 ondisk = 0) ==== 149+0+0 (unknown 2153389021 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(35 exist [writefull 0~5] v33'9 uv9 ondisk = 0) 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 35 ondisk uv 9 in 21.1 attempt 0 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 35 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 35 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 35 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b701c850 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (12 ms) 2026-02-24T19:18:30.484 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-24T19:18:30.485 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b701d330 write_seq 9 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 36 osd.7 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 36 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 15 client.4796.objecter _send_op 36 to 21.1 on osd.7 2026-02-24T19:18:30.495 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:36 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.480+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 29 ==== osd_op_reply(36 exist [writefull 0~5] v33'10 uv10 ondisk = 0) ==== 149+0+0 (unknown 500946849 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(36 exist [writefull 0~5] v33'10 uv10 ondisk = 0) 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 36 ondisk uv 10 in 21.1 attempt 0 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 36 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 36 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 36 2026-02-24T19:18:30.496 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.497 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b701d330 2026-02-24T19:18:30.497 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (12 ms) 2026-02-24T19:18:30.497 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-24T19:18:30.497 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b701c850 write_seq 10 2026-02-24T19:18:30.497 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717c0b0 2026-02-24T19:18:30.497 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.497 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.507 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.507 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.507 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 37 osd.7 2026-02-24T19:18:30.507 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.507 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 37 2026-02-24T19:18:30.507 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 15 client.4796.objecter _send_op 37 to 21.1 on osd.7 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:37 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.492+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 30 ==== osd_op_reply(37 exist [writefull 0~5] v33'11 uv11 ondisk = 0) ==== 149+0+0 (unknown 1767599221 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(37 exist [writefull 0~5] v33'11 uv11 ondisk = 0) 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 37 ondisk uv 11 in 21.1 attempt 0 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 37 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 37 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.508 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 37 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b701c850 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationAwaitable (11 ms) 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyCallback 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717c0b0 linger_id 1 cookie 94028495831216 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 1 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.509 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 15 client.4796.objecter send_linger 1 register 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [notify cookie 94028495831216 in=17b] tid 38 osd.7 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 38 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 15 client.4796.objecter _send_op 38 to 21.1 on osd.7 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:38 21.1 21:8049a5cb:::exist:head [notify cookie 94028495831216 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.510 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717ef10 linger_id 2 cookie 94028495843088 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 2 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 15 client.4796.objecter send_linger 2 register 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b7180350 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.511 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.512 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [notify cookie 94028495843088 in=17b] tid 39 osd.7 2026-02-24T19:18:30.512 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.512 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 39 2026-02-24T19:18:30.520 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 15 client.4796.objecter _send_op 39 to 21.1 on osd.7 2026-02-24T19:18:30.520 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:39 21.1 21:855dde50:::noexist:head [notify cookie 94028495843088 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.520 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.520 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.504+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.520 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 31 ==== watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920768 ret 0) ==== 42+0+8 (unknown 2244497308 0 0) 0x7ff290001b30 con 0x5584b70165a0 2026-02-24T19:18:30.520 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920768 ret 0) 2026-02-24T19:18:30.520 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 32 ==== osd_op_reply(38 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1816592544 0 174112307) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(38 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 38 ondisk uv 11 in 21.1 attempt 0 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 8 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 38 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 38 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 38 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a1ffb640 10 librados: operator() completed notify (linger op 0x5584b717c0b0), ec = system:0 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a17fa640 10 client.4796.objecter _linger_commit 1 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 33 ==== osd_op_reply(39 noexist [notify cookie 94028495843088] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2857568497 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.521 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a17fa640 10 client.4796.objecter _linger_commit notify_id=141733920768 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(39 noexist [notify cookie 94028495843088] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 39 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 39 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 39 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 39 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a17fa640 10 librados: finish linger op 0x5584b717c0b0 acked (0) 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a17fa640 10 client.4796.objecter _linger_commit 2 2026-02-24T19:18:30.522 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a1ffb640 20 client.4796.objecter _linger_cancel linger_id=1 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a1ffb640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a1ffb640 15 client.4796.objecter _session_linger_op_remove 7 1 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a17fa640 10 librados: finish linger op 0x5584b717ef10 acked (-2) 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a17fa640 10 librados: operator() completed notify (linger op 0x5584b717ef10), ec = osd:2 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a17fa640 20 client.4796.objecter _linger_cancel linger_id=2 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a17fa640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2a17fa640 15 client.4796.objecter _session_linger_op_remove 7 2 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyCallback (13 ms) 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717c0b0 linger_id 3 cookie 94028495831216 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.523 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 3 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 15 client.4796.objecter send_linger 3 register 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.524 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [notify cookie 94028495831216 in=17b] tid 40 osd.7 2026-02-24T19:18:30.525 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.525 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 40 2026-02-24T19:18:30.525 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 15 client.4796.objecter _send_op 40 to 21.1 on osd.7 2026-02-24T19:18:30.525 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:40 21.1 21:8049a5cb:::exist:head [notify cookie 94028495831216 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.525 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717ff20 linger_id 4 cookie 94028495847200 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 4 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 15 client.4796.objecter send_linger 4 register 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b7181360 2026-02-24T19:18:30.526 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [notify cookie 94028495847200 in=17b] tid 41 osd.7 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 41 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 15 client.4796.objecter _send_op 41 to 21.1 on osd.7 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:41 21.1 21:855dde50:::noexist:head [notify cookie 94028495847200 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b7181810 con 0x5584b70165a0 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.517+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 34 ==== watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920769 ret 0) ==== 42+0+8 (unknown 1065848082 0 0) 0x7ff290001b30 con 0x5584b70165a0 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920769 ret 0) 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 35 ==== osd_op_reply(40 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1816592544 0 1130152724) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.527 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(40 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 40 ondisk uv 11 in 21.1 attempt 0 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 8 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a1ffb640 10 librados: operator() completed notify (linger op 0x5584b717c0b0), ec = system:0 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 40 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 40 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 40 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 36 ==== osd_op_reply(41 noexist [notify cookie 94028495847200] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 956003855 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a17fa640 10 client.4796.objecter _linger_commit 3 2026-02-24T19:18:30.528 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(41 noexist [notify cookie 94028495847200] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a17fa640 10 client.4796.objecter _linger_commit notify_id=141733920769 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 41 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 41 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a17fa640 10 librados: finish linger op 0x5584b717c0b0 acked (0) 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 41 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a17fa640 20 client.4796.objecter _linger_cancel linger_id=3 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 41 2026-02-24T19:18:30.529 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a17fa640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a17fa640 15 client.4796.objecter _session_linger_op_remove 7 3 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a1ffb640 10 client.4796.objecter _linger_commit 4 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyDeferred (4 ms) 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a1ffb640 10 librados: finish linger op 0x5584b717ff20 acked (-2) 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyFuture 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a1ffb640 10 librados: operator() completed notify (linger op 0x5584b717ff20), ec = osd:2 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a1ffb640 20 client.4796.objecter _linger_cancel linger_id=4 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a1ffb640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2a1ffb640 15 client.4796.objecter _session_linger_op_remove 7 4 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717c0b0 linger_id 5 cookie 94028495831216 2026-02-24T19:18:30.530 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 5 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 15 client.4796.objecter send_linger 5 register 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [notify cookie 94028495831216 in=17b] tid 42 osd.7 2026-02-24T19:18:30.531 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.532 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 42 2026-02-24T19:18:30.532 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 15 client.4796.objecter _send_op 42 to 21.1 on osd.7 2026-02-24T19:18:30.532 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:42 21.1 21:8049a5cb:::exist:head [notify cookie 94028495831216 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.532 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.532 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717ef10 linger_id 6 cookie 94028495843088 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 6 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 15 client.4796.objecter send_linger 6 register 2026-02-24T19:18:30.533 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b7180350 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [notify cookie 94028495843088 in=17b] tid 43 osd.7 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 43 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 15 client.4796.objecter _send_op 43 to 21.1 on osd.7 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:43 21.1 21:855dde50:::noexist:head [notify cookie 94028495843088 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b7180840 con 0x5584b70165a0 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.522+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.534 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 37 ==== watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920770 ret 0) ==== 42+0+8 (unknown 4105944177 0 0) 0x7ff290001b30 con 0x5584b70165a0 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920770 ret 0) 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 38 ==== osd_op_reply(42 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1816592544 0 2551727229) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a17fa640 10 librados: operator() completed notify (linger op 0x5584b717c0b0), ec = system:0 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(42 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 42 ondisk uv 11 in 21.1 attempt 0 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 8 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 42 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 42 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 42 2026-02-24T19:18:30.535 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 39 ==== osd_op_reply(43 noexist [notify cookie 94028495843088] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2857568497 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(43 noexist [notify cookie 94028495843088] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a1ffb640 10 client.4796.objecter _linger_commit 5 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 43 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 43 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a1ffb640 10 client.4796.objecter _linger_commit notify_id=141733920770 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 43 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 43 2026-02-24T19:18:30.536 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a1ffb640 10 librados: finish linger op 0x5584b717c0b0 acked (0) 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a1ffb640 10 client.4796.objecter _linger_commit 6 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a17fa640 20 client.4796.objecter _linger_cancel linger_id=5 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyFuture (4 ms) 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a17fa640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyYield 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a17fa640 15 client.4796.objecter _session_linger_op_remove 7 5 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a1ffb640 10 librados: finish linger op 0x5584b717ef10 acked (-2) 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a1ffb640 10 librados: operator() completed notify (linger op 0x5584b717ef10), ec = osd:2 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a1ffb640 20 client.4796.objecter _linger_cancel linger_id=6 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a1ffb640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2a1ffb640 15 client.4796.objecter _session_linger_op_remove 7 6 2026-02-24T19:18:30.537 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717c0b0 linger_id 7 cookie 94028495831216 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 7 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 15 client.4796.objecter send_linger 7 register 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.538 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [notify cookie 94028495831216 in=17b] tid 44 osd.7 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 44 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 15 client.4796.objecter _send_op 44 to 21.1 on osd.7 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:44 21.1 21:8049a5cb:::exist:head [notify cookie 94028495831216 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b717ef10 con 0x5584b70165a0 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717f4c0 linger_id 8 cookie 94028495844544 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.539 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.540 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.541 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 8 2026-02-24T19:18:30.541 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.541 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 15 client.4796.objecter send_linger 8 register 2026-02-24T19:18:30.541 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717f8f0 2026-02-24T19:18:30.541 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.541 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.541 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.541 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [notify cookie 94028495844544 in=17b] tid 45 osd.7 2026-02-24T19:18:30.541 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 45 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 15 client.4796.objecter _send_op 45 to 21.1 on osd.7 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:45 21.1 21:855dde50:::noexist:head [notify cookie 94028495844544 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b717fda0 con 0x5584b70165a0 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.527+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 40 ==== watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920771 ret 0) ==== 42+0+8 (unknown 1324646143 0 0) 0x7ff290001b30 con 0x5584b70165a0 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920771 ret 0) 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a17fa640 10 librados: operator() completed notify (linger op 0x5584b717c0b0), ec = system:0 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 41 ==== osd_op_reply(44 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1816592544 0 3508812122) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(44 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.542 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 44 ondisk uv 11 in 21.1 attempt 0 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 8 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 44 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 44 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 44 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 42 ==== osd_op_reply(45 noexist [notify cookie 94028495844544] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3559834869 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a1ffb640 10 client.4796.objecter _linger_commit 7 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(45 noexist [notify cookie 94028495844544] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 45 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.543 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a1ffb640 10 client.4796.objecter _linger_commit notify_id=141733920771 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 45 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 45 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a1ffb640 10 librados: finish linger op 0x5584b717c0b0 acked (0) 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 45 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a1ffb640 10 client.4796.objecter _linger_commit 8 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyYield (5 ms) 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a17fa640 20 client.4796.objecter _linger_cancel linger_id=7 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a17fa640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a17fa640 15 client.4796.objecter _session_linger_op_remove 7 7 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a1ffb640 10 librados: finish linger op 0x5584b717f4c0 acked (-2) 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a1ffb640 10 librados: operator() completed notify (linger op 0x5584b717f4c0), ec = osd:2 2026-02-24T19:18:30.544 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a17fa640 20 client.4796.objecter _linger_cancel linger_id=8 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a17fa640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2a17fa640 15 client.4796.objecter _session_linger_op_remove 7 8 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717c0b0 linger_id 9 cookie 94028495831216 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 9 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 15 client.4796.objecter send_linger 9 register 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2026-02-24T19:18:30.545 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid exist '@21' '@21' [notify cookie 94028495831216 in=17b] tid 46 osd.7 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 46 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 15 client.4796.objecter _send_op 46 to 21.1 on osd.7 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:46 21.1 21:8049a5cb:::exist:head [notify cookie 94028495831216 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b70165a0 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 10 client.4796.objecter linger_register info 0x5584b717df00 linger_id 10 cookie 94028495838976 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 5 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 15 client.4796.objecter _session_linger_op_assign 7 10 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.546 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 15 client.4796.objecter send_linger 10 register 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b717e330 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [notify cookie 94028495838976 in=17b] tid 47 osd.7 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 47 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 15 client.4796.objecter _send_op 47 to 21.1 on osd.7 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:47 21.1 21:855dde50:::noexist:head [notify cookie 94028495838976 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5584b717e7e0 con 0x5584b70165a0 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.532+0000 7ff2aa354880 5 client.4796.objecter 2 in flight 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.536+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 43 ==== watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920772 ret 0) ==== 42+0+8 (unknown 1731176518 0 0) 0x7ff29800ce30 con 0x5584b70165a0 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.536+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 watch-notify(notify_complete (2) cookie 94028495831216 notify 141733920772 ret 0) 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.536+0000 7ff2a1ffb640 10 librados: operator() completed notify (linger op 0x5584b717c0b0), ec = system:0 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 44 ==== osd_op_reply(46 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1816592544 0 729627742) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.547 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(46 exist [notify cookie 94028495831216 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 46 ondisk uv 11 in 21.1 attempt 0 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 8 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 46 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 46 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 7 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 46 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 45 ==== osd_op_reply(47 noexist [notify cookie 94028495838976] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3705302358 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a17fa640 10 client.4796.objecter _linger_commit 9 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(47 noexist [notify cookie 94028495838976] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a17fa640 10 client.4796.objecter _linger_commit notify_id=141733920772 2026-02-24T19:18:30.548 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 47 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 10 client.4796.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a17fa640 10 librados: finish linger op 0x5584b717c0b0 acked (0) 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 47 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 47 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a17fa640 20 client.4796.objecter _linger_cancel linger_id=9 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 6 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 47 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a17fa640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a17fa640 15 client.4796.objecter _session_linger_op_remove 7 9 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a1ffb640 10 client.4796.objecter _linger_commit 10 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a1ffb640 10 librados: finish linger op 0x5584b717df00 acked (-2) 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a1ffb640 10 librados: operator() completed notify (linger op 0x5584b717df00), ec = osd:2 2026-02-24T19:18:30.549 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a1ffb640 20 client.4796.objecter _linger_cancel linger_id=10 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a1ffb640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2a1ffb640 15 client.4796.objecter _session_linger_op_remove 7 10 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyAwaitable (4 ms) 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter chose random osd.9 of [7,9] 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [stat] tid 48 osd.9 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 9 48 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _send_op 48 to 21.1 on osd.9 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6800/2864194603 -- osd_op(unknown.0.0:48 21.1 21:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b701ce10 con 0x5584b7015870 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.550 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 5 client.4796.objecter _op_cancel: cancelling tid 48 r=-125 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter op_cancel tid 48 in session 9 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _finish_op 48 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _session_op_remove 9 48 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter chose random osd.9 of [7,9] 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [stat] tid 49 osd.9 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-24T19:18:30.551 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 9 49 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _send_op 49 to 21.1 on osd.9 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.114:6800/2864194603 -- osd_op(unknown.0.0:49 21.1 21:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x5584b717c0b0 con 0x5584b7015870 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 4 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 5 client.4796.objecter _op_cancel: cancelling tid 49 r=-125 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter op_cancel tid 49 in session 9 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _finish_op 49 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 3 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _session_op_remove 9 49 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b71806f0 write_seq 11 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.552 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [stat] tid 50 osd.7 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 50 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _send_op 50 to 21.1 on osd.7 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:50 21.1 21:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b717f3b0 con 0x5584b70165a0 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 5 client.4796.objecter _op_cancel: cancelling tid 50 r=-125 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter op_cancel tid 50 in session 7 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 librados: complete_aio_write 0x5584b71806f0 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _finish_op 50 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _session_op_remove 7 50 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 librados: queue_aio_write 0x5584b6ed3390 completion 0x5584b71806f0 write_seq 12 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _op_submit op 0x5584b701d6b0 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _calc_target epoch 33 base noexist @21 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [7,9] primary 7 2026-02-24T19:18:30.553 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter _get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.554 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 10 client.4796.objecter _op_submit oid noexist '@21' '@21' [stat] tid 51 osd.7 2026-02-24T19:18:30.554 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter get_session s=0x5584b7014940 osd=7 3 2026-02-24T19:18:30.554 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _session_op_assign 7 51 2026-02-24T19:18:30.554 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 15 client.4796.objecter _send_op 51 to 21.1 on osd.7 2026-02-24T19:18:30.554 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 --> v1:10.20.193.194:6800/598300563 -- osd_op(unknown.0.0:51 21.1 21:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5584b717f3b0 con 0x5584b70165a0 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.537+0000 7ff2aa354880 5 client.4796.objecter 1 in flight 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 46 ==== osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2249759586 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 50 ondisk ... stray 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 1 -- 10.20.193.194:0/181633659 <== osd.7 v1:10.20.193.194:6800/598300563 47 ==== osd_op_reply(51 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2249759586 0 0) 0x7ff298007020 con 0x5584b70165a0 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 10 client.4796.objecter ms_dispatch2 0x5584b6eef590 osd_op_reply(51 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 10 client.4796.objecter in handle_osd_op_reply 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 7 client.4796.objecter handle_osd_op_reply 51 ondisk uv 0 in 21.1 attempt 0 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 10 client.4796.objecter op 0 rval 0 len 0 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 15 client.4796.objecter handle_osd_op_reply completed tid 51 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 15 client.4796.objecter _finish_op 51 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 4 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 15 client.4796.objecter _session_op_remove 7 51 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 5 client.4796.objecter 0 in flight 2026-02-24T19:18:30.555 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a2ffd640 20 librados: complete_aio_write 0x5584b71806f0 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTotal (3 ms) 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 10 librados: watch_flush enter 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 10 librados: watch_flush exit 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 10 client.4796.objecter close_session for osd.7 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 >> v1:10.20.193.194:6800/598300563 conn(0x5584b70165a0 legacy=0x5584b7016970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014940 osd=7 1 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 10 client.4796.objecter close_session for osd.9 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 >> v1:10.20.193.114:6800/2864194603 conn(0x5584b7015870 legacy=0x5584b7018690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 20 client.4796.objecter put_session s=0x5584b7014540 osd=9 1 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 20 client.4796.objecter shutdown clearing up homeless session... 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 10 client.4796.objecter successfully canceled tick 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 >> v1:10.20.193.45:6800/1599977652 conn(0x7ff290076a30 legacy=0x7ff290096ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 10 monclient: shutdown 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 >> v1:10.20.193.179:6789/0 conn(0x5584b706d8e0 legacy=0x5584b7064380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a3fff640 1 -- 10.20.193.194:0/181633659 reap_dead start 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2a3fff640 1 -- 10.20.193.194:0/181633659 reap_dead start 2026-02-24T19:18:30.556 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 shutdown_connections 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 >> 10.20.193.194:0/181633659 conn(0x5584b7000a90 msgr2=0x5584b7012e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 shutdown_connections 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 1 -- 10.20.193.194:0/181633659 wait complete. 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.540+0000 7ff2aa354880 1 librados: shutdown 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [----------] 29 tests from AsioRados (1189 ms total) 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [----------] Global test environment tear-down 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [==========] 29 tests from 1 test suite ran. (4931 ms total) 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stdout: api_asio: [ PASSED ] 29 tests. 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48171 2026-02-24T19:18:30.557 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48171 2026-02-24T19:18:32.310 INFO:tasks.workunit.client.0.trial194.stdout: cls: Running main() from gmock_main.cc 2026-02-24T19:18:32.310 INFO:tasks.workunit.client.0.trial194.stdout: cls: [==========] Running 1 test from 1 test suite. 2026-02-24T19:18:32.310 INFO:tasks.workunit.client.0.trial194.stdout: cls: [----------] Global test environment set-up. 2026-02-24T19:18:32.310 INFO:tasks.workunit.client.0.trial194.stdout: cls: [----------] 1 test from NeoRadosCls 2026-02-24T19:18:32.310 INFO:tasks.workunit.client.0.trial194.stdout: cls: [ RUN ] NeoRadosCls.DNE 2026-02-24T19:18:32.310 INFO:tasks.workunit.client.0.trial194.stdout: cls: [ OK ] NeoRadosCls.DNE (6656 ms) 2026-02-24T19:18:32.310 INFO:tasks.workunit.client.0.trial194.stdout: cls: [----------] 1 test from NeoRadosCls (6656 ms total) 2026-02-24T19:18:32.310 INFO:tasks.workunit.client.0.trial194.stdout: cls: 2026-02-24T19:18:32.311 INFO:tasks.workunit.client.0.trial194.stdout: cls: [----------] Global test environment tear-down 2026-02-24T19:18:32.311 INFO:tasks.workunit.client.0.trial194.stdout: cls: [==========] 1 test from 1 test suite ran. (6656 ms total) 2026-02-24T19:18:32.311 INFO:tasks.workunit.client.0.trial194.stdout: cls: [ PASSED ] 1 test. 2026-02-24T19:18:33.007 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: Running main() from gmock_main.cc 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: [----------] Global test environment set-up. 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: [----------] 1 test from neocls_handler_error 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (7348 ms) 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: [----------] 1 test from neocls_handler_error (7348 ms total) 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: [----------] Global test environment tear-down 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: [==========] 1 test from 1 test suite ran. (7348 ms total) 2026-02-24T19:18:33.008 INFO:tasks.workunit.client.0.trial194.stdout: handler_error: [ PASSED ] 1 test. 2026-02-24T19:18:35.123 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: Running main() from gmock_main.cc 2026-02-24T19:18:35.123 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [----------] Global test environment set-up. 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (487 ms) 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (124 ms) 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (8883 ms) 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (9495 ms total) 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [----------] Global test environment tear-down 2026-02-24T19:18:35.124 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (9495 ms total) 2026-02-24T19:18:35.125 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2026-02-24T19:18:35.304 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: Running main() from gmock_main.cc 2026-02-24T19:18:35.304 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2026-02-24T19:18:35.304 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [----------] Global test environment set-up. 2026-02-24T19:18:35.304 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2026-02-24T19:18:35.304 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2026-02-24T19:18:35.304 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (604 ms) 2026-02-24T19:18:35.304 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2026-02-24T19:18:35.304 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (33 ms) 2026-02-24T19:18:35.304 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (8857 ms) 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:33.852534+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2196184654' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48643-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:33.853695+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/1836883779' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial194-48080-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:33.854447+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/780588147' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial194-48911-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:33.944790+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/780588147' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial194-48911-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial194-48911-2"} : dispatch 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:33.988199+0000 mon.c [INF] from='client.? v1:10.20.193.194:0/1846059433' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48308-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.007224+0000 mon.a [INF] from='client.4973 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48308-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.029881+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/1836883779' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial194-48080-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.034087+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/1511121858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial194-48399-7"} : dispatch 2026-02-24T19:18:35.305 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.042272+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/304829644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial194-48413-7"} : dispatch 2026-02-24T19:18:35.306 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.060739+0000 mon.a [INF] from='client.4990 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial194-48399-7"} : dispatch 2026-02-24T19:18:35.306 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.065468+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/304829644' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial194-48413-7"} : dispatch 2026-02-24T19:18:35.306 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.071056+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/1511121858' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial194-48399-7"} : dispatch 2026-02-24T19:18:36.355 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.074192+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/304829644' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial194-48413-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:36.355 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.080037+0000 mon.a [INF] from='client.4990 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial194-48399-7"} : dispatch 2026-02-24T19:18:36.355 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.089141+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/1511121858' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial194-48399-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:36.355 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.093435+0000 mon.a [INF] from='client.4990 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial194-48399-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:36.355 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.933605+0000 mon.a [INF] from='client.4973 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48308-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:36.355 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.934929+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/1836883779' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial194-48080-3", "field": "max_bytes", "val": "4096"}]': finished 2026-02-24T19:18:36.355 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.935706+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/304829644' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial194-48413-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:34.936876+0000 mon.a [INF] from='client.4990 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial194-48399-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.042384+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/304829644' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial194-48413-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial194-48413-7"} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.059339+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2269179199' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial194-48985-1"} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.108254+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/1511121858' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_trial194-48399-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial194-48399-7"} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.130165+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/4155108575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial194-48172-10"} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.150217+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/4155108575' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial194-48172-10"} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.160497+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2585949179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_trial194-48201-10"} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.168376+0000 mon.c [INF] from='client.? v1:10.20.193.194:0/3178791119' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial194-48056-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.170751+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/4155108575' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial194-48172-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.242260+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2585949179' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_trial194-48201-10"} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.260222+0000 mon.a [INF] from='client.5003 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial194-48056-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:36.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.265150+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2585949179' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial194-48201-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.288758+0000 mon.a [INF] from='client.4990 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_trial194-48399-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial194-48399-7"} : dispatch 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.289741+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/956569988' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.324810+0000 client.admin [INF] onexx 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.327617+0000 mon.a [INF] from='client.5023 ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.986131+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/780588147' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOptrial194-48911-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial194-48911-2"}]': finished 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.986961+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2269179199' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial194-48985-1"}]': finished 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.987942+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/4155108575' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial194-48172-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.988730+0000 mon.a [INF] from='client.5003 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_trial194-48056-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:35.989711+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2585949179' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial194-48201-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:36.077542+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/4142728932' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial194-48497-1"} : dispatch 2026-02-24T19:18:36.357 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:36.079062+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2269179199' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial194-48985-1"} : dispatch 2026-02-24T19:18:38.230 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:36.095808+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/4155108575' entity='client.admin' cmd={"prefix": "osd pool create", "pool": api_c_read_operations: Running main() from gmock_main.cc 2026-02-24T19:18:38.230 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2026-02-24T19:18:38.230 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [----------] Global test environment set-up. 2026-02-24T19:18:38.230 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2026-02-24T19:18:38.230 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2026-02-24T19:18:38.230 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-24T19:18:38.230 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2026-02-24T19:18:38.230 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (2511 ms) 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (796 ms) 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (168 ms) 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (300 ms) 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (56 ms) 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (122 ms) 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2026-02-24T19:18:38.231 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (44 ms) 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (1646 ms) 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (226 ms) 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (78 ms) 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (807 ms) 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (240 ms) 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2026-02-24T19:18:38.232 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (1124 ms) 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (741 ms) 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (142 ms) 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (68 ms) 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (9078 ms total) 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [----------] Global test environment tear-down 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (12588 ms total) 2026-02-24T19:18:38.233 INFO:tasks.workunit.client.0.trial194.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2026-02-24T19:18:38.290 INFO:tasks.workunit.client.0.trial194.stdout: cmd: Running main() from gmock_main.cc 2026-02-24T19:18:38.290 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:18:38.290 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [----------] Global test environment set-up. 2026-02-24T19:18:38.290 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2026-02-24T19:18:38.290 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (3809 ms) 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (3552 ms) 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (5273 ms) 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [----------] 3 tests from NeoRadosCmd (12634 ms total) 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [----------] Global test environment tear-down 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [==========] 3 tests from 1 test suite ran. (12634 ms total) 2026-02-24T19:18:38.291 INFO:tasks.workunit.client.0.trial194.stdout: cmd: [ PASSED ] 3 tests. 2026-02-24T19:18:39.273 INFO:tasks.workunit.client.0.trial194.stdout: pool: Running main() from gmock_main.cc 2026-02-24T19:18:39.273 INFO:tasks.workunit.client.0.trial194.stdout: pool: [==========] Running 6 tests from 1 test suite. 2026-02-24T19:18:39.273 INFO:tasks.workunit.client.0.trial194.stdout: pool: [----------] Global test environment set-up. 2026-02-24T19:18:39.273 INFO:tasks.workunit.client.0.trial194.stdout: pool: [----------] 6 tests from NeoRadosPools 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ OK ] NeoRadosPools.PoolList (2037 ms) 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (2901 ms) 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (2349 ms) 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (2286 ms) 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (1927 ms) 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-24T19:18:39.274 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2094 ms) 2026-02-24T19:18:39.275 INFO:tasks.workunit.client.0.trial194.stdout: pool: [----------] 6 tests from NeoRadosPools (13595 ms total) 2026-02-24T19:18:39.275 INFO:tasks.workunit.client.0.trial194.stdout: pool: 2026-02-24T19:18:39.275 INFO:tasks.workunit.client.0.trial194.stdout: pool: [----------] Global test environment tear-down 2026-02-24T19:18:39.275 INFO:tasks.workunit.client.0.trial194.stdout: pool: [==========] 6 tests from 1 test suite ran. (13595 ms total) 2026-02-24T19:18:39.275 INFO:tasks.workunit.client.0.trial194.stdout: pool: [ PASSED ] 6 tests. 2026-02-24T19:18:39.387 INFO:tasks.workunit.client.0.trial194.stdout:"LibRadosLockEC_trial194-48172-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial194-48172-10"} : dispatch 2026-02-24T19:18:39.387 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:36.104260+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2585949179' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial194-48201-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial194-48201-10"} : dispatch 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:36.119103+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/3333589374' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48643-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:36.129291+0000 mon.a [INF] from='client.4786 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial194-48497-1"} : dispatch 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:36.146144+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/4078632462' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial194-48101-16"} : dispatch 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:36.169229+0000 mon.a [INF] from='client.5047 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial194-48101-16"} : dispatch 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:37.314698+0000 mon.a [INF] from='client.5023 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.112549+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/4155108575' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_trial194-48172-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial194-48172-10"}]': finished 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.114451+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/2585949179' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial194-48201-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial194-48201-10"}]': finished 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.115200+0000 mon.a [INF] from='client.4786 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial194-48497-1"}]': finished 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.116338+0000 mon.a [INF] from='client.5051 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48308-4","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.117524+0000 mon.a [INF] from='client.5077 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial194-48985-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:39.388 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.216985+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/1305131983' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial194-48985-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial194-48985-2"} : dispatch 2026-02-24T19:18:39.389 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.228249+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/634988561' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_trial194-48056-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:39.446 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:44.254 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:39.450 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:44.258 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:39.480 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:01:44.249 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:39.486 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:01:44.292 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:39.487 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:01:44.256 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:39.497 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:01:44.303 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:39.530 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:44.338 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:39.548 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:01:44.317 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:39.556 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:01:44.362 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:40.356 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.252153+0000 mon.a [INF] from='client.5077 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial194-48985-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile- ec_io: Running main() from gmock_main.cc 2026-02-24T19:18:40.356 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2026-02-24T19:18:40.356 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [----------] Global test environment set-up. 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (7311 ms) 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (7378 ms) 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (14689 ms total) 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [----------] Global test environment tear-down 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (14689 ms total) 2026-02-24T19:18:40.357 INFO:tasks.workunit.client.0.trial194.stdout: ec_io: [ PASSED ] 2 tests. 2026-02-24T19:18:40.710 INFO:tasks.workunit.client.0.trial194.stdout:ListObjectsNStrial194-48985-2"} : dispatch 2026-02-24T19:18:40.710 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.264190+0000 mon.a [INF] from='client.5101 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_trial194-48056-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:40.710 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:38.290193+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/780588147' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOptrial194-48911-2"} : dispatch 2026-02-24T19:18:40.710 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.161466+0000 mon.a [INF] from='client.5047 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_trial194-48101-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial194-48101-16"}]': finished 2026-02-24T19:18:40.710 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.162806+0000 mon.a [INF] from='client.5101 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_trial194-48056-4","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:40.710 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.164007+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/780588147' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOptrial194-48911-2"}]': finished 2026-02-24T19:18:40.710 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.269649+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/780588147' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ReadOptrial194-48911-2"} : dispatch 2026-02-24T19:18:40.710 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.285636+0000 mon.a [INF] from='client.5077 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNStrial194-48985-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial194-48985-2"}]': finished 2026-02-24T19:18:40.711 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.277519+0000 mon.c [INF] from='client.? v1:10.20.193.194:0/3960326938' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial194-48497-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:40.711 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.279567+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/1127986767' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_trial194-48228-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:40.711 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.287129+0000 mon.c [INF] from='client.? v1:10.20.193.194:0/2696161060' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48643-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:40.711 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.380452+0000 mon.a [INF] from='client.5114 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial194-48497-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:40.711 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.384663+0000 mon.a [INF] from='client.5120 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48643-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:40.711 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.389677+0000 mon.b [INF] from='client.? v1:10.20.193.194:0/956569988' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-24T19:18:40.711 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.404046+0000 mon.a [INF] from='client.5137 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_trial194-48228-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:40.711 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.517843+0000 client.admin [INF] threexx 2026-02-24T19:18:40.711 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:39.520162+0000 mon.a [INF] from='client.5023 ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-24T19:18:42.574 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_1_[48789]: starting. 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_1_[48789]: creating pool ceph_test_rados_open_pools_parallel.trial194-48720 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_1_[48789]: created object 0... 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_1_[48789]: created object 25... 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_1_[48789]: created object 49... 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_1_[48789]: finishing. 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_1_[48789]: shutting down. 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_2_[48791]: starting. 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_2_[48791]: rados_pool_create. 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_2_[48791]: rados_ioctx_create. 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_2_[48791]: shutting down. 2026-02-24T19:18:42.575 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_3_[50313]: starting. 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_3_[50313]: creating pool ceph_test_rados_open_pools_parallel.trial194-48720 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_3_[50313]: created object 0... 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_3_[50313]: created object 25... 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_3_[50313]: created object 49... 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_3_[50313]: finishing. 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_3_[50313]: shutting down. 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_4_[50314]: starting. 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_4_[50314]: rados_pool_create. 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_4_[50314]: rados_ioctx_create. 2026-02-24T19:18:42.576 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: process_4_[50314]: shutting down. 2026-02-24T19:18:42.577 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:42.577 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:42.577 INFO:tasks.workunit.client.0.trial194.stdout: open_pools_parallel: ******* SUCCESS ********** 2026-02-24T19:18:43.617 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: Running main() from gmock_main.cc 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [----------] Global test environment set-up. 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [----------] 5 tests from LibRadosStat 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ OK ] LibRadosStat.Stat (1732 ms) 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (1331 ms) 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ OK ] LibRadosStat.StatNS (737 ms) 2026-02-24T19:18:43.618 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (669 ms) 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (334 ms) 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [----------] 5 tests from LibRadosStat (4804 ms total) 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (2891 ms) 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (320 ms) 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2026-02-24T19:18:43.619 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (77 ms) 2026-02-24T19:18:43.620 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2026-02-24T19:18:43.620 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (660 ms) 2026-02-24T19:18:43.620 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (3950 ms total) 2026-02-24T19:18:43.620 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: 2026-02-24T19:18:43.620 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [----------] Global test environment tear-down 2026-02-24T19:18:43.620 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (18001 ms total) 2026-02-24T19:18:43.620 INFO:tasks.workunit.client.0.trial194.stdout: api_stat: [ PASSED ] 9 tests. 2026-02-24T19:18:43.621 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: Running main() from gmock_main.cc 2026-02-24T19:18:43.621 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2026-02-24T19:18:43.621 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [----------] Global test environment set-up. 2026-02-24T19:18:43.621 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2026-02-24T19:18:43.621 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: seed 48413 2026-02-24T19:18:43.621 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2026-02-24T19:18:43.621 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (2506 ms) 2026-02-24T19:18:43.621 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-24T19:18:43.621 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (835 ms) 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (269 ms) 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (842 ms) 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (502 ms) 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (4957 ms total) 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1773 ms) 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-24T19:18:43.622 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (6 ms) 2026-02-24T19:18:43.623 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-24T19:18:43.623 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (29 ms) 2026-02-24T19:18:43.623 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2026-02-24T19:18:43.623 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (1404 ms) 2026-02-24T19:18:43.623 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (3213 ms total) 2026-02-24T19:18:43.623 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: 2026-02-24T19:18:43.623 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [----------] Global test environment tear-down 2026-02-24T19:18:43.623 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (18000 ms total) 2026-02-24T19:18:43.623 INFO:tasks.workunit.client.0.trial194.stdout: api_stat_pp: [ PASSED ] 9 tests. 2026-02-24T19:18:43.733 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:40.349428+0000 mon.a [INF] from='client.? v1:10.20.193.194:0/780588147' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOptrial194-48911-2"}]': finished 2026-02-24T19:18:43.733 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:40.351264+0000 mon.a [INF] from='client.5114 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial194-48497-4","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:43.733 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:40.353109+0000 mon.a [INF] from='client.5120 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48643-4","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:43.733 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:40.354479+0000 mon.a [INF] from='client.5137 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_trial194-48228-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:43.733 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:40.439520+0000 mon.c [INF] from='client.? v1:10.20.193.194:0/1836483237' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48308-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:43.733 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: got: 2026-02-24T19:18:40.466081+0000 mon.a [INF] from='client.5150 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial194-48308-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:43.734 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8609 ms) 2026-02-24T19:18:43.734 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (18105 ms total) 2026-02-24T19:18:43.734 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: 2026-02-24T19:18:43.734 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [----------] Global test environment tear-down 2026-02-24T19:18:43.734 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (18105 ms total) 2026-02-24T19:18:43.734 INFO:tasks.workunit.client.0.trial194.stdout: api_cmd: [ PASSED ] 4 tests. 2026-02-24T19:18:45.463 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_1_[48848]: starting. 2026-02-24T19:18:45.463 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_1_[48848]: creating pool ceph_test_rados_delete_pools_parallel.trial194-48747 2026-02-24T19:18:45.463 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_1_[48848]: created object 0... 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_1_[48848]: created object 25... 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_1_[48848]: created object 49... 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_1_[48848]: finishing. 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_1_[48848]: shutting down. 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_2_[48854]: starting. 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_2_[48854]: deleting pool ceph_test_rados_delete_pools_parallel.trial194-48747 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_2_[48854]: shutting down. 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_3_[50470]: starting. 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_3_[50470]: creating pool ceph_test_rados_delete_pools_parallel.trial194-48747 2026-02-24T19:18:45.464 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_3_[50470]: created object 0... 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_3_[50470]: created object 25... 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_3_[50470]: created object 49... 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_3_[50470]: finishing. 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_3_[50470]: shutting down. 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_5_[50472]: starting. 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_5_[50472]: listing objects. 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_5_[50472]: listed object 0... 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_5_[50472]: listed object 25... 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_5_[50472]: saw 50 objects 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_5_[50472]: shutting down. 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:45.465 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_4_[50471]: starting. 2026-02-24T19:18:45.466 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_4_[50471]: deleting pool ceph_test_rados_delete_pools_parallel.trial194-48747 2026-02-24T19:18:45.466 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: process_4_[50471]: shutting down. 2026-02-24T19:18:45.466 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:45.466 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:45.466 INFO:tasks.workunit.client.0.trial194.stdout: delete_pools_parallel: ******* SUCCESS ********** 2026-02-24T19:18:47.204 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2026-02-24T19:18:47.204 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [----------] Global test environment set-up. 2026-02-24T19:18:47.204 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [----------] 7 tests from LibRadosList 2026-02-24T19:18:47.204 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2026-02-24T19:18:47.204 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosList.ListObjects (3926 ms) 2026-02-24T19:18:47.204 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-24T19:18:47.205 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (4005 ms) 2026-02-24T19:18:47.205 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2026-02-24T19:18:47.205 INFO:tasks.workunit.client.0.trial194.stdout: api_list: myset foo1,foo2,foo3 2026-02-24T19:18:47.205 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo1 2026-02-24T19:18:47.205 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo2 2026-02-24T19:18:47.205 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo3 2026-02-24T19:18:47.205 INFO:tasks.workunit.client.0.trial194.stdout: api_list: myset foo1,foo4,foo5 2026-02-24T19:18:47.205 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo4 2026-02-24T19:18:47.205 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo5 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo1 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: myset foo6,foo7 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo7 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo6 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns1:foo4 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns1:foo5 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns2:foo7 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns2:foo6 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns1:foo1 2026-02-24T19:18:47.206 INFO:tasks.workunit.client.0.trial194.stdout: api_list: :foo1 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: :foo2 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: :foo3 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (3783 ms) 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 1 0 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 10 0 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 13 0 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 7 0 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 14 0 2026-02-24T19:18:47.207 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 0 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 15 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 11 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 5 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 8 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 6 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 3 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 4 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 12 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 9 0 2026-02-24T19:18:47.208 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 2 0 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (3916 ms) 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: x cursor=MIN 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=1 cursor=18:02547ec2:::1:head 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=10 cursor=18:52ea6a34:::10:head 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=13 cursor=18:566253c9:::13:head 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=7 cursor=18:5c6b0b28:::7:head 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=14 cursor=18:62a1935d:::14:head 2026-02-24T19:18:47.209 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=0 cursor=18:6cac518f:::0:head 2026-02-24T19:18:47.210 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=15 cursor=18:863748b0:::15:head 2026-02-24T19:18:47.210 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=11 cursor=18:89d3ae78:::11:head 2026-02-24T19:18:47.210 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=5 cursor=18:b29083e3:::5:head 2026-02-24T19:18:47.210 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=8 cursor=18:bd63b0f1:::8:head 2026-02-24T19:18:47.210 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=6 cursor=18:c4fdafeb:::6:head 2026-02-24T19:18:47.210 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=3 cursor=18:cfc208b3:::3:head 2026-02-24T19:18:47.210 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=4 cursor=18:d83876eb:::4:head 2026-02-24T19:18:47.210 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=12 cursor=18:de5d7c5f:::12:head 2026-02-24T19:18:47.210 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=9 cursor=18:e960b815:::9:head 2026-02-24T19:18:47.211 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > oid=2 cursor=18:f905c69b:::2:head 2026-02-24T19:18:47.211 INFO:tasks.workunit.client.0.trial194.stdout: api_list: FIRST> seek to MIN oid=1 2026-02-24T19:18:47.211 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=1 cursor=18:02547ec2:::1:head 2026-02-24T19:18:47.211 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:02547ec2:::1:head 2026-02-24T19:18:47.211 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:02547ec2:::1:head -> 1 2026-02-24T19:18:47.211 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=10 cursor=18:52ea6a34:::10:head 2026-02-24T19:18:47.211 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:52ea6a34:::10:head 2026-02-24T19:18:47.211 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:52ea6a34:::10:head -> 10 2026-02-24T19:18:47.212 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=13 cursor=18:566253c9:::13:head 2026-02-24T19:18:47.212 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:566253c9:::13:head 2026-02-24T19:18:47.212 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:566253c9:::13:head -> 13 2026-02-24T19:18:47.212 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=7 cursor=18:5c6b0b28:::7:head 2026-02-24T19:18:47.212 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:5c6b0b28:::7:head 2026-02-24T19:18:47.212 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:5c6b0b28:::7:head -> 7 2026-02-24T19:18:47.705 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid api_watch_notify_pp: Running main() from gmock_main.cc 2026-02-24T19:18:47.705 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2026-02-24T19:18:47.705 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2026-02-24T19:18:47.705 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-24T19:18:47.705 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: notify 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (3934 ms) 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (179 ms) 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (4114 ms total) 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: notify 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (686 ms) 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: notify 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3970 ms) 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (153 ms) 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (755 ms) 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263174018016 notify_id 210453397504 notifier_gid 5114 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (376 ms) 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263174021280 notify_id 214748364802 notifier_gid 5114 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263174021280 notify_id 214748364802 notifier_gid 5114 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263174021280 notify_id 214748364803 notifier_gid 5114 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (799 ms) 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263173993808 notify_id 214748364805 notifier_gid 5114 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (189 ms) 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263173993808 notify_id 214748364801 notifier_gid 5114 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (87 ms) 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263173993808 notify_id 214748364800 notifier_gid 5114 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (107 ms) 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263173993808 notify_id 214748364802 notifier_gid 5114 2026-02-24T19:18:47.708 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (83 ms) 2026-02-24T19:18:47.709 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-24T19:18:48.127 INFO:tasks.workunit.client.0.trial194.stdout: api_watc=14 cursor=18:62a1935d:::14:head 2026-02-24T19:18:48.127 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:62a1935d:::14:head 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:62a1935d:::14:head -> 14 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=0 cursor=18:6cac518f:::0:head 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:6cac518f:::0:head 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:6cac518f:::0:head -> 0 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=15 cursor=18:863748b0:::15:head 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:863748b0:::15:head 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:863748b0:::15:head -> 15 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=11 cursor=18:89d3ae78:::11:head 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:89d3ae78:::11:head 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:89d3ae78:::11:head -> 11 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=5 cursor=18:b29083e3:::5:head 2026-02-24T19:18:48.128 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:b29083e3:::5:head 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:b29083e3:::5:head -> 5 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=8 cursor=18:bd63b0f1:::8:head 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:bd63b0f1:::8:head 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:bd63b0f1:::8:head -> 8 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=6 cursor=18:c4fdafeb:::6:head 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:c4fdafeb:::6:head 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:c4fdafeb:::6:head -> 6 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=3 cursor=18:cfc208b3:::3:head 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:cfc208b3:::3:head 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:cfc208b3:::3:head -> 3 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=4 cursor=18:d83876eb:::4:head 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:d83876eb:::4:head 2026-02-24T19:18:48.129 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:d83876eb:::4:head -> 4 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=12 cursor=18:de5d7c5f:::12:head 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:de5d7c5f:::12:head 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:de5d7c5f:::12:head -> 12 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=9 cursor=18:e960b815:::9:head 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:e960b815:::9:head 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:e960b815:::9:head -> 9 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : oid=2 cursor=18:f905c69b:::2:head 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:f905c69b:::2:head 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:f905c69b:::2:head -> 2 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:f905c69b:::2:head 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:f905c69b:::2:head expected=18:f905c69b:::2:head 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:f905c69b:::2:head -> 2 2026-02-24T19:18:48.130 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=2 expected=2 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:e960b815:::9:head 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:e960b815:::9:head expected=18:e960b815:::9:head 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:e960b815:::9:head -> 9 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=9 expected=9 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:52ea6a34:::10:head 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:52ea6a34:::10:head expected=18:52ea6a34:::10:head 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:52ea6a34:::10:head -> 10 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=10 expected=10 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:02547ec2:::1:head 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:02547ec2:::1:head expected=18:02547ec2:::1:head 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:02547ec2:::1:head -> 1 2026-02-24T19:18:48.131 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=1 expected=1 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:5c6b0b28:::7:head 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:5c6b0b28:::7:head expected=18:5c6b0b28:::7:head 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:5c6b0b28:::7:head -> 7 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=7 expected=7 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:b29083e3:::5:head 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:b29083e3:::5:head expected=18:b29083e3:::5:head 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:b29083e3:::5:head -> 5 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=5 expected=5 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:89d3ae78:::11:head 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:89d3ae78:::11:head expected=18:89d3ae78:::11:head 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:89d3ae78:::11:head -> 11 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=11 expected=11 2026-02-24T19:18:48.132 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:566253c9:::13:head 2026-02-24T19:18:48.133 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:566253c9:::13:head expected=18:566253c9:::13:head 2026-02-24T19:18:48.133 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:566253c9:::13:head -> 13 2026-02-24T19:18:50.127 INFO:tasks.workunit.client.0.trial194.stdout: api_list api_lock: Running main() from gmock_main.cc 2026-02-24T19:18:50.127 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2026-02-24T19:18:50.127 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [----------] Global test environment set-up. 2026-02-24T19:18:50.127 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [----------] 8 tests from LibRadosLock 2026-02-24T19:18:50.127 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2026-02-24T19:18:50.127 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (2338 ms) 2026-02-24T19:18:50.127 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLock.LockShared (418 ms) 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1126 ms) 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1903 ms) 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (128 ms) 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLock.Unlock (55 ms) 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (101 ms) 2026-02-24T19:18:50.128 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (94 ms) 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [----------] 8 tests from LibRadosLock (6166 ms total) 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (2100 ms) 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (733 ms) 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1258 ms) 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1097 ms) 2026-02-24T19:18:50.129 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (65 ms) 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (813 ms) 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (662 ms) 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (87 ms) 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (6818 ms total) 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [----------] Global test environment tear-down 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (24531 ms total) 2026-02-24T19:18:50.130 INFO:tasks.workunit.client.0.trial194.stdout: api_lock: [ PASSED ] 16 tests. 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: Running main() from gmock_main.cc 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [----------] Global test environment set-up. 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: seed 48201 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (2259 ms) 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (150 ms) 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1322 ms) 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1475 ms) 2026-02-24T19:18:50.131 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (677 ms) 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (154 ms) 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (121 ms) 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (38 ms) 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (6199 ms total) 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1907 ms) 2026-02-24T19:18:50.132 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (174 ms) 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1904 ms) 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1113 ms) 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (92 ms) 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (618 ms) 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (245 ms) 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-24T19:18:50.133 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (627 ms) 2026-02-24T19:18:50.134 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (6683 ms total) 2026-02-24T19:18:50.134 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: 2026-02-24T19:18:50.134 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [----------] Global test environment tear-down 2026-02-24T19:18:50.134 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (24528 ms total) 2026-02-24T19:18:50.134 INFO:tasks.workunit.client.0.trial194.stdout: api_lock_pp: [ PASSED ] 16 tests. 2026-02-24T19:18:50.490 INFO:tasks.workunit.client.0.trial194.stdout: api_io: Running main() from gmock_main.cc 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [----------] Global test environment set-up. 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [----------] 14 tests from LibRadosIo 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (2566 ms) 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: no timeout :/ 2026-02-24T19:18:50.491 INFO:tasks.workunit.client.0.trial194.stdout: api_io: no timeout :/ 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: no timeout :/ 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: no timeout :/ 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: no timeout :/ 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (995 ms) 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (260 ms) 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.Checksum (32 ms) 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (61 ms) 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-24T19:18:50.492 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (43 ms) 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (42 ms) 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (42 ms) 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.TruncTest (617 ms) 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (122 ms) 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (1278 ms) 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.RmXattr (1021 ms) 2026-02-24T19:18:50.493 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIo.XattrIter (875 ms) 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [----------] 14 tests from LibRadosIo (7959 ms total) 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1991 ms) 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (181 ms) 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (962 ms) 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-24T19:18:50.494 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (108 ms) 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (694 ms) 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (154 ms) 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (82 ms) 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (102 ms) 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (782 ms) 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (82 ms) 2026-02-24T19:18:50.495 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [----------] 10 tests from LibRadosIoEC (5142 ms total) 2026-02-24T19:18:50.496 INFO:tasks.workunit.client.0.trial194.stdout: api_io: 2026-02-24T19:18:50.496 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [----------] Global test environment tear-down 2026-02-24T19:18:50.496 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [==========] 24 tests from 2 test suites ran. (24907 ms total) 2026-02-24T19:18:50.496 INFO:tasks.workunit.client.0.trial194.stdout: api_io: [ PASSED ] 24 tests. 2026-02-24T19:18:51.380 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_1_[48757]: starting. 2026-02-24T19:18:51.380 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_1_[48757]: creating pool ceph_test_rados_list_parallel.trial194-48684 2026-02-24T19:18:51.380 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_1_[48757]: created object 0... 2026-02-24T19:18:51.380 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_1_[48757]: created object 25... 2026-02-24T19:18:51.380 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_1_[48757]: created object 49... 2026-02-24T19:18:51.380 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_1_[48757]: finishing. 2026-02-24T19:18:51.380 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_1_[48757]: shutting down. 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_2_[48760]: starting. 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_2_[48760]: listing objects. 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_2_[48760]: listed object 0... 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_2_[48760]: listed object 25... 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_2_[48760]: saw 50 objects 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_2_[48760]: shutting down. 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_3_[50570]: starting. 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_3_[50570]: creating pool ceph_test_rados_list_parallel.trial194-48684 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_3_[50570]: created object 0... 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_3_[50570]: created object 25... 2026-02-24T19:18:51.381 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_3_[50570]: created object 49... 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_3_[50570]: finishing. 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_3_[50570]: shutting down. 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_4_[50571]: starting. 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_4_[50571]: listing objects. 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_4_[50571]: listed object 0... 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_4_[50571]: listed object 25... 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_4_[50571]: saw 45 objects 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_4_[50571]: shutting down. 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_5_[50572]: starting. 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_5_[50572]: removed 25 objects... 2026-02-24T19:18:51.382 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_5_[50572]: removed half of the objects 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_5_[50572]: removed 50 objects... 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_5_[50572]: removed 50 objects 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_5_[50572]: shutting down. 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_6_[50967]: starting. 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_6_[50967]: creating pool ceph_test_rados_list_parallel.trial194-48684 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_6_[50967]: created object 0... 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_6_[50967]: created object 25... 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_6_[50967]: created object 49... 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_6_[50967]: finishing. 2026-02-24T19:18:51.383 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_6_[50967]: shutting down. 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_7_[50968]: starting. 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_7_[50968]: listing objects. 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_7_[50968]: listed object 0... 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_7_[50968]: listed object 25... 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_7_[50968]: listed object 50... 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_7_[50968]: saw 53 objects 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_7_[50968]: shutting down. 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_8_[50969]: starting. 2026-02-24T19:18:51.384 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_8_[50969]: added 25 objects... 2026-02-24T19:18:51.385 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_8_[50969]: added half of the objects 2026-02-24T19:18:51.385 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_8_[50969]: added 50 objects... 2026-02-24T19:18:51.385 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_8_[50969]: added 50 objects 2026-02-24T19:18:51.385 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_8_[50969]: shutting down. 2026-02-24T19:18:51.385 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:51.385 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:54.202 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ************************* api_io_pp: Running main() from gmock_main.cc 2026-02-24T19:18:54.202 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2026-02-24T19:18:54.202 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [----------] Global test environment set-up. 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: seed 48111 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (3167 ms) 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (318 ms) 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (78 ms) 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-24T19:18:54.203 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (10957 ms) 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (22 ms) 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (36 ms) 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (319 ms) 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (339 ms) 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (54 ms) 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-24T19:18:54.204 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (50 ms) 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (32 ms) 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (37 ms) 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (77 ms) 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (35 ms) 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (92 ms) 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2026-02-24T19:18:54.205 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (828 ms) 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (571 ms) 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (30 ms) 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (55 ms) 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (26 ms) 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (36 ms) 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (17168 ms total) 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: 2026-02-24T19:18:54.206 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2026-02-24T19:18:54.207 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-24T19:18:54.207 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (2013 ms) 2026-02-24T19:18:54.207 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-24T19:18:54.207 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (247 ms) 2026-02-24T19:18:54.207 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-24T19:18:54.719 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadO api_service: [==========] Running 4 tests from 1 test suite. 2026-02-24T19:18:54.719 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [----------] Global test environment set-up. 2026-02-24T19:18:54.719 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [----------] 4 tests from LibRadosService 2026-02-24T19:18:54.719 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2026-02-24T19:18:54.719 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5359 ms) 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [ OK ] LibRadosService.RegisterLate (107 ms) 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: cluster: 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: id: 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: health: HEALTH_OK 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: services: 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 87s) [leader: a] 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: mgr: y(active, since 85s), standbys: x 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: osd: 16 osds: 16 up (since 53s), 16 in (since 80s) 2026-02-24T19:18:54.720 INFO:tasks.workunit.client.0.trial194.stdout: api_service: laundry: 2 daemons active (1 hosts) 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: data: 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: pools: 31 pools, 913 pgs 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: objects: 14 objects, 449 KiB 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: usage: 428 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: pgs: 15.882% pgs unknown 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 46.440% pgs not active 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 344 active+clean 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 261 creating+peering 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 163 creating+activating 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 145 unknown 2026-02-24T19:18:54.721 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: io: 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: client: 0 B/s rd, 1.2 KiB/s wr, 0 op/s rd, 1 op/s wr 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: cluster: 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: id: 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: health: HEALTH_OK 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: services: 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 89s) [leader: a] 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: mgr: y(active, since 87s), standbys: x 2026-02-24T19:18:54.722 INFO:tasks.workunit.client.0.trial194.stdout: api_service: osd: 16 osds: 16 up (since 55s), 16 in (since 82s) 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: data: 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: pools: 32 pools, 921 pgs 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: objects: 30 objects, 451 KiB 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: usage: 428 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: pgs: 29.425% pgs unknown 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 23.887% pgs not active 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 430 active+clean 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 271 unknown 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 113 creating+activating 2026-02-24T19:18:54.723 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 107 creating+peering 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: io: 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: client: 1.4 KiB/s rd, 3.8 KiB/s wr, 2 op/s rd, 5 op/s wr 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [ OK ] LibRadosService.StatusFormat (3591 ms) 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [ RUN ] LibRadosService.Status 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [ OK ] LibRadosService.Status (20021 ms) 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [----------] 4 tests from LibRadosService (29079 ms total) 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [----------] Global test environment tear-down 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [==========] 4 tests from 1 test suite ran. (29079 ms total) 2026-02-24T19:18:54.724 INFO:tasks.workunit.client.0.trial194.stdout: api_service: [ PASSED ] 4 tests. 2026-02-24T19:18:56.523 INFO:tasks.workunit.client.0.trial194.stdout:****** 2026-02-24T19:18:56.523 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_9_[54341]: starting. 2026-02-24T19:18:56.523 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_9_[54341]: creating pool ceph_test_rados_list_parallel.trial194-48684 2026-02-24T19:18:56.523 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_9_[54341]: created object 0... 2026-02-24T19:18:56.523 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_9_[54341]: created object 25... 2026-02-24T19:18:56.523 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_9_[54341]: created object 49... 2026-02-24T19:18:56.523 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_9_[54341]: finishing. 2026-02-24T19:18:56.523 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_9_[54341]: shutting down. 2026-02-24T19:18:56.523 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_10_[54342]: starting. 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_10_[54342]: listing objects. 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_10_[54342]: listed object 0... 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_10_[54342]: listed object 25... 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_10_[54342]: listed object 50... 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_10_[54342]: listed object 75... 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_10_[54342]: saw 97 objects 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_10_[54342]: shutting down. 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.524 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_13_[54345]: starting. 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_13_[54345]: removed 25 objects... 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_13_[54345]: removed half of the objects 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_13_[54345]: removed 50 objects... 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_13_[54345]: removed 50 objects 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_13_[54345]: shutting down. 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_11_[54343]: starting. 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_11_[54343]: added 25 objects... 2026-02-24T19:18:56.525 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_11_[54343]: added half of the objects 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_11_[54343]: added 50 objects... 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_11_[54343]: added 50 objects 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_11_[54343]: shutting down. 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_12_[54344]: starting. 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_12_[54344]: added 25 objects... 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_12_[54344]: added half of the objects 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_12_[54344]: added 50 objects... 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_12_[54344]: added 50 objects 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_12_[54344]: shutting down. 2026-02-24T19:18:56.526 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_14_[59772]: starting. 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_14_[59772]: creating pool ceph_test_rados_list_parallel.trial194-48684 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_14_[59772]: created object 0... 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_14_[59772]: created object 25... 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_14_[59772]: created object 49... 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_14_[59772]: finishing. 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_14_[59772]: shutting down. 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.527 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.528 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:18:56.528 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: starting. 2026-02-24T19:18:56.528 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: listing objects. 2026-02-24T19:18:56.528 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: listed object 0... 2026-02-24T19:18:56.528 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: listed object 25... 2026-02-24T19:18:58.680 INFO:tasks.workunit.client.0.trial194.stdout: list: Running main() from gmock_main.cc 2026-02-24T19:18:58.680 INFO:tasks.workunit.client.0.trial194.stdout: list: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:18:58.680 INFO:tasks.workunit.client.0.trial194.stdout: list: [----------] Global test environment set-up. 2026-02-24T19:18:58.680 INFO:tasks.workunit.client.0.trial194.stdout: list: [----------] 3 tests from NeoradosList 2026-02-24T19:18:58.680 INFO:tasks.workunit.client.0.trial194.stdout: list: [ RUN ] NeoradosList.ListObjects 2026-02-24T19:18:58.680 INFO:tasks.workunit.client.0.trial194.stdout: list: [ OK ] NeoradosList.ListObjects (7350 ms) 2026-02-24T19:18:58.680 INFO:tasks.workunit.client.0.trial194.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2026-02-24T19:18:58.680 INFO:tasks.workunit.client.0.trial194.stdout: list: [ OK ] NeoradosList.ListObjectsNS (6262 ms) 2026-02-24T19:18:58.681 INFO:tasks.workunit.client.0.trial194.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2026-02-24T19:18:58.681 INFO:tasks.workunit.client.0.trial194.stdout: list: [ OK ] NeoradosList.ListObjectsMany (19399 ms) 2026-02-24T19:18:58.681 INFO:tasks.workunit.client.0.trial194.stdout: list: [----------] 3 tests from NeoradosList (33013 ms total) 2026-02-24T19:18:58.681 INFO:tasks.workunit.client.0.trial194.stdout: list: 2026-02-24T19:18:58.681 INFO:tasks.workunit.client.0.trial194.stdout: list: [----------] Global test environment tear-down 2026-02-24T19:18:58.681 INFO:tasks.workunit.client.0.trial194.stdout: list: [==========] 3 tests from 1 test suite ran. (33013 ms total) 2026-02-24T19:18:58.681 INFO:tasks.workunit.client.0.trial194.stdout: list: [ PASSED ] 3 tests. 2026-02-24T19:19:01.689 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: listed object 50... 2026-02-24T19:19:01.690 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: listed object 75... 2026-02-24T19:19:01.690 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: listed object 100... 2026-02-24T19:19:01.690 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: listed object 125... 2026-02-24T19:19:01.690 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: saw 150 objects 2026-02-24T19:19:01.690 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_15_[59773]: shutting down. 2026-02-24T19:19:01.690 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:19:01.690 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:19:01.690 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:19:01.690 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_16_[59774]: starting. 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_16_[59774]: added 25 objects... 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_16_[59774]: added half of the objects 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_16_[59774]: added 50 objects... 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_16_[59774]: added 50 objects 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: process_16_[59774]: shutting down. 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******************************* 2026-02-24T19:19:01.691 INFO:tasks.workunit.client.0.trial194.stdout: list_parallel: ******* SUCCESS ********** 2026-02-24T19:19:02.490 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2026-02-24T19:19:02.490 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [----------] Global test environment set-up. 2026-02-24T19:19:02.490 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2026-02-24T19:19:02.490 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2026-02-24T19:19:02.490 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5300 ms) 2026-02-24T19:19:02.490 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2026-02-24T19:19:02.490 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (125 ms) 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (21244 ms) 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: attempt 0 of 20 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10176 ms) 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (36845 ms total) 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [----------] Global test environment tear-down 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (36845 ms total) 2026-02-24T19:19:02.491 INFO:tasks.workunit.client.0.trial194.stdout: api_service_pp: [ PASSED ] 4 tests. 2026-02-24T19:19:08.851 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: Running main() from gmock_main.cc 2026-02-24T19:19:08.851 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [==========] Running 6 tests from 2 test suites. 2026-02-24T19:19:08.851 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [----------] Global test environment set-up. 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: handle_notify cookie 94331112368112 notify_id 141733920768 notifier_gid 4840 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (6627 ms) 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: Trying... 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: handle_notify cookie 94331125182080 notify_id 158913789953 notifier_gid 5076 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: Waiting for 3.000000000s 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: Timed out. 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: Flushing... 2026-02-24T19:19:08.852 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: Flushed... 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (8168 ms) 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (14796 ms total) 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotify (3136 ms) 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (6511 ms) 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (7110 ms) 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (11613 ms) 2026-02-24T19:19:08.853 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll (28371 ms total) 2026-02-24T19:19:08.854 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: 2026-02-24T19:19:08.854 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [----------] Global test environment tear-down 2026-02-24T19:19:08.854 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [==========] 6 tests from 2 test suites ran. (43167 ms total) 2026-02-24T19:19:08.854 INFO:tasks.workunit.client.0.trial194.stdout: watch_notify: [ PASSED ] 6 tests. 2026-02-24T19:19:10.334 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:15.141 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:10.350 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:15.158 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:10.438 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:15.246 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:10.589 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:02:15.394 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:10.601 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:02:15.370 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:10.660 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:02:15.429 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:10.673 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:02:15.479 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:10.781 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:02:15.550 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:10.789 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:02:15.594 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:13.246 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: Running main() from gmock_main.cc 2026-02-24T19:19:13.246 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2026-02-24T19:19:13.246 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [----------] Global test environment set-up. 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify_test_cb 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (2605 ms) 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: waiting up to 300 for disconnect notification ...watch_notify2_test_errcb cookie 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: 94660246948224 err -107 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1964 ms) 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-24T19:19:13.247 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94660246951872 err -107 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1269 ms) 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_cb from 4774 notify_id 154618822656 cookie 94660246962032 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (267 ms) 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_cb from 4774 notify_id 158913789952 cookie 94660246962032 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (911 ms) 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_cb from 4774 notify_id 158913789953 cookie 94660246962032 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (134 ms) 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_cb from 4774 notify_id 158913789952 cookie 94660246962032 2026-02-24T19:19:13.248 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_cb from 4774 notify_id 158913789952 cookie 94660246994080 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (133 ms) 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_cb from 4774 notify_id 163208757248 cookie 94660246994080 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_cb from 4774 notify_id 167503724545 cookie 94660246994080 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3933 ms) 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94660246994080 err -107 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify2_test_cb from 4774 notify_id 201863462913 cookie 94660246995280 2026-02-24T19:19:13.249 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5327 ms) 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: waiting up to watch_notify2_test_errcb cookie 30 for disconnect notification ...94660246997968 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: err -107 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1782 ms) 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (18330 ms total) 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: watch_notify_test_cb 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (2620 ms) 2026-02-24T19:19:13.250 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (2620 ms total) 2026-02-24T19:19:13.251 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: 2026-02-24T19:19:13.251 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [----------] Global test environment tear-down 2026-02-24T19:19:13.251 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (47627 ms total) 2026-02-24T19:19:13.251 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify: [ PASSED ] 11 tests. 2026-02-24T19:19:13.485 INFO:tasks.workunit.client.0.trial194.stdout:h_notify_pp: trying... 2026-02-24T19:19:13.485 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263174331760 notify_id 214748364801 notifier_gid 5114 2026-02-24T19:19:13.485 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: timed out 2026-02-24T19:19:13.485 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: flushing 2026-02-24T19:19:13.485 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: flushed 2026-02-24T19:19:13.485 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3058 ms) 2026-02-24T19:19:13.485 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-24T19:19:13.485 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: trying... 2026-02-24T19:19:13.485 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263173993808 notify_id 219043332102 notifier_gid 5114 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: timed out 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: flushing 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: flushed 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3077 ms) 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: List watches 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: notify2 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263174331760 notify_id 227633266690 notifier_gid 5114 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: notify2 done 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: watch_check 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: unwatch2 2026-02-24T19:19:13.486 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: flushing 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: done 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3268 ms) 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: List watches 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: notify2 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: handle_notify cookie 94263174331760 notify_id 236223201283 notifier_gid 5114 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: notify2 done 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: watch_check 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: unwatch2 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: flushing 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: done 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3270 ms) 2026-02-24T19:19:13.487 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (19884 ms total) 2026-02-24T19:19:13.488 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: 2026-02-24T19:19:13.488 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2026-02-24T19:19:13.488 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (47860 ms total) 2026-02-24T19:19:13.488 INFO:tasks.workunit.client.0.trial194.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2026-02-24T19:19:14.780 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: Running main() from gmock_main.cc 2026-02-24T19:19:14.780 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:19:14.780 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [----------] Global test environment set-up. 2026-02-24T19:19:14.780 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [----------] 3 tests from NeoradosECList 2026-02-24T19:19:14.780 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2026-02-24T19:19:14.780 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (11387 ms) 2026-02-24T19:19:14.780 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2026-02-24T19:19:14.780 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (8394 ms) 2026-02-24T19:19:14.781 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2026-02-24T19:19:14.781 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (29325 ms) 2026-02-24T19:19:14.781 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [----------] 3 tests from NeoradosECList (49107 ms total) 2026-02-24T19:19:14.781 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: 2026-02-24T19:19:14.781 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [----------] Global test environment tear-down 2026-02-24T19:19:14.781 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (49107 ms total) 2026-02-24T19:19:14.781 INFO:tasks.workunit.client.0.trial194.stdout: ec_list: [ PASSED ] 3 tests. 2026-02-24T19:19:19.872 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: Running main() from gmock_main.cc 2026-02-24T19:19:19.872 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2026-02-24T19:19:19.872 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [----------] Global test environment set-up. 2026-02-24T19:19:19.872 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2026-02-24T19:19:19.872 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2026-02-24T19:19:19.872 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-24T19:19:19.872 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-24T19:19:19.872 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (6661 ms) 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (2757 ms) 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3183 ms) 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3233 ms) 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (2948 ms) 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2026-02-24T19:19:19.873 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (5721 ms) 2026-02-24T19:19:19.874 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2026-02-24T19:19:19.874 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (29725 ms) 2026-02-24T19:19:19.874 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (54230 ms total) 2026-02-24T19:19:19.874 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: 2026-02-24T19:19:19.874 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [----------] Global test environment tear-down 2026-02-24T19:19:19.874 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (54230 ms total) 2026-02-24T19:19:19.874 INFO:tasks.workunit.client.0.trial194.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2026-02-24T19:19:22.498 INFO:tasks.workunit.client.0.trial194.stdout:pPP (126 ms) 2026-02-24T19:19:22.499 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-24T19:19:22.499 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (98 ms) 2026-02-24T19:19:22.499 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-24T19:19:22.499 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (32 ms) 2026-02-24T19:19:22.499 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-24T19:19:22.499 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (85 ms) 2026-02-24T19:19:22.499 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-24T19:19:22.499 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (70 ms) 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (153 ms) 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (134 ms) 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (52 ms) 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (63 ms) 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (73 ms) 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (651 ms) 2026-02-24T19:19:22.500 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (17905 ms) 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (1770 ms) 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (86 ms) 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (33 ms) 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (60 ms) 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (23659 ms total) 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: 2026-02-24T19:19:22.501 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [----------] Global test environment tear-down 2026-02-24T19:19:22.502 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (56911 ms total) 2026-02-24T19:19:22.502 INFO:tasks.workunit.client.0.trial194.stdout: api_io_pp: [ PASSED ] 40 tests. 2026-02-24T19:19:35.032 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:39.840 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:35.036 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:39.844 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:35.178 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:39.986 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:35.186 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:02:39.955 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:35.221 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:02:39.990 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:35.288 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:02:40.094 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:35.292 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:02:40.097 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:35.367 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:02:40.136 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:35.465 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:02:40.271 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:39.588 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: Running main() from gmock_main.cc 2026-02-24T19:19:39.588 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [==========] Running 8 tests from 1 test suite. 2026-02-24T19:19:39.588 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [----------] Global test environment set-up. 2026-02-24T19:19:39.588 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (6616 ms) 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3813 ms) 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3167 ms) 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (4326 ms) 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (2864 ms) 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (8699 ms) 2026-02-24T19:19:39.589 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2026-02-24T19:19:39.590 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (36139 ms) 2026-02-24T19:19:39.590 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Cancel 2026-02-24T19:19:39.590 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ OK ] NeoRadosWriteOps.Cancel (8274 ms) 2026-02-24T19:19:39.590 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps (73902 ms total) 2026-02-24T19:19:39.590 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: 2026-02-24T19:19:39.590 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [----------] Global test environment tear-down 2026-02-24T19:19:39.590 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [==========] 8 tests from 1 test suite ran. (73902 ms total) 2026-02-24T19:19:39.590 INFO:tasks.workunit.client.0.trial194.stdout: write_operations: [ PASSED ] 8 tests. 2026-02-24T19:19:41.025 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: Running main() from gmock_main.cc 2026-02-24T19:19:41.025 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2026-02-24T19:19:41.025 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [----------] Global test environment set-up. 2026-02-24T19:19:41.025 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [----------] 9 tests from LibRadosPools 2026-02-24T19:19:41.025 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2026-02-24T19:19:41.025 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ OK ] LibRadosPools.PoolList (3854 ms) 2026-02-24T19:19:41.025 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3549 ms) 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3115 ms) 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3161 ms) 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3285 ms) 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (7571 ms) 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (10011 ms) 2026-02-24T19:19:41.026 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-24T19:19:41.027 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (16536 ms) 2026-02-24T19:19:41.027 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-24T19:19:41.027 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (24332 ms) 2026-02-24T19:19:41.027 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [----------] 9 tests from LibRadosPools (75417 ms total) 2026-02-24T19:19:41.027 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: 2026-02-24T19:19:41.027 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [----------] Global test environment tear-down 2026-02-24T19:19:41.027 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (75417 ms total) 2026-02-24T19:19:41.027 INFO:tasks.workunit.client.0.trial194.stdout: api_pool: [ PASSED ] 9 tests. 2026-02-24T19:19:42.621 INFO:tasks.workunit.client.0.trial194.stdout: misc: Running main() from gmock_main.cc 2026-02-24T19:19:42.622 INFO:tasks.workunit.client.0.trial194.stdout: misc: [==========] Running 12 tests from 1 test suite. 2026-02-24T19:19:42.622 INFO:tasks.workunit.client.0.trial194.stdout: misc: [----------] Global test environment set-up. 2026-02-24T19:19:42.622 INFO:tasks.workunit.client.0.trial194.stdout: misc: [----------] 12 tests from NeoRadosMisc 2026-02-24T19:19:42.622 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.Version 2026-02-24T19:19:42.622 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.Version (3787 ms) 2026-02-24T19:19:42.622 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-24T19:19:42.622 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (3555 ms) 2026-02-24T19:19:42.622 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2026-02-24T19:19:42.622 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.LongName (4135 ms) 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (4453 ms) 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3861 ms) 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (6256 ms) 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.Exec (6958 ms) 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (10103 ms) 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (7924 ms) 2026-02-24T19:19:42.623 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.BigObject (7065 ms) 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (9313 ms) 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (9529 ms) 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: [----------] 12 tests from NeoRadosMisc (76945 ms total) 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: [----------] Global test environment tear-down 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: [==========] 12 tests from 1 test suite ran. (76945 ms total) 2026-02-24T19:19:42.624 INFO:tasks.workunit.client.0.trial194.stdout: misc: [ PASSED ] 12 tests. 2026-02-24T19:19:45.862 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2026-02-24T19:19:45.862 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] Global test environment set-up. 2026-02-24T19:19:45.862 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2026-02-24T19:19:45.862 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2026-02-24T19:19:45.862 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-24T19:19:45.862 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T19:19:45.862 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: 2026-02-24T19:18:25.852+0000 7f5062983880 -1 failed for service _ceph-mon._tcp 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: 2026-02-24T19:18:25.852+0000 7f5062983880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (250 ms) 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5002 ms) 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5253 ms total) 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2026-02-24T19:19:45.863 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: started 0x55dca4992fb0 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: started 0x55dca4b7be70 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: started 2 aios 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: waiting 0x55dca4992fb0 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: waiting 0x55dca4b7be70 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: done. 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (7391 ms) 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (7391 ms total) 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-24T19:19:45.864 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMisc.Exec (626 ms) 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (276 ms) 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (28 ms) 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5071 ms) 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2026-02-24T19:19:45.865 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (58830 ms) 2026-02-24T19:19:45.866 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] 8 tests from LibRadosMisc (64833 ms total) 2026-02-24T19:19:45.866 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: 2026-02-24T19:19:45.866 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [----------] Global test environment tear-down 2026-02-24T19:19:45.866 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (80242 ms total) 2026-02-24T19:19:45.866 INFO:tasks.workunit.client.0.trial194.stdout: api_misc: [ PASSED ] 12 tests. 2026-02-24T19:19:54.598 INFO:tasks.workunit.client.0.trial194.stdout: io: Running main() from gmock_main.cc 2026-02-24T19:19:54.598 INFO:tasks.workunit.client.0.trial194.stdout: io: [==========] Running 14 tests from 1 test suite. 2026-02-24T19:19:54.598 INFO:tasks.workunit.client.0.trial194.stdout: io: [----------] Global test environment set-up. 2026-02-24T19:19:54.598 INFO:tasks.workunit.client.0.trial194.stdout: io: [----------] 14 tests from NeoRadosIo 2026-02-24T19:19:54.598 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.Limits 2026-02-24T19:19:54.598 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.Limits (6422 ms) 2026-02-24T19:19:54.598 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (4029 ms) 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.ReadOp (3120 ms) 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.SparseRead (4380 ms) 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.RoundTrip (2864 ms) 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (8662 ms) 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (13643 ms) 2026-02-24T19:19:54.599 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (11017 ms) 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (7930 ms) 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.Trunc 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.Trunc (10346 ms) 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.Remove 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.Remove (7772 ms) 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3060 ms) 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.RmXattr (2744 ms) 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2026-02-24T19:19:54.600 INFO:tasks.workunit.client.0.trial194.stdout: io: [ OK ] NeoRadosIo.GetXattrs (2938 ms) 2026-02-24T19:19:54.601 INFO:tasks.workunit.client.0.trial194.stdout: io: [----------] 14 tests from NeoRadosIo (88934 ms total) 2026-02-24T19:19:54.601 INFO:tasks.workunit.client.0.trial194.stdout: io: 2026-02-24T19:19:54.601 INFO:tasks.workunit.client.0.trial194.stdout: io: [----------] Global test environment tear-down 2026-02-24T19:19:54.601 INFO:tasks.workunit.client.0.trial194.stdout: io: [==========] 14 tests from 1 test suite ran. (88934 ms total) 2026-02-24T19:19:54.601 INFO:tasks.workunit.client.0.trial194.stdout: io: [ PASSED ] 14 tests. 2026-02-24T19:19:54.626 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:59.434 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:54.629 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:59.437 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:54.656 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:02:59.425 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:54.657 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:02:59.463 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:54.659 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:02:59.465 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:54.664 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:59.472 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:54.665 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:02:59.434 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:54.691 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:02:59.497 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:54.696 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:02:59.465 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:56.737 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: Running main() from gmock_main.cc 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [==========] Running 15 tests from 1 test suite. 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [----------] Global test environment set-up. 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (6632 ms) 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3766 ms) 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3203 ms) 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2026-02-24T19:19:56.738 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (4346 ms) 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (2846 ms) 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (10299 ms) 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (9515 ms) 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (8669 ms) 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (7287 ms) 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (10823 ms) 2026-02-24T19:19:56.739 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (9549 ms) 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (5277 ms) 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (2730 ms) 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3243 ms) 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ RUN ] NeoRadosReadOps.Cancel 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ OK ] NeoRadosReadOps.Cancel (2863 ms) 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps (91058 ms total) 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [----------] Global test environment tear-down 2026-02-24T19:19:56.740 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [==========] 15 tests from 1 test suite ran. (91058 ms total) 2026-02-24T19:19:56.741 INFO:tasks.workunit.client.0.trial194.stdout: read_operations: [ PASSED ] 15 tests. 2026-02-24T19:19:58.786 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: Running main() from gmock_main.cc 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] Global test environment set-up. 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (5078 ms) 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2098 ms) 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2063 ms) 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2026-02-24T19:19:58.787 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2095 ms) 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (11335 ms total) 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4241 ms) 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (8583 ms) 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (10955 ms) 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (23780 ms total) 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: 2026-02-24T19:19:58.788 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (5339 ms) 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (3201 ms) 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (4064 ms) 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (4928 ms) 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (17533 ms total) 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-24T19:19:58.789 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-24T19:19:58.790 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4060 ms) 2026-02-24T19:19:58.790 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-24T19:19:58.790 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3915 ms) 2026-02-24T19:19:58.790 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (7976 ms total) 2026-02-24T19:19:58.790 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: 2026-02-24T19:19:58.790 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [----------] Global test environment tear-down 2026-02-24T19:19:58.790 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (93175 ms total) 2026-02-24T19:19:58.790 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots: [ PASSED ] 13 tests. 2026-02-24T19:19:58.792 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:58.792 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48603 2026-02-24T19:19:58.792 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48603 2026-02-24T19:19:58.792 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:58.792 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48372 2026-02-24T19:19:58.792 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48372 2026-02-24T19:19:58.792 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48257 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48257 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48112 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48112 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48318 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48318 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48711 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48711 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:58.793 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48736 2026-02-24T19:19:58.794 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48736 2026-02-24T19:19:58.794 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:19:58.794 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48133 2026-02-24T19:19:58.794 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48133 2026-02-24T19:20:14.642 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:19.449 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:14.677 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:19.484 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:14.705 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:03:19.510 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:14.708 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:03:19.514 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:14.710 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:03:19.478 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:14.710 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:19.518 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:14.715 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:03:19.484 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:14.739 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:03:19.545 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:14.744 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:03:19.513 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:18.792 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: seed 48356 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (5098 ms) 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2128 ms) 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2012 ms) 2026-02-24T19:20:18.793 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2091 ms) 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4358 ms) 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (15690 ms total) 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (8760 ms) 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (10675 ms) 2026-02-24T19:20:18.794 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (19178 ms) 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (12868 ms) 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (6086 ms) 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial194-48356-7 2026-02-24T19:20:18.795 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: waiting for snaps to purge 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (18661 ms) 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (76231 ms total) 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (2 ms) 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5356 ms) 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5359 ms total) 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-24T19:20:18.796 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (2921 ms) 2026-02-24T19:20:18.797 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-24T19:20:18.797 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2135 ms) 2026-02-24T19:20:18.797 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-24T19:20:20.730 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ snapshots: Running main() from gmock_main.cc 2026-02-24T19:20:20.730 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2026-02-24T19:20:20.730 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [----------] Global test environment set-up. 2026-02-24T19:20:20.730 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2026-02-24T19:20:20.730 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2026-02-24T19:20:20.730 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (8297 ms) 2026-02-24T19:20:20.730 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (5290 ms) 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4310 ms) 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (8132 ms) 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (17152 ms) 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (43184 ms total) 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-24T19:20:20.731 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (13442 ms) 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (17387 ms) 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (10930 ms) 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6112 ms) 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (3935 ms) 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnaptrial194-49083-11. 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: Waiting for snaps to purge. 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20053 ms) 2026-02-24T19:20:20.732 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (71863 ms total) 2026-02-24T19:20:20.733 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: 2026-02-24T19:20:20.733 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [----------] Global test environment tear-down 2026-02-24T19:20:20.733 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (115047 ms total) 2026-02-24T19:20:20.733 INFO:tasks.workunit.client.0.trial194.stdout: snapshots: [ PASSED ] 11 tests. 2026-02-24T19:20:33.784 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: Running main() from gmock_main.cc 2026-02-24T19:20:33.784 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [==========] Running 45 tests from 2 test suites. 2026-02-24T19:20:33.784 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [----------] Global test environment set-up. 2026-02-24T19:20:33.784 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [----------] 29 tests from LibRadosAio 2026-02-24T19:20:33.784 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2026-02-24T19:20:33.784 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.TooBig (3880 ms) 2026-02-24T19:20:33.784 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (4533 ms) 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3182 ms) 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3277 ms) 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (3163 ms) 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (2859 ms) 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (10294 ms) 2026-02-24T19:20:33.785 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (12013 ms) 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (9391 ms) 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (9375 ms) 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (10784 ms) 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (7515 ms) 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3058 ms) 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2026-02-24T19:20:33.786 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2737 ms) 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.Flush (2945 ms) 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3156 ms) 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (2923 ms) 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3104 ms) 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3216 ms) 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (2625 ms) 2026-02-24T19:20:33.787 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3169 ms) 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2919 ms) 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3085 ms) 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (2952 ms) 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3106 ms) 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3053 ms) 2026-02-24T19:20:33.788 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-24T19:20:33.789 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.CancelBeforeSubmit (2836 ms) 2026-02-24T19:20:33.789 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-24T19:20:33.791 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2026-02-24T19:20:33.791 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] Global test environment set-up. 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: seed 48269 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (2042 ms) 2026-02-24T19:20:33.792 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (387 ms) 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (990 ms) 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (121 ms) 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (37 ms) 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (20 ms) 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (64 ms) 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2026-02-24T19:20:33.793 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (28 ms) 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (151 ms) 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (39 ms) 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (921 ms) 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (83 ms) 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: osd_max_attr_size = 0 2026-02-24T19:20:33.794 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (38554 ms) 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (4640 ms) 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: waiting for initial deep scrubs... 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: done waiting, doing copies 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: waiting for final deep scrubs... 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: done waiting 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (72122 ms) 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-24T19:20:33.795 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (45 ms) 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (23 ms) 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4569 ms) 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2026-02-24T19:20:33.796 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-24T19:20:34.657 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:39.465 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:34.659 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:39.467 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:34.683 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:03:39.451 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:34.684 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:03:39.489 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:34.684 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:03:39.490 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:34.685 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:03:39.454 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:34.687 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:39.495 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:34.710 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:03:39.516 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:34.712 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:03:39.481 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:41.776 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 22 tests fr OK ] LibRadosSnapshotsECPP.RollbackPP (2018 ms) 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (1934 ms) 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9010 ms total) 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (3959 ms) 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3981 ms) 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-24T19:20:41.777 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4176 ms) 2026-02-24T19:20:41.778 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12118 ms total) 2026-02-24T19:20:41.778 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: 2026-02-24T19:20:41.778 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2026-02-24T19:20:41.778 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (136163 ms total) 2026-02-24T19:20:41.778 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2026-02-24T19:20:41.778 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2026-02-24T19:20:41.778 INFO:tasks.workunit.client.0.trial194.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T19:20:47.870 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: Running main() from gmock_main.cc 2026-02-24T19:20:47.870 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [==========] Running 63 tests from 5 test suites. 2026-02-24T19:20:47.870 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] Global test environment set-up. 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (3742 ms) 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (23791 ms) 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (23592 ms) 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (8615 ms) 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (9151 ms) 2026-02-24T19:20:47.871 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (9616 ms) 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3803 ms) 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2727 ms) 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3245 ms) 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (2870 ms) 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2865 ms) 2026-02-24T19:20:47.872 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3174 ms) 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3173 ms) 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3165 ms) 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (2598 ms) 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2923 ms) 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3142 ms) 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-24T19:20:47.873 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2939 ms) 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3068 ms) 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3105 ms) 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (2775 ms) 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3112 ms) 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3056 ms) 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3170 ms) 2026-02-24T19:20:47.874 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2026-02-24T19:20:47.875 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2764 ms) 2026-02-24T19:20:47.875 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2026-02-24T19:20:47.875 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3046 ms) 2026-02-24T19:20:47.875 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-24T19:20:59.783 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:04.590 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:59.784 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:04.592 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:59.809 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:04:04.615 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:59.810 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:04:04.616 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:59.813 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:04:04.582 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:59.814 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:04:04.583 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:59.832 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:04.639 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:59.845 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:04:04.651 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:59.848 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:04:04.617 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:00.765 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAiom LibRadosMiscPP (124843 ms total) 2026-02-24T19:21:00.765 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: 2026-02-24T19:21:00.765 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (1313 ms) 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (1313 ms total) 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (154 ms) 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (25 ms) 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (179 ms total) 2026-02-24T19:21:00.766 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (222 ms) 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (27 ms) 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (249 ms total) 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (145 ms) 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2026-02-24T19:21:00.767 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (60 ms) 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (205 ms total) 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1250 ms) 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1250 ms total) 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [----------] Global test environment tear-down 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (155151 ms total) 2026-02-24T19:21:00.768 INFO:tasks.workunit.client.0.trial194.stdout: api_misc_pp: [ PASSED ] 31 tests. 2026-02-24T19:21:00.769 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:00.769 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48632 2026-02-24T19:21:00.769 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48632 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48008 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48008 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48070 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48070 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48551 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48551 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=47999 2026-02-24T19:21:00.770 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 47999 2026-02-24T19:21:00.775 INFO:tasks.workunit.client.0.trial194.stdout:: : entry=13 expected=13 2026-02-24T19:21:00.775 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:de5d7c5f:::12:head 2026-02-24T19:21:00.775 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:de5d7c5f:::12:head expected=18:de5d7c5f:::12:head 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:de5d7c5f:::12:head -> 12 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=12 expected=12 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:d83876eb:::4:head 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:d83876eb:::4:head expected=18:d83876eb:::4:head 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:d83876eb:::4:head -> 4 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=4 expected=4 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:cfc208b3:::3:head 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:cfc208b3:::3:head expected=18:cfc208b3:::3:head 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:cfc208b3:::3:head -> 3 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=3 expected=3 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:c4fdafeb:::6:head 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:c4fdafeb:::6:head expected=18:c4fdafeb:::6:head 2026-02-24T19:21:00.776 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:c4fdafeb:::6:head -> 6 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=6 expected=6 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:bd63b0f1:::8:head 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:bd63b0f1:::8:head expected=18:bd63b0f1:::8:head 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:bd63b0f1:::8:head -> 8 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=8 expected=8 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:863748b0:::15:head 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:863748b0:::15:head expected=18:863748b0:::15:head 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:863748b0:::15:head -> 15 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=15 expected=15 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:6cac518f:::0:head 2026-02-24T19:21:00.777 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:6cac518f:::0:head expected=18:6cac518f:::0:head 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:6cac518f:::0:head -> 0 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=0 expected=0 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : seek to 18:62a1935d:::14:head 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : cursor()=18:62a1935d:::14:head expected=18:62a1935d:::14:head 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: > 18:62a1935d:::14:head -> 14 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: : entry=14 expected=14 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (5198 ms) 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (123623 ms) 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: split 0/5 -> MIN 18:33333333::::head 2026-02-24T19:21:00.778 INFO:tasks.workunit.client.0.trial194.stdout: api_list: split 1/5 -> 18:33333333::::head 18:66666666::::head 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: split 2/5 -> 18:66666666::::head 18:99999999::::head 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: split 3/5 -> 18:99999999::::head 18:cccccccc::::head 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: split 4/5 -> 18:cccccccc::::head MAX 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (2121 ms) 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [----------] 7 tests from LibRadosList (146575 ms total) 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [----------] 3 tests from LibRadosListEC 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1723 ms) 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: myset foo1,foo2,foo3 2026-02-24T19:21:00.779 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo1 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo2 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo3 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: myset foo1,foo4,foo5 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo4 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo5 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo1 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: myset foo6,foo7 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo7 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: foo6 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns1:foo4 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns1:foo5 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns2:foo7 2026-02-24T19:21:00.780 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns2:foo6 2026-02-24T19:21:00.781 INFO:tasks.workunit.client.0.trial194.stdout: api_list: ns1:foo1 2026-02-24T19:21:00.781 INFO:tasks.workunit.client.0.trial194.stdout: api_list: :foo1 2026-02-24T19:21:00.781 INFO:tasks.workunit.client.0.trial194.stdout: api_list: :foo2 2026-02-24T19:21:00.781 INFO:tasks.workunit.client.0.trial194.stdout: api_list: :foo3 2026-02-24T19:21:00.781 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (991 ms) 2026-02-24T19:21:07.960 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2026-02-24T19:21:07.960 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 1 0 2026-02-24T19:21:07.960 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 10 0 2026-02-24T19:21:07.960 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 13 0 2026-02-24T19:21:07.960 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 7 0 2026-02-24T19:21:07.960 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 14 0 2026-02-24T19:21:07.960 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 0 0 2026-02-24T19:21:07.960 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 15 0 2026-02-24T19:21:07.960 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 11 0 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 5 0 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 8 0 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 6 0 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 3 0 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 4 0 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 12 0 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 9 0 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 2 0 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (1800 ms) 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [----------] 3 tests from LibRadosListEC (4516 ms total) 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 2026-02-24T19:21:07.961 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [----------] 1 test from LibRadosListNP 2026-02-24T19:21:07.962 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2026-02-24T19:21:07.962 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3051 ms) 2026-02-24T19:21:07.962 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [----------] 1 test from LibRadosListNP (3051 ms total) 2026-02-24T19:21:07.962 INFO:tasks.workunit.client.0.trial194.stdout: api_list: 2026-02-24T19:21:07.962 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [----------] Global test environment tear-down 2026-02-24T19:21:07.962 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [==========] 11 tests from 3 test suites ran. (162360 ms total) 2026-02-24T19:21:07.962 INFO:tasks.workunit.client.0.trial194.stdout: api_list: [ PASSED ] 11 tests. 2026-02-24T19:21:39.886 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:44.693 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:39.890 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:44.698 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:39.920 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:04:44.689 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:39.923 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:04:44.692 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:39.948 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:44.756 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:39.949 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:04:44.755 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:39.951 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:04:44.757 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:39.973 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:04:44.742 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:39.992 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:04:44.797 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:59.890 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:04.697 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:59.893 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:04.701 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:59.918 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:05:04.724 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:59.919 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:05:04.688 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:59.920 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:05:04.725 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:59.921 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:05:04.690 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:59.929 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:04.737 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:59.942 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:05:04.711 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:59.943 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:05:04.749 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:19.899 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:24.706 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:19.929 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:24.736 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:19.954 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:05:24.723 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:19.956 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:05:24.761 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:19.956 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:05:24.725 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:19.957 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:05:24.762 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:19.964 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:24.771 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:19.982 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:05:24.751 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:19.989 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:05:24.795 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:29.336 INFO:tasks.workunit.client.0.trial194.stdout:api_aio: [ OK ] LibRadosAio.CancelBeforeComplete (3040 ms) 2026-02-24T19:22:29.336 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAio.CancelAfterComplete 2026-02-24T19:22:29.336 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAio.CancelAfterComplete (3100 ms) 2026-02-24T19:22:29.336 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [----------] 29 tests from LibRadosAio (131304 ms total) 2026-02-24T19:22:29.336 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: 2026-02-24T19:22:29.336 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2026-02-24T19:22:29.336 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2026-02-24T19:22:29.336 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6939 ms) 2026-02-24T19:22:29.336 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6904 ms) 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7327 ms) 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6932 ms) 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6888 ms) 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7238 ms) 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6856 ms) 2026-02-24T19:22:29.337 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6899 ms) 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7100 ms) 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6964 ms) 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6956 ms) 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6979 ms) 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7080 ms) 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2026-02-24T19:22:29.338 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7140 ms) 2026-02-24T19:22:29.339 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2026-02-24T19:22:29.339 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (6869 ms) 2026-02-24T19:22:29.339 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2026-02-24T19:22:29.339 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7371 ms) 2026-02-24T19:22:29.339 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112449 ms total) 2026-02-24T19:22:29.339 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: 2026-02-24T19:22:29.339 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [----------] Global test environment tear-down 2026-02-24T19:22:29.339 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [==========] 45 tests from 2 test suites ran. (243753 ms total) 2026-02-24T19:22:29.339 INFO:tasks.workunit.client.0.trial194.stdout: api_aio: [ PASSED ] 45 tests. 2026-02-24T19:22:39.956 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:44.763 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:39.957 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:44.765 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:39.976 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:44.784 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:39.981 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:05:44.750 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:39.982 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:05:44.751 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:39.984 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:05:44.789 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:39.985 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:05:44.791 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:40.003 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:05:44.772 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:40.007 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:05:44.812 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.989 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:04.796 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:59.990 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:04.798 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:00.012 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:04.819 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:00.015 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:04.821 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:00.016 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:04.822 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:00.018 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:04.786 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:00.019 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:04.788 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:00.034 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:04.840 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:00.040 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:04.809 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:09.387 INFO:tasks.workunit.client.0.trial194.stdout:o.RoundTripAppendPP (3047 ms) 2026-02-24T19:23:09.387 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2857 ms) 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3058 ms) 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3184 ms) 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: sending pool EIO time: 2026-02-24T19:21:04.093152+0000 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: eio flag missed all ios that already completed 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: 2026-02-24T19:23:09.388 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag (8945 ms) 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3043 ms) 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (163376 ms total) 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (2917 ms) 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (8908 ms) 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (15181 ms) 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-24T19:23:09.389 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3110 ms) 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30117 ms total) 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (2770 ms) 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (2770 ms total) 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (14061 ms) 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7020 ms) 2026-02-24T19:23:09.390 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6945 ms) 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7244 ms) 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (2779 ms) 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7311 ms) 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6742 ms) 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6983 ms) 2026-02-24T19:23:09.391 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2026-02-24T19:23:09.392 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7085 ms) 2026-02-24T19:23:09.392 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-24T19:23:09.392 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7104 ms) 2026-02-24T19:23:09.392 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2026-02-24T19:23:09.392 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6859 ms) 2026-02-24T19:23:09.392 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-24T19:23:09.392 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7400 ms) 2026-02-24T19:23:20.025 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:24.832 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:20.051 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:24.858 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:20.070 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:24.877 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:20.078 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:24.883 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:20.078 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:24.847 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:20.079 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:24.884 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:20.079 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:24.848 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:20.098 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:24.903 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:20.099 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:24.867 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:32.531 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:37.339 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:32.533 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:37.341 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:32.550 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:37.357 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:32.560 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:37.329 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:32.561 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:37.366 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:32.561 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:37.330 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:32.562 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:37.367 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:32.578 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:37.347 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:32.578 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:37.383 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:40.055 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:44.862 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:40.056 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:44.864 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:40.066 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:44.873 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:40.080 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:44.885 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:40.081 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:44.887 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:40.084 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:44.853 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:40.085 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:44.854 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:40.095 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:06:44.901 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:40.098 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:06:44.867 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:00.101 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:04.908 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:00.102 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:04.909 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:00.120 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:04.928 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:00.128 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:07:04.896 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:00.128 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:07:04.933 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:00.128 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:07:04.897 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:00.129 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:07:04.934 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:00.147 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:07:04.916 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:00.148 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:07:04.954 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:04.117 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-24T19:24:04.117 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6843 ms) 2026-02-24T19:24:04.117 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-24T19:24:04.117 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3198 ms) 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6879 ms) 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (6769 ms) 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7004 ms) 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7267 ms) 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (6836 ms) 2026-02-24T19:24:04.118 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (6897 ms) 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139236 ms total) 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-24T19:24:04.119 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (103 ms) 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/cancel (9 ms) 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel (112 ms total) 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [----------] Global test environment tear-down 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [==========] 63 tests from 5 test suites ran. (338531 ms total) 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ PASSED ] 62 tests. 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ SKIPPED ] 1 test, listed below: 2026-02-24T19:24:04.120 INFO:tasks.workunit.client.0.trial194.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-24T19:24:04.124 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.124 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48020 2026-02-24T19:24:04.124 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48020 2026-02-24T19:24:04.124 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48818 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48818 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48198 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48198 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48895 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48895 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48296 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48296 2026-02-24T19:24:04.125 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48680 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48680 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48961 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48961 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48225 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48225 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48580 2026-02-24T19:24:04.126 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48580 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48794 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48794 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48653 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48653 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48844 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48844 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48515 2026-02-24T19:24:04.127 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48515 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48152 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48152 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48923 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48923 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48410 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48410 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=47991 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 47991 2026-02-24T19:24:04.128 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48052 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48052 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48340 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48340 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48091 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48091 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48456 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48456 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.129 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48493 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48493 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48758 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48758 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ pid=48997 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ wait 48997 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ exit 0 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ cleanup 2026-02-24T19:24:04.130 INFO:tasks.workunit.client.0.trial194.stderr:+ pkill -P 47985 2026-02-24T19:24:04.132 INFO:tasks.workunit.client.0.trial194.stderr:+ true 2026-02-24T19:24:04.132 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-24T19:24:04.132 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-24T19:24:04.159 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2026-02-24T19:24:04.159 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-24T19:24:04.511 DEBUG:teuthology.parallel:result is None 2026-02-24T19:24:04.512 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T19:24:04.537 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T19:24:04.537 DEBUG:teuthology.orchestra.run.trial194:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T19:24:04.593 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T19:24:04.594 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-24T19:24:04.607 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T19:24:04.607 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:04.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.674+0000 7f140eda2640 10 monclient: get_monmap_and_config 2026-02-24T19:24:04.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.674+0000 7f140eda2640 10 monclient: build_initial_monmap 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.674+0000 7f140eda2640 10 monclient: monmap: 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:04.675140+0000 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:04.675140+0000 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:04.678 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.674+0000 7f140eda2640 1 Processor -- start 2026-02-24T19:24:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.674+0000 7f140eda2640 1 -- start start 2026-02-24T19:24:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.674+0000 7f140eda2640 10 monclient: init 2026-02-24T19:24:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:04.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 10 monclient(hunting): picked mon.noname-b con 0x7f1408058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 10 monclient(hunting): picked mon.noname-c con 0x7f14080b0410 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 10 monclient(hunting): picked mon.noname-a con 0x7f14081626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14081655c0 con 0x7f14081626a0 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14080b12b0 con 0x7f1408058da0 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14080b1590 con 0x7f14080b0410 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140eda2640 10 monclient(hunting): authenticate will time out at 4016.314148s 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140cb17640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f1408058da0 0x7f14081647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34866/0 (socket says 10.20.193.45:34866) 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.675+0000 7f140cb17640 1 -- 10.20.193.45:0/37269426 learned_addr learned my addr 10.20.193.45:0/37269426 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.676+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2478002473 0 0) 0x7f14080b12b0 con 0x7f1408058da0 2026-02-24T19:24:04.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.676+0000 7f13ff7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.676+0000 7f13ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.676+0000 7f13ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.676+0000 7f13ff7fe640 10 monclient(hunting): my global_id is 28060 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.676+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13f4003610 con 0x7f1408058da0 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195947634 0 0) 0x7f14081655c0 con 0x7f14081626a0 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 10 monclient(hunting): my global_id is 30591 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14080b12b0 con 0x7f14081626a0 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1001777634 0 0) 0x7f14080b1590 con 0x7f14080b0410 2026-02-24T19:24:04.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 10 monclient(hunting): my global_id is 26534 2026-02-24T19:24:04.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.677+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14081655c0 con 0x7f14080b0410 2026-02-24T19:24:04.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2400141258 0 0) 0x7f13f4003610 con 0x7f1408058da0 2026-02-24T19:24:04.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 >> v1:10.20.193.179:6789/0 conn(0x7f14080b0410 legacy=0x7f1408164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 >> v1:10.20.193.45:6789/0 conn(0x7f14081626a0 legacy=0x7f14081c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 1 monclient: found mon.noname-b 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14080b1870 con 0x7f1408058da0 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13f8002df0 con 0x7f1408058da0 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:04.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f13ff7fe640 10 monclient: dump: 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f140eda2640 5 monclient: authenticate success, global_id 28060 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.678+0000 7f140eda2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13f8002fc0 con 0x7f1408058da0 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f13ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f13ff7fe640 1 -- 10.20.193.45:0/37269426 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13f8003400 con 0x7f1408058da0 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f13ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f13ff7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f13ff7fe640 10 monclient: dump: 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.692 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f140eda2640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f140eda2640 4 set_mon_vals no callback set 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f140eda2640 10 monclient: shutdown 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f140eda2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f140eda2640 1 -- 10.20.193.45:0/37269426 >> v1:10.20.193.114:6789/0 conn(0x7f1408058da0 legacy=0x7f14081647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f140eda2640 1 -- 10.20.193.45:0/37269426 shutdown_connections 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f140eda2640 1 -- 10.20.193.45:0/37269426 >> 10.20.193.45:0/37269426 conn(0x7f14080b65f0 msgr2=0x7f14080b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:04.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f140eda2640 1 -- 10.20.193.45:0/37269426 shutdown_connections 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.679+0000 7f140eda2640 1 -- 10.20.193.45:0/37269426 wait complete. 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 10 monclient: build_initial_monmap 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 10 monclient: monmap: 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:04.694 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 1 librados: starting msgr at 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 1 librados: starting objecter 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 1 Processor -- start 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 1 -- start start 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 1 librados: setting wanted keys 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 1 librados: calling monclient init 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.680+0000 7f140eda2640 10 monclient: init 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 10 monclient(hunting): picked mon.noname-c con 0x7f1408058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:04.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 10 monclient(hunting): picked mon.noname-a con 0x7f14080b0410 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 10 monclient(hunting): picked mon.noname-b con 0x7f14081626a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f140813aeb0 con 0x7f14080b0410 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f140805ba00 con 0x7f14081626a0 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f140805bce0 con 0x7f1408058da0 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f140eda2640 10 monclient(hunting): authenticate will time out at 4016.320149s 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f13fffff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f14080b0410 0x7f14081fb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45666/0 (socket says 10.20.193.45:45666) 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f13fffff640 1 -- 10.20.193.45:0/2377526430 learned_addr learned my addr 10.20.193.45:0/2377526430 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f13fd7fa640 10 client.?.objecter ms_handle_connect 0x7f14080b0410 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f13fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f13fd7fa640 10 client.?.objecter ms_handle_connect 0x7f14081626a0 2026-02-24T19:24:04.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f13fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f13fd7fa640 10 client.?.objecter ms_handle_connect 0x7f1408058da0 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.681+0000 7f13fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2265074669 0 0) 0x7f140805ba00 con 0x7f14081626a0 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): my global_id is 28063 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d8003610 con 0x7f14081626a0 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2104205525 0 0) 0x7f140813aeb0 con 0x7f14080b0410 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): my global_id is 30594 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f140805ba00 con 0x7f14080b0410 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131089938 0 0) 0x7f140805bce0 con 0x7f1408058da0 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 10 monclient(hunting): my global_id is 26537 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.682+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f140813aeb0 con 0x7f1408058da0 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4128788010 0 0) 0x7f140805ba00 con 0x7f14080b0410 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f140805bce0 con 0x7f14080b0410 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13f0003170 con 0x7f14080b0410 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:04.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2144233233 0 0) 0x7f13d8003610 con 0x7f14081626a0 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f140805ba00 con 0x7f14081626a0 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f14040032f0 con 0x7f14081626a0 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.700 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1683345397 0 0) 0x7f140813aeb0 con 0x7f1408058da0 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13d8003610 con 0x7f1408058da0 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13f8003310 con 0x7f1408058da0 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.685+0000 7f13fd7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.701 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.702 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.702 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.702 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.702 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.702 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.702 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.702 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.686+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 573073460 0 0) 0x7f13d8003610 con 0x7f1408058da0 2026-02-24T19:24:04.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 >> v1:10.20.193.114:6789/0 conn(0x7f14081626a0 legacy=0x7f140813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 >> v1:10.20.193.45:6789/0 conn(0x7f14080b0410 legacy=0x7f14081fb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:04.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 1 monclient: found mon.c 2026-02-24T19:24:04.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:04.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:04.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140805bfc0 con 0x7f1408058da0 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f13fd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 5 monclient: authenticate success, global_id 26537 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 10 monclient: _renew_subs 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f140805c2a0 con 0x7f1408058da0 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 10 client.26537.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 10 monclient: _renew_subs 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f140805c860 con 0x7f1408058da0 2026-02-24T19:24:04.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 1 librados: init done 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.687+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14080b6ca0 con 0x7f1408058da0 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.692+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13f8002f70 con 0x7f1408058da0 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.692+0000 7f13fd7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.692+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13f8004b80 con 0x7f1408058da0 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.692+0000 7f13fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.692+0000 7f13fd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.692+0000 7f13fd7fa640 10 monclient: dump: 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.707 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.692+0000 7f13feffd640 4 set_mon_vals no callback set 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.696+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f13f801d850 con 0x7f1408058da0 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.696+0000 7f13fffff640 10 monclient: get_auth_request con 0x7f13d8077e50 auth_method 0 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.696+0000 7f13fd7fa640 10 client.26537.objecter ms_handle_connect 0x7f13d8077e50 2026-02-24T19:24:04.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.696+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f13f8092fb0 con 0x7f1408058da0 2026-02-24T19:24:04.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.696+0000 7f13fd7fa640 10 client.26537.objecter ms_dispatch2 0x7f1408000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:04.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.696+0000 7f13fd7fa640 3 client.26537.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:04.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.696+0000 7f13fd7fa640 3 client.26537.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:04.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.696+0000 7f13fd7fa640 20 client.26537.objecter dump_active .. 0 homeless 2026-02-24T19:24:04.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.781+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f13f805d9e0 con 0x7f1408058da0 2026-02-24T19:24:04.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.781+0000 7f13fd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:04.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.781+0000 7f13fd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:04.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.885+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14081fbaf0 con 0x7f13d8077e50 2026-02-24T19:24:04.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.887+0000 7f13fd7fa640 1 -- 10.20.193.45:0/2377526430 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125399 (unknown 2965378022 0 4190562200) 0x7f13f00078d0 con 0x7f13d8077e50 2026-02-24T19:24:04.891 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:24:04.892 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-24T19:24:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 10 librados: watch_flush enter 2026-02-24T19:24:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 10 librados: watch_flush exit 2026-02-24T19:24:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 20 client.26537.objecter shutdown clearing up homeless session... 2026-02-24T19:24:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 10 client.26537.objecter successfully canceled tick 2026-02-24T19:24:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 >> v1:10.20.193.45:6800/1599977652 conn(0x7f13d8077e50 legacy=0x7f13d8098300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 10 monclient: shutdown 2026-02-24T19:24:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:04.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 >> v1:10.20.193.179:6789/0 conn(0x7f1408058da0 legacy=0x7f14081fc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 shutdown_connections 2026-02-24T19:24:04.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 >> 10.20.193.45:0/2377526430 conn(0x7f14080b65f0 msgr2=0x7f1408059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:04.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 shutdown_connections 2026-02-24T19:24:04.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 1 -- 10.20.193.45:0/2377526430 wait complete. 2026-02-24T19:24:04.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.888+0000 7f140eda2640 1 librados: shutdown 2026-02-24T19:24:04.900 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2026-02-24T19:24:04.083806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":540384,"kb_used_data":109024,"kb_used_omap":25300,"kb_used_meta":405803,"kb_avail":1509409056,"statfs":{"total":1546188226560,"available":1545634873344,"internally_reserved":0,"allocated":111640576,"data_stored":69001183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25907859,"internal_metadata":415542637},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046700"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.685829+0000","last_change":"2026-02-24T19:18:30.040599+0000","last_active":"2026-02-24T19:23:59.685829+0000","last_peered":"2026-02-24T19:23:59.685829+0000","last_clean":"2026-02-24T19:23:59.685829+0000","last_became_active":"2026-02-24T19:18:30.038497+0000","last_became_peered":"2026-02-24T19:18:30.038497+0000","last_unstale":"2026-02-24T19:23:59.685829+0000","last_undegraded":"2026-02-24T19:23:59.685829+0000","last_fullsized":"2026-02-24T19:23:59.685829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:10:09.004482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":617,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.319916+0000","last_change":"2026-02-24T19:18:28.471116+0000","last_active":"2026-02-24T19:23:58.319916+0000","last_peered":"2026-02-24T19:23:58.319916+0000","last_clean":"2026-02-24T19:23:58.319916+0000","last_became_active":"2026-02-24T19:18:28.441755+0000","last_became_peered":"2026-02-24T19:18:28.441755+0000","last_unstale":"2026-02-24T19:23:58.319916+0000","last_undegraded":"2026-02-24T19:23:58.319916+0000","last_fullsized":"2026-02-24T19:23:58.319916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:31:02.204366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.380594+0000","last_change":"2026-02-24T19:18:28.672244+0000","last_active":"2026-02-24T19:23:59.380594+0000","last_peered":"2026-02-24T19:23:59.380594+0000","last_clean":"2026-02-24T19:23:59.380594+0000","last_became_active":"2026-02-24T19:18:28.670036+0000","last_became_peered":"2026-02-24T19:18:28.670036+0000","last_unstale":"2026-02-24T19:23:59.380594+0000","last_undegraded":"2026-02-24T19:23:59.380594+0000","last_fullsized":"2026-02-24T19:23:59.380594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:13:54.603079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329086+0000","last_change":"2026-02-24T19:18:29.299593+0000","last_active":"2026-02-24T19:23:58.329086+0000","last_peered":"2026-02-24T19:23:58.329086+0000","last_clean":"2026-02-24T19:23:58.329086+0000","last_became_active":"2026-02-24T19:18:29.297442+0000","last_became_peered":"2026-02-24T19:18:29.297442+0000","last_unstale":"2026-02-24T19:23:58.329086+0000","last_undegraded":"2026-02-24T19:23:58.329086+0000","last_fullsized":"2026-02-24T19:23:58.329086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:27:15.018443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.675209+0000","last_change":"2026-02-24T19:18:29.545106+0000","last_active":"2026-02-24T19:23:59.675209+0000","last_peered":"2026-02-24T19:23:59.675209+0000","last_clean":"2026-02-24T19:23:59.675209+0000","last_became_active":"2026-02-24T19:18:29.539772+0000","last_became_peered":"2026-02-24T19:18:29.539772+0000","last_unstale":"2026-02-24T19:23:59.675209+0000","last_undegraded":"2026-02-24T19:23:59.675209+0000","last_fullsized":"2026-02-24T19:23:59.675209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:13:08.139044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.674742+0000","last_change":"2026-02-24T19:18:28.594138+0000","last_active":"2026-02-24T19:23:59.674742+0000","last_peered":"2026-02-24T19:23:59.674742+0000","last_clean":"2026-02-24T19:23:59.674742+0000","last_became_active":"2026-02-24T19:18:28.575721+0000","last_became_peered":"2026-02-24T19:18:28.575721+0000","last_unstale":"2026-02-24T19:23:59.674742+0000","last_undegraded":"2026-02-24T19:23:59.674742+0000","last_fullsized":"2026-02-24T19:23:59.674742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:15:36.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329395+0000","last_change":"2026-02-24T19:18:28.208160+0000","last_active":"2026-02-24T19:23:58.329395+0000","last_peered":"2026-02-24T19:23:58.329395+0000","last_clean":"2026-02-24T19:23:58.329395+0000","last_became_active":"2026-02-24T19:18:28.189388+0000","last_became_peered":"2026-02-24T19:18:28.189388+0000","last_unstale":"2026-02-24T19:23:58.329395+0000","last_undegraded":"2026-02-24T19:23:58.329395+0000","last_fullsized":"2026-02-24T19:23:58.329395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:38:11.940782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":623,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:03.131587+0000","last_change":"2026-02-24T19:18:30.249532+0000","last_active":"2026-02-24T19:24:03.131587+0000","last_peered":"2026-02-24T19:24:03.131587+0000","last_clean":"2026-02-24T19:24:03.131587+0000","last_became_active":"2026-02-24T19:18:30.247456+0000","last_became_peered":"2026-02-24T19:18:30.247456+0000","last_unstale":"2026-02-24T19:24:03.131587+0000","last_undegraded":"2026-02-24T19:24:03.131587+0000","last_fullsized":"2026-02-24T19:24:03.131587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:38:54.762951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.321970+0000","last_change":"2026-02-24T19:18:29.118353+0000","last_active":"2026-02-24T19:23:58.321970+0000","last_peered":"2026-02-24T19:23:58.321970+0000","last_clean":"2026-02-24T19:23:58.321970+0000","last_became_active":"2026-02-24T19:18:29.115400+0000","last_became_peered":"2026-02-24T19:18:29.115400+0000","last_unstale":"2026-02-24T19:23:58.321970+0000","last_undegraded":"2026-02-24T19:23:58.321970+0000","last_fullsized":"2026-02-24T19:23:58.321970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:24:41.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.322740+0000","last_change":"2026-02-24T19:18:28.592539+0000","last_active":"2026-02-24T19:23:58.322740+0000","last_peered":"2026-02-24T19:23:58.322740+0000","last_clean":"2026-02-24T19:23:58.322740+0000","last_became_active":"2026-02-24T19:18:28.565625+0000","last_became_peered":"2026-02-24T19:18:28.565625+0000","last_unstale":"2026-02-24T19:23:58.322740+0000","last_undegraded":"2026-02-24T19:23:58.322740+0000","last_fullsized":"2026-02-24T19:23:58.322740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:42:03.341148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":613,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.285712+0000","last_change":"2026-02-24T19:18:28.631307+0000","last_active":"2026-02-24T19:23:58.285712+0000","last_peered":"2026-02-24T19:23:58.285712+0000","last_clean":"2026-02-24T19:23:58.285712+0000","last_became_active":"2026-02-24T19:18:28.626150+0000","last_became_peered":"2026-02-24T19:18:28.626150+0000","last_unstale":"2026-02-24T19:23:58.285712+0000","last_undegraded":"2026-02-24T19:23:58.285712+0000","last_fullsized":"2026-02-24T19:23:58.285712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:39:37.876703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.679046+0000","last_change":"2026-02-24T19:18:30.388644+0000","last_active":"2026-02-24T19:23:59.679046+0000","last_peered":"2026-02-24T19:23:59.679046+0000","last_clean":"2026-02-24T19:23:59.679046+0000","last_became_active":"2026-02-24T19:18:30.386561+0000","last_became_peered":"2026-02-24T19:18:30.386561+0000","last_unstale":"2026-02-24T19:23:59.679046+0000","last_undegraded":"2026-02-24T19:23:59.679046+0000","last_fullsized":"2026-02-24T19:23:59.679046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:24:18.512374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"25'32","reported_seq":676,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.673915+0000","last_change":"2026-02-24T19:17:41.855813+0000","last_active":"2026-02-24T19:23:59.673915+0000","last_peered":"2026-02-24T19:23:59.673915+0000","last_clean":"2026-02-24T19:23:59.673915+0000","last_became_active":"2026-02-24T19:17:41.834152+0000","last_became_peered":"2026-02-24T19:17:41.834152+0000","last_unstale":"2026-02-24T19:23:59.673915+0000","last_undegraded":"2026-02-24T19:23:59.673915+0000","last_fullsized":"2026-02-24T19:23:59.673915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_clean_scrub_stamp":"2026-02-24T19:17:39.980633+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:41:22.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":633,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.315726+0000","last_change":"2026-02-24T19:17:51.734383+0000","last_active":"2026-02-24T19:23:58.315726+0000","last_peered":"2026-02-24T19:23:58.315726+0000","last_clean":"2026-02-24T19:23:58.315726+0000","last_became_active":"2026-02-24T19:17:49.844588+0000","last_became_peered":"2026-02-24T19:17:49.844588+0000","last_unstale":"2026-02-24T19:23:58.315726+0000","last_undegraded":"2026-02-24T19:23:58.315726+0000","last_fullsized":"2026-02-24T19:23:58.315726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:26:51.919573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039325629000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.679882+0000","last_change":"2026-02-24T19:18:28.881103+0000","last_active":"2026-02-24T19:23:59.679882+0000","last_peered":"2026-02-24T19:23:59.679882+0000","last_clean":"2026-02-24T19:23:59.679882+0000","last_became_active":"2026-02-24T19:18:28.879013+0000","last_became_peered":"2026-02-24T19:18:28.879013+0000","last_unstale":"2026-02-24T19:23:59.679882+0000","last_undegraded":"2026-02-24T19:23:59.679882+0000","last_fullsized":"2026-02-24T19:23:59.679882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:34:10.611706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":631,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.252850+0000","last_change":"2026-02-24T19:17:51.879794+0000","last_active":"2026-02-24T19:23:58.252850+0000","last_peered":"2026-02-24T19:23:58.252850+0000","last_clean":"2026-02-24T19:23:58.252850+0000","last_became_active":"2026-02-24T19:17:49.829989+0000","last_became_peered":"2026-02-24T19:17:49.829989+0000","last_unstale":"2026-02-24T19:23:58.252850+0000","last_undegraded":"2026-02-24T19:23:58.252850+0000","last_fullsized":"2026-02-24T19:23:58.252850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:23:30.666021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032260351999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":617,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.322537+0000","last_change":"2026-02-24T19:18:28.728380+0000","last_active":"2026-02-24T19:23:58.322537+0000","last_peered":"2026-02-24T19:23:58.322537+0000","last_clean":"2026-02-24T19:23:58.322537+0000","last_became_active":"2026-02-24T19:18:28.725927+0000","last_became_peered":"2026-02-24T19:18:28.725927+0000","last_unstale":"2026-02-24T19:23:58.322537+0000","last_undegraded":"2026-02-24T19:23:58.322537+0000","last_fullsized":"2026-02-24T19:23:58.322537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:22:34.338905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":629,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.282851+0000","last_change":"2026-02-24T19:17:51.909002+0000","last_active":"2026-02-24T19:23:58.282851+0000","last_peered":"2026-02-24T19:23:58.282851+0000","last_clean":"2026-02-24T19:23:58.282851+0000","last_became_active":"2026-02-24T19:17:50.962180+0000","last_became_peered":"2026-02-24T19:17:50.962180+0000","last_unstale":"2026-02-24T19:23:58.282851+0000","last_undegraded":"2026-02-24T19:23:58.282851+0000","last_fullsized":"2026-02-24T19:23:58.282851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:55:24.848537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034127616999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,14],"acting":[6,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.692086+0000","last_change":"2026-02-24T19:18:29.244450+0000","last_active":"2026-02-24T19:23:59.692086+0000","last_peered":"2026-02-24T19:23:59.692086+0000","last_clean":"2026-02-24T19:23:59.692086+0000","last_became_active":"2026-02-24T19:18:29.241947+0000","last_became_peered":"2026-02-24T19:18:29.241947+0000","last_unstale":"2026-02-24T19:23:59.692086+0000","last_undegraded":"2026-02-24T19:23:59.692086+0000","last_fullsized":"2026-02-24T19:23:59.692086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:17:14.369011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":634,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.313256+0000","last_change":"2026-02-24T19:17:51.726046+0000","last_active":"2026-02-24T19:23:58.313256+0000","last_peered":"2026-02-24T19:23:58.313256+0000","last_clean":"2026-02-24T19:23:58.313256+0000","last_became_active":"2026-02-24T19:17:49.831395+0000","last_became_peered":"2026-02-24T19:17:49.831395+0000","last_unstale":"2026-02-24T19:23:58.313256+0000","last_undegraded":"2026-02-24T19:23:58.313256+0000","last_fullsized":"2026-02-24T19:23:58.313256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:45:35.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363406999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.322946+0000","last_change":"2026-02-24T19:18:29.174512+0000","last_active":"2026-02-24T19:23:58.322946+0000","last_peered":"2026-02-24T19:23:58.322946+0000","last_clean":"2026-02-24T19:23:58.322946+0000","last_became_active":"2026-02-24T19:18:29.172298+0000","last_became_peered":"2026-02-24T19:18:29.172298+0000","last_unstale":"2026-02-24T19:23:58.322946+0000","last_undegraded":"2026-02-24T19:23:58.322946+0000","last_fullsized":"2026-02-24T19:23:58.322946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:53:31.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15],"acting":[8,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":636,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.400437+0000","last_change":"2026-02-24T19:17:51.889910+0000","last_active":"2026-02-24T19:23:59.400437+0000","last_peered":"2026-02-24T19:23:59.400437+0000","last_clean":"2026-02-24T19:23:59.400437+0000","last_became_active":"2026-02-24T19:17:49.867737+0000","last_became_peered":"2026-02-24T19:17:49.867737+0000","last_unstale":"2026-02-24T19:23:59.400437+0000","last_undegraded":"2026-02-24T19:23:59.400437+0000","last_fullsized":"2026-02-24T19:23:59.400437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:43:43.357779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041050483999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.398466+0000","last_change":"2026-02-24T19:18:29.018360+0000","last_active":"2026-02-24T19:23:59.398466+0000","last_peered":"2026-02-24T19:23:59.398466+0000","last_clean":"2026-02-24T19:23:59.398466+0000","last_became_active":"2026-02-24T19:18:29.015809+0000","last_became_peered":"2026-02-24T19:18:29.015809+0000","last_unstale":"2026-02-24T19:23:59.398466+0000","last_undegraded":"2026-02-24T19:23:59.398466+0000","last_fullsized":"2026-02-24T19:23:59.398466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:52:29.814745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9],"acting":[15,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":636,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.403574+0000","last_change":"2026-02-24T19:17:51.895025+0000","last_active":"2026-02-24T19:23:59.403574+0000","last_peered":"2026-02-24T19:23:59.403574+0000","last_clean":"2026-02-24T19:23:59.403574+0000","last_became_active":"2026-02-24T19:17:49.822380+0000","last_became_peered":"2026-02-24T19:17:49.822380+0000","last_unstale":"2026-02-24T19:23:59.403574+0000","last_undegraded":"2026-02-24T19:23:59.403574+0000","last_fullsized":"2026-02-24T19:23:59.403574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:22:04.516051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031009920999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.676619+0000","last_change":"2026-02-24T19:18:28.599982+0000","last_active":"2026-02-24T19:23:59.676619+0000","last_peered":"2026-02-24T19:23:59.676619+0000","last_clean":"2026-02-24T19:23:59.676619+0000","last_became_active":"2026-02-24T19:18:28.578714+0000","last_became_peered":"2026-02-24T19:18:28.578714+0000","last_unstale":"2026-02-24T19:23:59.676619+0000","last_undegraded":"2026-02-24T19:23:59.676619+0000","last_fullsized":"2026-02-24T19:23:59.676619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:11:52.417883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":635,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.315985+0000","last_change":"2026-02-24T19:17:51.929779+0000","last_active":"2026-02-24T19:23:59.315985+0000","last_peered":"2026-02-24T19:23:59.315985+0000","last_clean":"2026-02-24T19:23:59.315985+0000","last_became_active":"2026-02-24T19:17:49.636104+0000","last_became_peered":"2026-02-24T19:17:49.636104+0000","last_unstale":"2026-02-24T19:23:59.315985+0000","last_undegraded":"2026-02-24T19:23:59.315985+0000","last_fullsized":"2026-02-24T19:23:59.315985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:53:57.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036145872000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":615,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.254381+0000","last_change":"2026-02-24T19:18:28.651861+0000","last_active":"2026-02-24T19:23:58.254381+0000","last_peered":"2026-02-24T19:23:58.254381+0000","last_clean":"2026-02-24T19:23:58.254381+0000","last_became_active":"2026-02-24T19:18:28.629954+0000","last_became_peered":"2026-02-24T19:18:28.629954+0000","last_unstale":"2026-02-24T19:23:58.254381+0000","last_undegraded":"2026-02-24T19:23:58.254381+0000","last_fullsized":"2026-02-24T19:23:58.254381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:13:40.801862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":632,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.321137+0000","last_change":"2026-02-24T19:17:51.735983+0000","last_active":"2026-02-24T19:23:58.321137+0000","last_peered":"2026-02-24T19:23:58.321137+0000","last_clean":"2026-02-24T19:23:58.321137+0000","last_became_active":"2026-02-24T19:17:49.848509+0000","last_became_peered":"2026-02-24T19:17:49.848509+0000","last_unstale":"2026-02-24T19:23:58.321137+0000","last_undegraded":"2026-02-24T19:23:58.321137+0000","last_fullsized":"2026-02-24T19:23:58.321137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:59:49.327706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032515259999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.306622+0000","last_change":"2026-02-24T19:18:29.182530+0000","last_active":"2026-02-24T19:23:59.306622+0000","last_peered":"2026-02-24T19:23:59.306622+0000","last_clean":"2026-02-24T19:23:59.306622+0000","last_became_active":"2026-02-24T19:18:29.176942+0000","last_became_peered":"2026-02-24T19:18:29.176942+0000","last_unstale":"2026-02-24T19:23:59.306622+0000","last_undegraded":"2026-02-24T19:23:59.306622+0000","last_fullsized":"2026-02-24T19:23:59.306622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:20:26.047180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,12],"acting":[9,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.389654+0000","last_change":"2026-02-24T19:18:29.901720+0000","last_active":"2026-02-24T19:23:59.389654+0000","last_peered":"2026-02-24T19:23:59.389654+0000","last_clean":"2026-02-24T19:23:59.389654+0000","last_became_active":"2026-02-24T19:18:29.899492+0000","last_became_peered":"2026-02-24T19:18:29.899492+0000","last_unstale":"2026-02-24T19:23:59.389654+0000","last_undegraded":"2026-02-24T19:23:59.389654+0000","last_fullsized":"2026-02-24T19:23:59.389654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:46:01.639570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14],"acting":[13,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.391170+0000","last_change":"2026-02-24T19:18:28.454346+0000","last_active":"2026-02-24T19:23:59.391170+0000","last_peered":"2026-02-24T19:23:59.391170+0000","last_clean":"2026-02-24T19:23:59.391170+0000","last_became_active":"2026-02-24T19:18:28.448515+0000","last_became_peered":"2026-02-24T19:18:28.448515+0000","last_unstale":"2026-02-24T19:23:59.391170+0000","last_undegraded":"2026-02-24T19:23:59.391170+0000","last_fullsized":"2026-02-24T19:23:59.391170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:54.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":614,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.329506+0000","last_change":"2026-02-24T19:18:28.813537+0000","last_active":"2026-02-24T19:23:59.329506+0000","last_peered":"2026-02-24T19:23:59.329506+0000","last_clean":"2026-02-24T19:23:59.329506+0000","last_became_active":"2026-02-24T19:18:28.805888+0000","last_became_peered":"2026-02-24T19:18:28.805888+0000","last_unstale":"2026-02-24T19:23:59.329506+0000","last_undegraded":"2026-02-24T19:23:59.329506+0000","last_fullsized":"2026-02-24T19:23:59.329506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:21:32.488493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1","version":"33'11","reported_seq":643,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.312144+0000","last_change":"2026-02-24T19:18:28.660457+0000","last_active":"2026-02-24T19:23:58.312144+0000","last_peered":"2026-02-24T19:23:58.312144+0000","last_clean":"2026-02-24T19:23:58.312144+0000","last_became_active":"2026-02-24T19:18:28.658257+0000","last_became_peered":"2026-02-24T19:18:28.658257+0000","last_unstale":"2026-02-24T19:23:58.312144+0000","last_undegraded":"2026-02-24T19:23:58.312144+0000","last_fullsized":"2026-02-24T19:23:58.312144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:56:37.770223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":618,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329992+0000","last_change":"2026-02-24T19:18:28.336280+0000","last_active":"2026-02-24T19:23:58.329992+0000","last_peered":"2026-02-24T19:23:58.329992+0000","last_clean":"2026-02-24T19:23:58.329992+0000","last_became_active":"2026-02-24T19:18:28.334029+0000","last_became_peered":"2026-02-24T19:18:28.334029+0000","last_unstale":"2026-02-24T19:23:58.329992+0000","last_undegraded":"2026-02-24T19:23:58.329992+0000","last_fullsized":"2026-02-24T19:23:58.329992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:54:32.836654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329780+0000","last_change":"2026-02-24T19:18:28.729903+0000","last_active":"2026-02-24T19:23:58.329780+0000","last_peered":"2026-02-24T19:23:58.329780+0000","last_clean":"2026-02-24T19:23:58.329780+0000","last_became_active":"2026-02-24T19:18:28.727493+0000","last_became_peered":"2026-02-24T19:18:28.727493+0000","last_unstale":"2026-02-24T19:23:58.329780+0000","last_undegraded":"2026-02-24T19:23:58.329780+0000","last_fullsized":"2026-02-24T19:23:58.329780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:30:30.028759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.323713+0000","last_change":"2026-02-24T19:18:29.352492+0000","last_active":"2026-02-24T19:23:58.323713+0000","last_peered":"2026-02-24T19:23:58.323713+0000","last_clean":"2026-02-24T19:23:58.323713+0000","last_became_active":"2026-02-24T19:18:29.350423+0000","last_became_peered":"2026-02-24T19:18:29.350423+0000","last_unstale":"2026-02-24T19:23:58.323713+0000","last_undegraded":"2026-02-24T19:23:58.323713+0000","last_fullsized":"2026-02-24T19:23:58.323713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:16:25.791348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.676171+0000","last_change":"2026-02-24T19:18:29.505834+0000","last_active":"2026-02-24T19:23:59.676171+0000","last_peered":"2026-02-24T19:23:59.676171+0000","last_clean":"2026-02-24T19:23:59.676171+0000","last_became_active":"2026-02-24T19:18:29.503545+0000","last_became_peered":"2026-02-24T19:18:29.503545+0000","last_unstale":"2026-02-24T19:23:59.676171+0000","last_undegraded":"2026-02-24T19:23:59.676171+0000","last_fullsized":"2026-02-24T19:23:59.676171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:38:03.828269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.677349+0000","last_change":"2026-02-24T19:18:28.360041+0000","last_active":"2026-02-24T19:23:59.677349+0000","last_peered":"2026-02-24T19:23:59.677349+0000","last_clean":"2026-02-24T19:23:59.677349+0000","last_became_active":"2026-02-24T19:18:28.357637+0000","last_became_peered":"2026-02-24T19:18:28.357637+0000","last_unstale":"2026-02-24T19:23:59.677349+0000","last_undegraded":"2026-02-24T19:23:59.677349+0000","last_fullsized":"2026-02-24T19:23:59.677349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:35:29.378705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.677601+0000","last_change":"2026-02-24T19:18:30.010817+0000","last_active":"2026-02-24T19:23:59.677601+0000","last_peered":"2026-02-24T19:23:59.677601+0000","last_clean":"2026-02-24T19:23:59.677601+0000","last_became_active":"2026-02-24T19:18:30.008609+0000","last_became_peered":"2026-02-24T19:18:30.008609+0000","last_unstale":"2026-02-24T19:23:59.677601+0000","last_undegraded":"2026-02-24T19:23:59.677601+0000","last_fullsized":"2026-02-24T19:23:59.677601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:45:00.289172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.321788+0000","last_change":"2026-02-24T19:18:29.239229+0000","last_active":"2026-02-24T19:23:58.321788+0000","last_peered":"2026-02-24T19:23:58.321788+0000","last_clean":"2026-02-24T19:23:58.321788+0000","last_became_active":"2026-02-24T19:18:29.237008+0000","last_became_peered":"2026-02-24T19:18:29.237008+0000","last_unstale":"2026-02-24T19:23:58.321788+0000","last_undegraded":"2026-02-24T19:23:58.321788+0000","last_fullsized":"2026-02-24T19:23:58.321788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:19:19.633721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":623,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:03.130699+0000","last_change":"2026-02-24T19:18:28.794132+0000","last_active":"2026-02-24T19:24:03.130699+0000","last_peered":"2026-02-24T19:24:03.130699+0000","last_clean":"2026-02-24T19:24:03.130699+0000","last_became_active":"2026-02-24T19:18:28.791994+0000","last_became_peered":"2026-02-24T19:18:28.791994+0000","last_unstale":"2026-02-24T19:24:03.130699+0000","last_undegraded":"2026-02-24T19:24:03.130699+0000","last_fullsized":"2026-02-24T19:24:03.130699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:37:30.793100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":864256,"data_stored":857120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280590,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6772,"kb_used_omap":3010,"kb_used_meta":23933,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6934528,"data_stored":4264433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3082938,"internal_metadata":24507718},"hb_peers":[0,2,3,4,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313294,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210814,"internal_metadata":27379842},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280591,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":211429,"internal_metadata":27379227},"hb_peers":[1,3,5,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33716,"kb_used_data":6756,"kb_used_omap":3011,"kb_used_meta":23932,"kb_avail":94338124,"statfs":{"total":96636764160,"available":96602238976,"internally_reserved":0,"allocated":6918144,"data_stored":4258324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3084121,"internal_metadata":24506535},"hb_peers":[1,2,3,4,5,6,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313294,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210351,"internal_metadata":27380305},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33780,"kb_used_data":6820,"kb_used_omap":110,"kb_used_meta":26833,"kb_avail":94338060,"statfs":{"total":96636764160,"available":96602173440,"internally_reserved":0,"allocated":6983680,"data_stored":4295884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113659,"internal_metadata":27476997},"hb_peers":[0,1,3,4,5,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208968,"internal_metadata":27381688},"hb_peers":[0,1,3,4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3084465,"internal_metadata":24506191},"hb_peers":[1,2,3,4,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33720,"kb_used_data":6760,"kb_used_omap":207,"kb_used_meta":26736,"kb_avail":94338120,"statfs":{"total":96636764160,"available":96602234880,"internally_reserved":0,"allocated":6922240,"data_stored":4254252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":212730,"internal_metadata":27377926},"hb_peers":[0,1,4,5,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":2920,"kb_used_meta":24023,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2990703,"internal_metadata":24599953},"hb_peers":[0,1,3,4,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313294,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33716,"kb_used_data":6756,"kb_used_omap":173,"kb_used_meta":26770,"kb_avail":94338124,"statfs":{"total":96636764160,"available":96602238976,"internally_reserved":0,"allocated":6918144,"data_stored":4254233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":177224,"internal_metadata":27413432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6772,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6934528,"data_stored":4264433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":211067,"internal_metadata":27379589},"hb_peers":[1,2,3,4,5,6,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313294,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34104,"kb_used_data":7144,"kb_used_omap":2877,"kb_used_meta":24066,"kb_avail":94337736,"statfs":{"total":96636764160,"available":96601841664,"internally_reserved":0,"allocated":7315456,"data_stored":4652068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2946222,"internal_metadata":24644434},"hb_peers":[0,2,3,4,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34184,"kb_used_data":7224,"kb_used_omap":5765,"kb_used_meta":21178,"kb_avail":94337656,"statfs":{"total":96636764160,"available":96601759744,"internally_reserved":0,"allocated":7397376,"data_stored":4723713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5904083,"internal_metadata":21686573},"hb_peers":[0,1,2,4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313294,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":167,"kb_used_meta":26776,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":172019,"internal_metadata":27418637},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280591,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33716,"kb_used_data":6756,"kb_used_omap":3014,"kb_used_meta":23929,"kb_avail":94338124,"statfs":{"total":96636764160,"available":96602238976,"internally_reserved":0,"allocated":6918144,"data_stored":4254247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087066,"internal_metadata":24503590},"hb_peers":[1,2,3,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:04.904 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:04.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.968+0000 7fe3bec13640 10 monclient: get_monmap_and_config 2026-02-24T19:24:04.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.968+0000 7fe3bec13640 10 monclient: build_initial_monmap 2026-02-24T19:24:04.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.968+0000 7fe3bec13640 10 monclient: monmap: 2026-02-24T19:24:04.972 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:04.972 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.972 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:04.969154+0000 2026-02-24T19:24:04.972 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:04.969154+0000 2026-02-24T19:24:04.972 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:04.972 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.973 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:04.973 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:04.973 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:04.973 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.968+0000 7fe3bec13640 1 Processor -- start 2026-02-24T19:24:04.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.968+0000 7fe3bec13640 1 -- start start 2026-02-24T19:24:04.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.968+0000 7fe3bec13640 10 monclient: init 2026-02-24T19:24:04.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.968+0000 7fe3bec13640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bec13640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bec13640 10 monclient(hunting): picked mon.noname-a con 0x7fe3b8058da0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bec13640 10 monclient(hunting): picked mon.noname-c con 0x7fe3b80b0410 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bec13640 10 monclient(hunting): picked mon.noname-b con 0x7fe3b81626a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bec13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b81655c0 con 0x7fe3b8058da0 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bec13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b80b12b0 con 0x7fe3b81626a0 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bec13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b80b1590 con 0x7fe3b80b0410 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bec13640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bec13640 10 monclient(hunting): authenticate will time out at 4016.608063s 2026-02-24T19:24:04.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bc988640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe3b8058da0 0x7fe3b81647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45672/0 (socket says 10.20.193.45:45672) 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bc988640 1 -- 10.20.193.45:0/1171077020 learned_addr learned my addr 10.20.193.45:0/1171077020 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.969+0000 7fe3bd189640 1 --1- 10.20.193.45:0/1171077020 >> v1:10.20.193.114:6789/0 conn(0x7fe3b81626a0 0x7fe3b81c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34874/0 (socket says 10.20.193.45:34874) 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.970+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 332901570 0 0) 0x7fe3b81655c0 con 0x7fe3b8058da0 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.970+0000 7fe3af7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.970+0000 7fe3af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.970+0000 7fe3af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.970+0000 7fe3af7fe640 10 monclient(hunting): my global_id is 30597 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.970+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a4003610 con 0x7fe3b8058da0 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1667446154 0 0) 0x7fe3b80b12b0 con 0x7fe3b81626a0 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 10 monclient(hunting): my global_id is 28066 2026-02-24T19:24:04.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b81655c0 con 0x7fe3b81626a0 2026-02-24T19:24:04.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734615071 0 0) 0x7fe3b80b1590 con 0x7fe3b80b0410 2026-02-24T19:24:04.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 10 monclient(hunting): my global_id is 26540 2026-02-24T19:24:04.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.971+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b80b12b0 con 0x7fe3b80b0410 2026-02-24T19:24:04.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1414689347 0 0) 0x7fe3a4003610 con 0x7fe3b8058da0 2026-02-24T19:24:04.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 >> v1:10.20.193.179:6789/0 conn(0x7fe3b80b0410 legacy=0x7fe3b8164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 >> v1:10.20.193.114:6789/0 conn(0x7fe3b81626a0 legacy=0x7fe3b81c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 1 monclient: found mon.noname-a 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b80b1870 con 0x7fe3b8058da0 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3bec13640 5 monclient: authenticate success, global_id 30597 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3bec13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe3a8002df0 con 0x7fe3b8058da0 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:04.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: dump: 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3bec13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3a8002fc0 con 0x7fe3b8058da0 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 1 -- 10.20.193.45:0/1171077020 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe3a8003400 con 0x7fe3b8058da0 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3af7fe640 10 monclient: dump: 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.988 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3bec13640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.973+0000 7fe3bec13640 4 set_mon_vals no callback set 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 10 monclient: shutdown 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 -- 10.20.193.45:0/1171077020 >> v1:10.20.193.45:6789/0 conn(0x7fe3b8058da0 legacy=0x7fe3b81647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 -- 10.20.193.45:0/1171077020 shutdown_connections 2026-02-24T19:24:04.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 -- 10.20.193.45:0/1171077020 >> 10.20.193.45:0/1171077020 conn(0x7fe3b80b65f0 msgr2=0x7fe3b80b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 -- 10.20.193.45:0/1171077020 shutdown_connections 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 -- 10.20.193.45:0/1171077020 wait complete. 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 10 monclient: build_initial_monmap 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 10 monclient: monmap: 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:04.990 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 librados: starting msgr at 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 librados: starting objecter 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 Processor -- start 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 -- start start 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 librados: setting wanted keys 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 1 librados: calling monclient init 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.974+0000 7fe3bec13640 10 monclient: init 2026-02-24T19:24:04.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 10 monclient(hunting): picked mon.noname-a con 0x7fe3b8058da0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 10 monclient(hunting): picked mon.noname-c con 0x7fe3b80b0410 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 10 monclient(hunting): picked mon.noname-b con 0x7fe3b81626a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b813dd10 con 0x7fe3b8058da0 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b81fb3a0 con 0x7fe3b81626a0 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b81fb680 con 0x7fe3b80b0410 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bec13640 10 monclient(hunting): authenticate will time out at 4016.614436s 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bc988640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe3b8058da0 0x7fe3b813d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45678/0 (socket says 10.20.193.45:45678) 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.975+0000 7fe3bc988640 1 -- 10.20.193.45:0/979781146 learned_addr learned my addr 10.20.193.45:0/979781146 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.976+0000 7fe3ad7fa640 10 client.?.objecter ms_handle_connect 0x7fe3b8058da0 2026-02-24T19:24:04.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.976+0000 7fe3ad7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.976+0000 7fe3ad7fa640 10 client.?.objecter ms_handle_connect 0x7fe3b80b0410 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.976+0000 7fe3ad7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.976+0000 7fe3ad7fa640 10 client.?.objecter ms_handle_connect 0x7fe3b81626a0 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.976+0000 7fe3ad7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559205482 0 0) 0x7fe3b813dd10 con 0x7fe3b8058da0 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): my global_id is 30600 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe388003610 con 0x7fe3b8058da0 2026-02-24T19:24:04.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236117643 0 0) 0x7fe3b81fb680 con 0x7fe3b80b0410 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): my global_id is 26543 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b813dd10 con 0x7fe3b80b0410 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773587932 0 0) 0x7fe3b81fb3a0 con 0x7fe3b81626a0 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 10 monclient(hunting): my global_id is 28069 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.977+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b81fb680 con 0x7fe3b81626a0 2026-02-24T19:24:04.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1502693351 0 0) 0x7fe3b813dd10 con 0x7fe3b80b0410 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3b81fb3a0 con 0x7fe3b80b0410 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe3a0003060 con 0x7fe3b80b0410 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.995 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 431691567 0 0) 0x7fe388003610 con 0x7fe3b8058da0 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3b813dd10 con 0x7fe3b8058da0 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe3a8003310 con 0x7fe3b8058da0 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.979+0000 7fe3ad7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.996 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.980+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 309338240 0 0) 0x7fe3b81fb680 con 0x7fe3b81626a0 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.980+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe388003610 con 0x7fe3b81626a0 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.980+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe3b4003370 con 0x7fe3b81626a0 2026-02-24T19:24:04.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.980+0000 7fe3ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.980+0000 7fe3ad7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.980+0000 7fe3ad7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:04.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4209328536 0 0) 0x7fe3b81fb3a0 con 0x7fe3b80b0410 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 >> v1:10.20.193.114:6789/0 conn(0x7fe3b81626a0 legacy=0x7fe3b815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 >> v1:10.20.193.45:6789/0 conn(0x7fe3b8058da0 legacy=0x7fe3b813d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 1 monclient: found mon.c 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b81fb960 con 0x7fe3b80b0410 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 5 monclient: authenticate success, global_id 26543 2026-02-24T19:24:04.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 10 monclient: _renew_subs 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b81fbc40 con 0x7fe3b80b0410 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 10 client.26543.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 10 monclient: _renew_subs 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3b81fb0c0 con 0x7fe3b80b0410 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 1 librados: init done 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:05.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:04.981+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b8163ca0 con 0x7fe3b80b0410 2026-02-24T19:24:05.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3a0003200 con 0x7fe3b80b0410 2026-02-24T19:24:05.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3ad7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:05.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe3a0003920 con 0x7fe3b80b0410 2026-02-24T19:24:05.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:05.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3ad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:05.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3aeffd640 4 set_mon_vals no callback set 2026-02-24T19:24:05.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3ad7fa640 10 monclient: dump: 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.075 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fe3a001c790 con 0x7fe3b80b0410 2026-02-24T19:24:05.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3bc988640 10 monclient: get_auth_request con 0x7fe388077e20 auth_method 0 2026-02-24T19:24:05.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.071+0000 7fe3ad7fa640 10 client.26543.objecter ms_handle_connect 0x7fe388077e20 2026-02-24T19:24:05.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.072+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fe3a0091fb0 con 0x7fe3b80b0410 2026-02-24T19:24:05.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.072+0000 7fe3ad7fa640 10 client.26543.objecter ms_dispatch2 0x7fe3b8000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:05.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.072+0000 7fe3ad7fa640 3 client.26543.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:05.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.072+0000 7fe3ad7fa640 3 client.26543.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:05.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.072+0000 7fe3ad7fa640 20 client.26543.objecter dump_active .. 0 homeless 2026-02-24T19:24:05.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.074+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe3a005c9e0 con 0x7fe3b80b0410 2026-02-24T19:24:05.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.074+0000 7fe3ad7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:05.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.074+0000 7fe3ad7fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:05.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.181+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3b813f130 con 0x7fe388077e20 2026-02-24T19:24:05.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.181+0000 7fe3ad7fa640 1 -- 10.20.193.45:0/979781146 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125399 (unknown 2965378022 0 4190562200) 0x7fe3b813f130 con 0x7fe388077e20 2026-02-24T19:24:05.185 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:24:05.186 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-24T19:24:05.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 10 librados: watch_flush enter 2026-02-24T19:24:05.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 10 librados: watch_flush exit 2026-02-24T19:24:05.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 20 client.26543.objecter shutdown clearing up homeless session... 2026-02-24T19:24:05.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 10 client.26543.objecter successfully canceled tick 2026-02-24T19:24:05.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 >> v1:10.20.193.45:6800/1599977652 conn(0x7fe388077e20 legacy=0x7fe3880982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 10 monclient: shutdown 2026-02-24T19:24:05.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:05.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 >> v1:10.20.193.179:6789/0 conn(0x7fe3b80b0410 legacy=0x7fe3b813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 shutdown_connections 2026-02-24T19:24:05.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 >> 10.20.193.45:0/979781146 conn(0x7fe3b80b65f0 msgr2=0x7fe3b805b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:05.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 shutdown_connections 2026-02-24T19:24:05.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 1 -- 10.20.193.45:0/979781146 wait complete. 2026-02-24T19:24:05.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.184+0000 7fe3bec13640 1 librados: shutdown 2026-02-24T19:24:05.195 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2026-02-24T19:24:04.083806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":540384,"kb_used_data":109024,"kb_used_omap":25300,"kb_used_meta":405803,"kb_avail":1509409056,"statfs":{"total":1546188226560,"available":1545634873344,"internally_reserved":0,"allocated":111640576,"data_stored":69001183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25907859,"internal_metadata":415542637},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046700"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.685829+0000","last_change":"2026-02-24T19:18:30.040599+0000","last_active":"2026-02-24T19:23:59.685829+0000","last_peered":"2026-02-24T19:23:59.685829+0000","last_clean":"2026-02-24T19:23:59.685829+0000","last_became_active":"2026-02-24T19:18:30.038497+0000","last_became_peered":"2026-02-24T19:18:30.038497+0000","last_unstale":"2026-02-24T19:23:59.685829+0000","last_undegraded":"2026-02-24T19:23:59.685829+0000","last_fullsized":"2026-02-24T19:23:59.685829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:10:09.004482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":617,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.319916+0000","last_change":"2026-02-24T19:18:28.471116+0000","last_active":"2026-02-24T19:23:58.319916+0000","last_peered":"2026-02-24T19:23:58.319916+0000","last_clean":"2026-02-24T19:23:58.319916+0000","last_became_active":"2026-02-24T19:18:28.441755+0000","last_became_peered":"2026-02-24T19:18:28.441755+0000","last_unstale":"2026-02-24T19:23:58.319916+0000","last_undegraded":"2026-02-24T19:23:58.319916+0000","last_fullsized":"2026-02-24T19:23:58.319916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:31:02.204366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.380594+0000","last_change":"2026-02-24T19:18:28.672244+0000","last_active":"2026-02-24T19:23:59.380594+0000","last_peered":"2026-02-24T19:23:59.380594+0000","last_clean":"2026-02-24T19:23:59.380594+0000","last_became_active":"2026-02-24T19:18:28.670036+0000","last_became_peered":"2026-02-24T19:18:28.670036+0000","last_unstale":"2026-02-24T19:23:59.380594+0000","last_undegraded":"2026-02-24T19:23:59.380594+0000","last_fullsized":"2026-02-24T19:23:59.380594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:13:54.603079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329086+0000","last_change":"2026-02-24T19:18:29.299593+0000","last_active":"2026-02-24T19:23:58.329086+0000","last_peered":"2026-02-24T19:23:58.329086+0000","last_clean":"2026-02-24T19:23:58.329086+0000","last_became_active":"2026-02-24T19:18:29.297442+0000","last_became_peered":"2026-02-24T19:18:29.297442+0000","last_unstale":"2026-02-24T19:23:58.329086+0000","last_undegraded":"2026-02-24T19:23:58.329086+0000","last_fullsized":"2026-02-24T19:23:58.329086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:27:15.018443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.675209+0000","last_change":"2026-02-24T19:18:29.545106+0000","last_active":"2026-02-24T19:23:59.675209+0000","last_peered":"2026-02-24T19:23:59.675209+0000","last_clean":"2026-02-24T19:23:59.675209+0000","last_became_active":"2026-02-24T19:18:29.539772+0000","last_became_peered":"2026-02-24T19:18:29.539772+0000","last_unstale":"2026-02-24T19:23:59.675209+0000","last_undegraded":"2026-02-24T19:23:59.675209+0000","last_fullsized":"2026-02-24T19:23:59.675209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:13:08.139044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.674742+0000","last_change":"2026-02-24T19:18:28.594138+0000","last_active":"2026-02-24T19:23:59.674742+0000","last_peered":"2026-02-24T19:23:59.674742+0000","last_clean":"2026-02-24T19:23:59.674742+0000","last_became_active":"2026-02-24T19:18:28.575721+0000","last_became_peered":"2026-02-24T19:18:28.575721+0000","last_unstale":"2026-02-24T19:23:59.674742+0000","last_undegraded":"2026-02-24T19:23:59.674742+0000","last_fullsized":"2026-02-24T19:23:59.674742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:15:36.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329395+0000","last_change":"2026-02-24T19:18:28.208160+0000","last_active":"2026-02-24T19:23:58.329395+0000","last_peered":"2026-02-24T19:23:58.329395+0000","last_clean":"2026-02-24T19:23:58.329395+0000","last_became_active":"2026-02-24T19:18:28.189388+0000","last_became_peered":"2026-02-24T19:18:28.189388+0000","last_unstale":"2026-02-24T19:23:58.329395+0000","last_undegraded":"2026-02-24T19:23:58.329395+0000","last_fullsized":"2026-02-24T19:23:58.329395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:38:11.940782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":623,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:03.131587+0000","last_change":"2026-02-24T19:18:30.249532+0000","last_active":"2026-02-24T19:24:03.131587+0000","last_peered":"2026-02-24T19:24:03.131587+0000","last_clean":"2026-02-24T19:24:03.131587+0000","last_became_active":"2026-02-24T19:18:30.247456+0000","last_became_peered":"2026-02-24T19:18:30.247456+0000","last_unstale":"2026-02-24T19:24:03.131587+0000","last_undegraded":"2026-02-24T19:24:03.131587+0000","last_fullsized":"2026-02-24T19:24:03.131587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:38:54.762951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.321970+0000","last_change":"2026-02-24T19:18:29.118353+0000","last_active":"2026-02-24T19:23:58.321970+0000","last_peered":"2026-02-24T19:23:58.321970+0000","last_clean":"2026-02-24T19:23:58.321970+0000","last_became_active":"2026-02-24T19:18:29.115400+0000","last_became_peered":"2026-02-24T19:18:29.115400+0000","last_unstale":"2026-02-24T19:23:58.321970+0000","last_undegraded":"2026-02-24T19:23:58.321970+0000","last_fullsized":"2026-02-24T19:23:58.321970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:24:41.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.322740+0000","last_change":"2026-02-24T19:18:28.592539+0000","last_active":"2026-02-24T19:23:58.322740+0000","last_peered":"2026-02-24T19:23:58.322740+0000","last_clean":"2026-02-24T19:23:58.322740+0000","last_became_active":"2026-02-24T19:18:28.565625+0000","last_became_peered":"2026-02-24T19:18:28.565625+0000","last_unstale":"2026-02-24T19:23:58.322740+0000","last_undegraded":"2026-02-24T19:23:58.322740+0000","last_fullsized":"2026-02-24T19:23:58.322740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:42:03.341148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":613,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.285712+0000","last_change":"2026-02-24T19:18:28.631307+0000","last_active":"2026-02-24T19:23:58.285712+0000","last_peered":"2026-02-24T19:23:58.285712+0000","last_clean":"2026-02-24T19:23:58.285712+0000","last_became_active":"2026-02-24T19:18:28.626150+0000","last_became_peered":"2026-02-24T19:18:28.626150+0000","last_unstale":"2026-02-24T19:23:58.285712+0000","last_undegraded":"2026-02-24T19:23:58.285712+0000","last_fullsized":"2026-02-24T19:23:58.285712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:39:37.876703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.679046+0000","last_change":"2026-02-24T19:18:30.388644+0000","last_active":"2026-02-24T19:23:59.679046+0000","last_peered":"2026-02-24T19:23:59.679046+0000","last_clean":"2026-02-24T19:23:59.679046+0000","last_became_active":"2026-02-24T19:18:30.386561+0000","last_became_peered":"2026-02-24T19:18:30.386561+0000","last_unstale":"2026-02-24T19:23:59.679046+0000","last_undegraded":"2026-02-24T19:23:59.679046+0000","last_fullsized":"2026-02-24T19:23:59.679046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:24:18.512374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"25'32","reported_seq":676,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.673915+0000","last_change":"2026-02-24T19:17:41.855813+0000","last_active":"2026-02-24T19:23:59.673915+0000","last_peered":"2026-02-24T19:23:59.673915+0000","last_clean":"2026-02-24T19:23:59.673915+0000","last_became_active":"2026-02-24T19:17:41.834152+0000","last_became_peered":"2026-02-24T19:17:41.834152+0000","last_unstale":"2026-02-24T19:23:59.673915+0000","last_undegraded":"2026-02-24T19:23:59.673915+0000","last_fullsized":"2026-02-24T19:23:59.673915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_clean_scrub_stamp":"2026-02-24T19:17:39.980633+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:41:22.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":633,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.315726+0000","last_change":"2026-02-24T19:17:51.734383+0000","last_active":"2026-02-24T19:23:58.315726+0000","last_peered":"2026-02-24T19:23:58.315726+0000","last_clean":"2026-02-24T19:23:58.315726+0000","last_became_active":"2026-02-24T19:17:49.844588+0000","last_became_peered":"2026-02-24T19:17:49.844588+0000","last_unstale":"2026-02-24T19:23:58.315726+0000","last_undegraded":"2026-02-24T19:23:58.315726+0000","last_fullsized":"2026-02-24T19:23:58.315726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:26:51.919573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039325629000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.679882+0000","last_change":"2026-02-24T19:18:28.881103+0000","last_active":"2026-02-24T19:23:59.679882+0000","last_peered":"2026-02-24T19:23:59.679882+0000","last_clean":"2026-02-24T19:23:59.679882+0000","last_became_active":"2026-02-24T19:18:28.879013+0000","last_became_peered":"2026-02-24T19:18:28.879013+0000","last_unstale":"2026-02-24T19:23:59.679882+0000","last_undegraded":"2026-02-24T19:23:59.679882+0000","last_fullsized":"2026-02-24T19:23:59.679882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:34:10.611706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":631,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.252850+0000","last_change":"2026-02-24T19:17:51.879794+0000","last_active":"2026-02-24T19:23:58.252850+0000","last_peered":"2026-02-24T19:23:58.252850+0000","last_clean":"2026-02-24T19:23:58.252850+0000","last_became_active":"2026-02-24T19:17:49.829989+0000","last_became_peered":"2026-02-24T19:17:49.829989+0000","last_unstale":"2026-02-24T19:23:58.252850+0000","last_undegraded":"2026-02-24T19:23:58.252850+0000","last_fullsized":"2026-02-24T19:23:58.252850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:23:30.666021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032260351999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":617,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.322537+0000","last_change":"2026-02-24T19:18:28.728380+0000","last_active":"2026-02-24T19:23:58.322537+0000","last_peered":"2026-02-24T19:23:58.322537+0000","last_clean":"2026-02-24T19:23:58.322537+0000","last_became_active":"2026-02-24T19:18:28.725927+0000","last_became_peered":"2026-02-24T19:18:28.725927+0000","last_unstale":"2026-02-24T19:23:58.322537+0000","last_undegraded":"2026-02-24T19:23:58.322537+0000","last_fullsized":"2026-02-24T19:23:58.322537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:22:34.338905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":629,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.282851+0000","last_change":"2026-02-24T19:17:51.909002+0000","last_active":"2026-02-24T19:23:58.282851+0000","last_peered":"2026-02-24T19:23:58.282851+0000","last_clean":"2026-02-24T19:23:58.282851+0000","last_became_active":"2026-02-24T19:17:50.962180+0000","last_became_peered":"2026-02-24T19:17:50.962180+0000","last_unstale":"2026-02-24T19:23:58.282851+0000","last_undegraded":"2026-02-24T19:23:58.282851+0000","last_fullsized":"2026-02-24T19:23:58.282851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:55:24.848537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034127616999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,14],"acting":[6,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.692086+0000","last_change":"2026-02-24T19:18:29.244450+0000","last_active":"2026-02-24T19:23:59.692086+0000","last_peered":"2026-02-24T19:23:59.692086+0000","last_clean":"2026-02-24T19:23:59.692086+0000","last_became_active":"2026-02-24T19:18:29.241947+0000","last_became_peered":"2026-02-24T19:18:29.241947+0000","last_unstale":"2026-02-24T19:23:59.692086+0000","last_undegraded":"2026-02-24T19:23:59.692086+0000","last_fullsized":"2026-02-24T19:23:59.692086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:17:14.369011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":634,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.313256+0000","last_change":"2026-02-24T19:17:51.726046+0000","last_active":"2026-02-24T19:23:58.313256+0000","last_peered":"2026-02-24T19:23:58.313256+0000","last_clean":"2026-02-24T19:23:58.313256+0000","last_became_active":"2026-02-24T19:17:49.831395+0000","last_became_peered":"2026-02-24T19:17:49.831395+0000","last_unstale":"2026-02-24T19:23:58.313256+0000","last_undegraded":"2026-02-24T19:23:58.313256+0000","last_fullsized":"2026-02-24T19:23:58.313256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:45:35.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363406999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.322946+0000","last_change":"2026-02-24T19:18:29.174512+0000","last_active":"2026-02-24T19:23:58.322946+0000","last_peered":"2026-02-24T19:23:58.322946+0000","last_clean":"2026-02-24T19:23:58.322946+0000","last_became_active":"2026-02-24T19:18:29.172298+0000","last_became_peered":"2026-02-24T19:18:29.172298+0000","last_unstale":"2026-02-24T19:23:58.322946+0000","last_undegraded":"2026-02-24T19:23:58.322946+0000","last_fullsized":"2026-02-24T19:23:58.322946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:53:31.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15],"acting":[8,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":636,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.400437+0000","last_change":"2026-02-24T19:17:51.889910+0000","last_active":"2026-02-24T19:23:59.400437+0000","last_peered":"2026-02-24T19:23:59.400437+0000","last_clean":"2026-02-24T19:23:59.400437+0000","last_became_active":"2026-02-24T19:17:49.867737+0000","last_became_peered":"2026-02-24T19:17:49.867737+0000","last_unstale":"2026-02-24T19:23:59.400437+0000","last_undegraded":"2026-02-24T19:23:59.400437+0000","last_fullsized":"2026-02-24T19:23:59.400437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:43:43.357779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041050483999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.398466+0000","last_change":"2026-02-24T19:18:29.018360+0000","last_active":"2026-02-24T19:23:59.398466+0000","last_peered":"2026-02-24T19:23:59.398466+0000","last_clean":"2026-02-24T19:23:59.398466+0000","last_became_active":"2026-02-24T19:18:29.015809+0000","last_became_peered":"2026-02-24T19:18:29.015809+0000","last_unstale":"2026-02-24T19:23:59.398466+0000","last_undegraded":"2026-02-24T19:23:59.398466+0000","last_fullsized":"2026-02-24T19:23:59.398466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:52:29.814745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9],"acting":[15,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":636,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.403574+0000","last_change":"2026-02-24T19:17:51.895025+0000","last_active":"2026-02-24T19:23:59.403574+0000","last_peered":"2026-02-24T19:23:59.403574+0000","last_clean":"2026-02-24T19:23:59.403574+0000","last_became_active":"2026-02-24T19:17:49.822380+0000","last_became_peered":"2026-02-24T19:17:49.822380+0000","last_unstale":"2026-02-24T19:23:59.403574+0000","last_undegraded":"2026-02-24T19:23:59.403574+0000","last_fullsized":"2026-02-24T19:23:59.403574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:22:04.516051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031009920999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.676619+0000","last_change":"2026-02-24T19:18:28.599982+0000","last_active":"2026-02-24T19:23:59.676619+0000","last_peered":"2026-02-24T19:23:59.676619+0000","last_clean":"2026-02-24T19:23:59.676619+0000","last_became_active":"2026-02-24T19:18:28.578714+0000","last_became_peered":"2026-02-24T19:18:28.578714+0000","last_unstale":"2026-02-24T19:23:59.676619+0000","last_undegraded":"2026-02-24T19:23:59.676619+0000","last_fullsized":"2026-02-24T19:23:59.676619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:11:52.417883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":635,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.315985+0000","last_change":"2026-02-24T19:17:51.929779+0000","last_active":"2026-02-24T19:23:59.315985+0000","last_peered":"2026-02-24T19:23:59.315985+0000","last_clean":"2026-02-24T19:23:59.315985+0000","last_became_active":"2026-02-24T19:17:49.636104+0000","last_became_peered":"2026-02-24T19:17:49.636104+0000","last_unstale":"2026-02-24T19:23:59.315985+0000","last_undegraded":"2026-02-24T19:23:59.315985+0000","last_fullsized":"2026-02-24T19:23:59.315985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:53:57.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036145872000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":615,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.254381+0000","last_change":"2026-02-24T19:18:28.651861+0000","last_active":"2026-02-24T19:23:58.254381+0000","last_peered":"2026-02-24T19:23:58.254381+0000","last_clean":"2026-02-24T19:23:58.254381+0000","last_became_active":"2026-02-24T19:18:28.629954+0000","last_became_peered":"2026-02-24T19:18:28.629954+0000","last_unstale":"2026-02-24T19:23:58.254381+0000","last_undegraded":"2026-02-24T19:23:58.254381+0000","last_fullsized":"2026-02-24T19:23:58.254381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:13:40.801862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":632,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.321137+0000","last_change":"2026-02-24T19:17:51.735983+0000","last_active":"2026-02-24T19:23:58.321137+0000","last_peered":"2026-02-24T19:23:58.321137+0000","last_clean":"2026-02-24T19:23:58.321137+0000","last_became_active":"2026-02-24T19:17:49.848509+0000","last_became_peered":"2026-02-24T19:17:49.848509+0000","last_unstale":"2026-02-24T19:23:58.321137+0000","last_undegraded":"2026-02-24T19:23:58.321137+0000","last_fullsized":"2026-02-24T19:23:58.321137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:59:49.327706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032515259999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.306622+0000","last_change":"2026-02-24T19:18:29.182530+0000","last_active":"2026-02-24T19:23:59.306622+0000","last_peered":"2026-02-24T19:23:59.306622+0000","last_clean":"2026-02-24T19:23:59.306622+0000","last_became_active":"2026-02-24T19:18:29.176942+0000","last_became_peered":"2026-02-24T19:18:29.176942+0000","last_unstale":"2026-02-24T19:23:59.306622+0000","last_undegraded":"2026-02-24T19:23:59.306622+0000","last_fullsized":"2026-02-24T19:23:59.306622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:20:26.047180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,12],"acting":[9,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.389654+0000","last_change":"2026-02-24T19:18:29.901720+0000","last_active":"2026-02-24T19:23:59.389654+0000","last_peered":"2026-02-24T19:23:59.389654+0000","last_clean":"2026-02-24T19:23:59.389654+0000","last_became_active":"2026-02-24T19:18:29.899492+0000","last_became_peered":"2026-02-24T19:18:29.899492+0000","last_unstale":"2026-02-24T19:23:59.389654+0000","last_undegraded":"2026-02-24T19:23:59.389654+0000","last_fullsized":"2026-02-24T19:23:59.389654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:46:01.639570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14],"acting":[13,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.391170+0000","last_change":"2026-02-24T19:18:28.454346+0000","last_active":"2026-02-24T19:23:59.391170+0000","last_peered":"2026-02-24T19:23:59.391170+0000","last_clean":"2026-02-24T19:23:59.391170+0000","last_became_active":"2026-02-24T19:18:28.448515+0000","last_became_peered":"2026-02-24T19:18:28.448515+0000","last_unstale":"2026-02-24T19:23:59.391170+0000","last_undegraded":"2026-02-24T19:23:59.391170+0000","last_fullsized":"2026-02-24T19:23:59.391170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:54.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":614,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.329506+0000","last_change":"2026-02-24T19:18:28.813537+0000","last_active":"2026-02-24T19:23:59.329506+0000","last_peered":"2026-02-24T19:23:59.329506+0000","last_clean":"2026-02-24T19:23:59.329506+0000","last_became_active":"2026-02-24T19:18:28.805888+0000","last_became_peered":"2026-02-24T19:18:28.805888+0000","last_unstale":"2026-02-24T19:23:59.329506+0000","last_undegraded":"2026-02-24T19:23:59.329506+0000","last_fullsized":"2026-02-24T19:23:59.329506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:21:32.488493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1","version":"33'11","reported_seq":643,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.312144+0000","last_change":"2026-02-24T19:18:28.660457+0000","last_active":"2026-02-24T19:23:58.312144+0000","last_peered":"2026-02-24T19:23:58.312144+0000","last_clean":"2026-02-24T19:23:58.312144+0000","last_became_active":"2026-02-24T19:18:28.658257+0000","last_became_peered":"2026-02-24T19:18:28.658257+0000","last_unstale":"2026-02-24T19:23:58.312144+0000","last_undegraded":"2026-02-24T19:23:58.312144+0000","last_fullsized":"2026-02-24T19:23:58.312144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:56:37.770223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":618,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329992+0000","last_change":"2026-02-24T19:18:28.336280+0000","last_active":"2026-02-24T19:23:58.329992+0000","last_peered":"2026-02-24T19:23:58.329992+0000","last_clean":"2026-02-24T19:23:58.329992+0000","last_became_active":"2026-02-24T19:18:28.334029+0000","last_became_peered":"2026-02-24T19:18:28.334029+0000","last_unstale":"2026-02-24T19:23:58.329992+0000","last_undegraded":"2026-02-24T19:23:58.329992+0000","last_fullsized":"2026-02-24T19:23:58.329992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:54:32.836654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329780+0000","last_change":"2026-02-24T19:18:28.729903+0000","last_active":"2026-02-24T19:23:58.329780+0000","last_peered":"2026-02-24T19:23:58.329780+0000","last_clean":"2026-02-24T19:23:58.329780+0000","last_became_active":"2026-02-24T19:18:28.727493+0000","last_became_peered":"2026-02-24T19:18:28.727493+0000","last_unstale":"2026-02-24T19:23:58.329780+0000","last_undegraded":"2026-02-24T19:23:58.329780+0000","last_fullsized":"2026-02-24T19:23:58.329780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:30:30.028759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.323713+0000","last_change":"2026-02-24T19:18:29.352492+0000","last_active":"2026-02-24T19:23:58.323713+0000","last_peered":"2026-02-24T19:23:58.323713+0000","last_clean":"2026-02-24T19:23:58.323713+0000","last_became_active":"2026-02-24T19:18:29.350423+0000","last_became_peered":"2026-02-24T19:18:29.350423+0000","last_unstale":"2026-02-24T19:23:58.323713+0000","last_undegraded":"2026-02-24T19:23:58.323713+0000","last_fullsized":"2026-02-24T19:23:58.323713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:16:25.791348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.676171+0000","last_change":"2026-02-24T19:18:29.505834+0000","last_active":"2026-02-24T19:23:59.676171+0000","last_peered":"2026-02-24T19:23:59.676171+0000","last_clean":"2026-02-24T19:23:59.676171+0000","last_became_active":"2026-02-24T19:18:29.503545+0000","last_became_peered":"2026-02-24T19:18:29.503545+0000","last_unstale":"2026-02-24T19:23:59.676171+0000","last_undegraded":"2026-02-24T19:23:59.676171+0000","last_fullsized":"2026-02-24T19:23:59.676171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:38:03.828269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.677349+0000","last_change":"2026-02-24T19:18:28.360041+0000","last_active":"2026-02-24T19:23:59.677349+0000","last_peered":"2026-02-24T19:23:59.677349+0000","last_clean":"2026-02-24T19:23:59.677349+0000","last_became_active":"2026-02-24T19:18:28.357637+0000","last_became_peered":"2026-02-24T19:18:28.357637+0000","last_unstale":"2026-02-24T19:23:59.677349+0000","last_undegraded":"2026-02-24T19:23:59.677349+0000","last_fullsized":"2026-02-24T19:23:59.677349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:35:29.378705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.677601+0000","last_change":"2026-02-24T19:18:30.010817+0000","last_active":"2026-02-24T19:23:59.677601+0000","last_peered":"2026-02-24T19:23:59.677601+0000","last_clean":"2026-02-24T19:23:59.677601+0000","last_became_active":"2026-02-24T19:18:30.008609+0000","last_became_peered":"2026-02-24T19:18:30.008609+0000","last_unstale":"2026-02-24T19:23:59.677601+0000","last_undegraded":"2026-02-24T19:23:59.677601+0000","last_fullsized":"2026-02-24T19:23:59.677601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:45:00.289172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.321788+0000","last_change":"2026-02-24T19:18:29.239229+0000","last_active":"2026-02-24T19:23:58.321788+0000","last_peered":"2026-02-24T19:23:58.321788+0000","last_clean":"2026-02-24T19:23:58.321788+0000","last_became_active":"2026-02-24T19:18:29.237008+0000","last_became_peered":"2026-02-24T19:18:29.237008+0000","last_unstale":"2026-02-24T19:23:58.321788+0000","last_undegraded":"2026-02-24T19:23:58.321788+0000","last_fullsized":"2026-02-24T19:23:58.321788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:19:19.633721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":623,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:03.130699+0000","last_change":"2026-02-24T19:18:28.794132+0000","last_active":"2026-02-24T19:24:03.130699+0000","last_peered":"2026-02-24T19:24:03.130699+0000","last_clean":"2026-02-24T19:24:03.130699+0000","last_became_active":"2026-02-24T19:18:28.791994+0000","last_became_peered":"2026-02-24T19:18:28.791994+0000","last_unstale":"2026-02-24T19:24:03.130699+0000","last_undegraded":"2026-02-24T19:24:03.130699+0000","last_fullsized":"2026-02-24T19:24:03.130699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:37:30.793100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":864256,"data_stored":857120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280590,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6772,"kb_used_omap":3010,"kb_used_meta":23933,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6934528,"data_stored":4264433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3082938,"internal_metadata":24507718},"hb_peers":[0,2,3,4,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313294,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210814,"internal_metadata":27379842},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280591,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":211429,"internal_metadata":27379227},"hb_peers":[1,3,5,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33716,"kb_used_data":6756,"kb_used_omap":3011,"kb_used_meta":23932,"kb_avail":94338124,"statfs":{"total":96636764160,"available":96602238976,"internally_reserved":0,"allocated":6918144,"data_stored":4258324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3084121,"internal_metadata":24506535},"hb_peers":[1,2,3,4,5,6,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313294,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210351,"internal_metadata":27380305},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33780,"kb_used_data":6820,"kb_used_omap":110,"kb_used_meta":26833,"kb_avail":94338060,"statfs":{"total":96636764160,"available":96602173440,"internally_reserved":0,"allocated":6983680,"data_stored":4295884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113659,"internal_metadata":27476997},"hb_peers":[0,1,3,4,5,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208968,"internal_metadata":27381688},"hb_peers":[0,1,3,4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3084465,"internal_metadata":24506191},"hb_peers":[1,2,3,4,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33720,"kb_used_data":6760,"kb_used_omap":207,"kb_used_meta":26736,"kb_avail":94338120,"statfs":{"total":96636764160,"available":96602234880,"internally_reserved":0,"allocated":6922240,"data_stored":4254252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":212730,"internal_metadata":27377926},"hb_peers":[0,1,4,5,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":2920,"kb_used_meta":24023,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2990703,"internal_metadata":24599953},"hb_peers":[0,1,3,4,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313294,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33716,"kb_used_data":6756,"kb_used_omap":173,"kb_used_meta":26770,"kb_avail":94338124,"statfs":{"total":96636764160,"available":96602238976,"internally_reserved":0,"allocated":6918144,"data_stored":4254233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":177224,"internal_metadata":27413432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6772,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6934528,"data_stored":4264433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":211067,"internal_metadata":27379589},"hb_peers":[1,2,3,4,5,6,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313294,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34104,"kb_used_data":7144,"kb_used_omap":2877,"kb_used_meta":24066,"kb_avail":94337736,"statfs":{"total":96636764160,"available":96601841664,"internally_reserved":0,"allocated":7315456,"data_stored":4652068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2946222,"internal_metadata":24644434},"hb_peers":[0,2,3,4,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34184,"kb_used_data":7224,"kb_used_omap":5765,"kb_used_meta":21178,"kb_avail":94337656,"statfs":{"total":96636764160,"available":96601759744,"internally_reserved":0,"allocated":7397376,"data_stored":4723713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5904083,"internal_metadata":21686573},"hb_peers":[0,1,2,4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313294,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":167,"kb_used_meta":26776,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":172019,"internal_metadata":27418637},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280591,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33716,"kb_used_data":6756,"kb_used_omap":3014,"kb_used_meta":23929,"kb_avail":94338124,"statfs":{"total":96636764160,"available":96602238976,"internally_reserved":0,"allocated":6918144,"data_stored":4254247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087066,"internal_metadata":24503590},"hb_peers":[1,2,3,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:05.199 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T19:24:05.199 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:05.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.264+0000 7f3cb1693640 10 monclient: get_monmap_and_config 2026-02-24T19:24:05.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.264+0000 7f3cb1693640 10 monclient: build_initial_monmap 2026-02-24T19:24:05.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.264+0000 7f3cb1693640 10 monclient: monmap: 2026-02-24T19:24:05.268 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:05.268 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.268 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:05.265864+0000 2026-02-24T19:24:05.269 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:05.265864+0000 2026-02-24T19:24:05.269 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:05.269 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.269 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:05.269 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:05.269 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:05.269 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 1 Processor -- start 2026-02-24T19:24:05.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 1 -- start start 2026-02-24T19:24:05.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 10 monclient: init 2026-02-24T19:24:05.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 10 monclient(hunting): picked mon.noname-c con 0x7f3cac058da0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 10 monclient(hunting): picked mon.noname-a con 0x7f3cac059170 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 10 monclient(hunting): picked mon.noname-b con 0x7f3cac159ee0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cac05d6e0 con 0x7f3cac059170 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cac164100 con 0x7f3cac159ee0 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cac0a8ff0 con 0x7f3cac058da0 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.265+0000 7f3cb1693640 10 monclient(hunting): authenticate will time out at 4016.904855s 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.266+0000 7f3caa7fc640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f3cac059170 0x7f3cac1597d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45688/0 (socket says 10.20.193.45:45688) 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.266+0000 7f3caa7fc640 1 -- 10.20.193.45:0/3564893272 learned_addr learned my addr 10.20.193.45:0/3564893272 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:05.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.266+0000 7f3cab7fe640 1 --1- 10.20.193.45:0/3564893272 >> v1:10.20.193.114:6789/0 conn(0x7f3cac159ee0 0x7f3cac163340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34888/0 (socket says 10.20.193.45:34888) 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842826533 0 0) 0x7f3cac05d6e0 con 0x7f3cac059170 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 10 monclient(hunting): my global_id is 30603 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c98003610 con 0x7f3cac059170 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2207078842 0 0) 0x7f3cac164100 con 0x7f3cac159ee0 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 10 monclient(hunting): my global_id is 28072 2026-02-24T19:24:05.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.267+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cac05d6e0 con 0x7f3cac159ee0 2026-02-24T19:24:05.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.268+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236630578 0 0) 0x7f3cac0a8ff0 con 0x7f3cac058da0 2026-02-24T19:24:05.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.268+0000 7f3ca9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.268+0000 7f3ca9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.268+0000 7f3ca9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.268+0000 7f3ca9ffb640 10 monclient(hunting): my global_id is 26546 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.268+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cac164100 con 0x7f3cac058da0 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3876846921 0 0) 0x7f3c98003610 con 0x7f3cac059170 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 >> v1:10.20.193.179:6789/0 conn(0x7f3cac058da0 legacy=0x7f3cac05cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 >> v1:10.20.193.114:6789/0 conn(0x7f3cac159ee0 legacy=0x7f3cac163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 1 monclient: found mon.noname-a 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac0a92d0 con 0x7f3cac059170 2026-02-24T19:24:05.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3c94002df0 con 0x7f3cac059170 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3ca9ffb640 10 monclient: dump: 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.282 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3cb1693640 5 monclient: authenticate success, global_id 30603 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.269+0000 7f3cb1693640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c94002fc0 con 0x7f3cac059170 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3ca9ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3ca9ffb640 1 -- 10.20.193.45:0/3564893272 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3c94003400 con 0x7f3cac059170 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3cb1693640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:05.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3ca9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3cb1693640 4 set_mon_vals no callback set 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3ca9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3ca9ffb640 10 monclient: dump: 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.284 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3cb1693640 10 monclient: shutdown 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3cb1693640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3cb1693640 1 -- 10.20.193.45:0/3564893272 >> v1:10.20.193.45:6789/0 conn(0x7f3cac059170 legacy=0x7f3cac1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3cb1693640 1 -- 10.20.193.45:0/3564893272 shutdown_connections 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3cb1693640 1 -- 10.20.193.45:0/3564893272 >> 10.20.193.45:0/3564893272 conn(0x7f3cac0b65f0 msgr2=0x7f3cac0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3cb1693640 1 -- 10.20.193.45:0/3564893272 shutdown_connections 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.270+0000 7f3cb1693640 1 -- 10.20.193.45:0/3564893272 wait complete. 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient: build_initial_monmap 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient: monmap: 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:05.285 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 1 librados: starting msgr at 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 1 librados: starting objecter 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:05.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 1 Processor -- start 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 1 -- start start 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 1 librados: setting wanted keys 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 1 librados: calling monclient init 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient: init 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient(hunting): picked mon.noname-a con 0x7f3cac058da0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient(hunting): picked mon.noname-b con 0x7f3cac059170 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient(hunting): picked mon.noname-c con 0x7f3cac159ee0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cac1fb870 con 0x7f3cac058da0 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cac1fbb50 con 0x7f3cac059170 2026-02-24T19:24:05.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cac1fbe30 con 0x7f3cac159ee0 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.271+0000 7f3cb1693640 10 monclient(hunting): authenticate will time out at 4016.910962s 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.272+0000 7f3caa7fc640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f3cac059170 0x7f3cac162700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34894/0 (socket says 10.20.193.45:34894) 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.272+0000 7f3caa7fc640 1 -- 10.20.193.45:0/4014195803 learned_addr learned my addr 10.20.193.45:0/4014195803 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.272+0000 7f3c8b7fe640 10 client.?.objecter ms_handle_connect 0x7f3cac058da0 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.272+0000 7f3c8b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.272+0000 7f3c8b7fe640 10 client.?.objecter ms_handle_connect 0x7f3cac159ee0 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.272+0000 7f3c8b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.272+0000 7f3c8b7fe640 10 client.?.objecter ms_handle_connect 0x7f3cac059170 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.272+0000 7f3c8b7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501214320 0 0) 0x7f3cac1fbe30 con 0x7f3cac159ee0 2026-02-24T19:24:05.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): my global_id is 26549 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c78003610 con 0x7f3cac159ee0 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662217591 0 0) 0x7f3cac1fb870 con 0x7f3cac058da0 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): my global_id is 30606 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cac1fbe30 con 0x7f3cac058da0 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441085377 0 0) 0x7f3cac1fbb50 con 0x7f3cac059170 2026-02-24T19:24:05.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 10 monclient(hunting): my global_id is 28075 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.273+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cac1fb870 con 0x7f3cac059170 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.275+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 830496925 0 0) 0x7f3c78003610 con 0x7f3cac159ee0 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.275+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3cac1fbb50 con 0x7f3cac159ee0 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.275+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3c9c0032f0 con 0x7f3cac159ee0 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.275+0000 7f3c8b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.275+0000 7f3c8b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.275+0000 7f3c8b7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.290 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.275+0000 7f3c8b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.275+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1260889307 0 0) 0x7f3cac1fbe30 con 0x7f3cac058da0 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.275+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c78003610 con 0x7f3cac058da0 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3ca0003060 con 0x7f3cac058da0 2026-02-24T19:24:05.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 124424471 0 0) 0x7f3cac1fb870 con 0x7f3cac059170 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3cac1fbe30 con 0x7f3cac059170 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3c94003310 con 0x7f3cac059170 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.293 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.294 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.294 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3258501578 0 0) 0x7f3cac1fbb50 con 0x7f3cac159ee0 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 >> v1:10.20.193.114:6789/0 conn(0x7f3cac059170 legacy=0x7f3cac162700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 >> v1:10.20.193.45:6789/0 conn(0x7f3cac058da0 legacy=0x7f3cac151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 1 monclient: found mon.c 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac161f00 con 0x7f3cac159ee0 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3c8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:05.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3cb1693640 5 monclient: authenticate success, global_id 26549 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3cb1693640 10 monclient: _renew_subs 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3cb1693640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac1621e0 con 0x7f3cac159ee0 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3cb1693640 10 client.26549.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3cb1693640 10 monclient: _renew_subs 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3cb1693640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3cac1523c0 con 0x7f3cac159ee0 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.277+0000 7f3cb1693640 1 librados: init done 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.278+0000 7f3cb1693640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.278+0000 7f3cb1693640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.278+0000 7f3cb1693640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:05.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.278+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cac1677f0 con 0x7f3cac159ee0 2026-02-24T19:24:05.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.368+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c9c003490 con 0x7f3cac159ee0 2026-02-24T19:24:05.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.368+0000 7f3c8b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.368+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3c9c004df0 con 0x7f3cac159ee0 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.368+0000 7f3c8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.368+0000 7f3c8b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.368+0000 7f3ca97fa640 4 set_mon_vals no callback set 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.368+0000 7f3c8b7fe640 10 monclient: dump: 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.371 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.372 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.372 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.372 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.368+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f3c9c01dc60 con 0x7f3cac159ee0 2026-02-24T19:24:05.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.369+0000 7f3caaffd640 10 monclient: get_auth_request con 0x7f3c78077e20 auth_method 0 2026-02-24T19:24:05.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.369+0000 7f3c8b7fe640 10 client.26549.objecter ms_handle_connect 0x7f3c78077e20 2026-02-24T19:24:05.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.370+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f3c9c093430 con 0x7f3cac159ee0 2026-02-24T19:24:05.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.370+0000 7f3c8b7fe640 10 client.26549.objecter ms_dispatch2 0x7f3cac000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:05.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.370+0000 7f3c8b7fe640 3 client.26549.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:05.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.370+0000 7f3c8b7fe640 3 client.26549.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:05.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.370+0000 7f3c8b7fe640 20 client.26549.objecter dump_active .. 0 homeless 2026-02-24T19:24:05.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.371+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f3c9c05de60 con 0x7f3cac159ee0 2026-02-24T19:24:05.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.371+0000 7f3c8b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:05.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.371+0000 7f3c8b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:05.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.474+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3cac1fc000 con 0x7f3c78077e20 2026-02-24T19:24:05.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.475+0000 7f3c8b7fe640 1 -- 10.20.193.45:0/4014195803 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125399 (unknown 2965378022 0 4190562200) 0x7f3cac1fc000 con 0x7f3c78077e20 2026-02-24T19:24:05.479 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:24:05.480 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-24T19:24:05.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 10 librados: watch_flush enter 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 10 librados: watch_flush exit 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 20 client.26549.objecter shutdown clearing up homeless session... 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 10 client.26549.objecter successfully canceled tick 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 >> v1:10.20.193.45:6800/1599977652 conn(0x7f3c78077e20 legacy=0x7f3c780982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 10 monclient: shutdown 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 >> v1:10.20.193.179:6789/0 conn(0x7f3cac159ee0 legacy=0x7f3cac1332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 shutdown_connections 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 >> 10.20.193.45:0/4014195803 conn(0x7f3cac0b65f0 msgr2=0x7f3cac1530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:05.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 shutdown_connections 2026-02-24T19:24:05.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 1 -- 10.20.193.45:0/4014195803 wait complete. 2026-02-24T19:24:05.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.477+0000 7f3cb1693640 1 librados: shutdown 2026-02-24T19:24:05.487 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2026-02-24T19:24:04.083806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":540384,"kb_used_data":109024,"kb_used_omap":25300,"kb_used_meta":405803,"kb_avail":1509409056,"statfs":{"total":1546188226560,"available":1545634873344,"internally_reserved":0,"allocated":111640576,"data_stored":69001183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25907859,"internal_metadata":415542637},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.046700"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.685829+0000","last_change":"2026-02-24T19:18:30.040599+0000","last_active":"2026-02-24T19:23:59.685829+0000","last_peered":"2026-02-24T19:23:59.685829+0000","last_clean":"2026-02-24T19:23:59.685829+0000","last_became_active":"2026-02-24T19:18:30.038497+0000","last_became_peered":"2026-02-24T19:18:30.038497+0000","last_unstale":"2026-02-24T19:23:59.685829+0000","last_undegraded":"2026-02-24T19:23:59.685829+0000","last_fullsized":"2026-02-24T19:23:59.685829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:10:09.004482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":617,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.319916+0000","last_change":"2026-02-24T19:18:28.471116+0000","last_active":"2026-02-24T19:23:58.319916+0000","last_peered":"2026-02-24T19:23:58.319916+0000","last_clean":"2026-02-24T19:23:58.319916+0000","last_became_active":"2026-02-24T19:18:28.441755+0000","last_became_peered":"2026-02-24T19:18:28.441755+0000","last_unstale":"2026-02-24T19:23:58.319916+0000","last_undegraded":"2026-02-24T19:23:58.319916+0000","last_fullsized":"2026-02-24T19:23:58.319916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:31:02.204366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.380594+0000","last_change":"2026-02-24T19:18:28.672244+0000","last_active":"2026-02-24T19:23:59.380594+0000","last_peered":"2026-02-24T19:23:59.380594+0000","last_clean":"2026-02-24T19:23:59.380594+0000","last_became_active":"2026-02-24T19:18:28.670036+0000","last_became_peered":"2026-02-24T19:18:28.670036+0000","last_unstale":"2026-02-24T19:23:59.380594+0000","last_undegraded":"2026-02-24T19:23:59.380594+0000","last_fullsized":"2026-02-24T19:23:59.380594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:13:54.603079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329086+0000","last_change":"2026-02-24T19:18:29.299593+0000","last_active":"2026-02-24T19:23:58.329086+0000","last_peered":"2026-02-24T19:23:58.329086+0000","last_clean":"2026-02-24T19:23:58.329086+0000","last_became_active":"2026-02-24T19:18:29.297442+0000","last_became_peered":"2026-02-24T19:18:29.297442+0000","last_unstale":"2026-02-24T19:23:58.329086+0000","last_undegraded":"2026-02-24T19:23:58.329086+0000","last_fullsized":"2026-02-24T19:23:58.329086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:27:15.018443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.675209+0000","last_change":"2026-02-24T19:18:29.545106+0000","last_active":"2026-02-24T19:23:59.675209+0000","last_peered":"2026-02-24T19:23:59.675209+0000","last_clean":"2026-02-24T19:23:59.675209+0000","last_became_active":"2026-02-24T19:18:29.539772+0000","last_became_peered":"2026-02-24T19:18:29.539772+0000","last_unstale":"2026-02-24T19:23:59.675209+0000","last_undegraded":"2026-02-24T19:23:59.675209+0000","last_fullsized":"2026-02-24T19:23:59.675209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:13:08.139044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.674742+0000","last_change":"2026-02-24T19:18:28.594138+0000","last_active":"2026-02-24T19:23:59.674742+0000","last_peered":"2026-02-24T19:23:59.674742+0000","last_clean":"2026-02-24T19:23:59.674742+0000","last_became_active":"2026-02-24T19:18:28.575721+0000","last_became_peered":"2026-02-24T19:18:28.575721+0000","last_unstale":"2026-02-24T19:23:59.674742+0000","last_undegraded":"2026-02-24T19:23:59.674742+0000","last_fullsized":"2026-02-24T19:23:59.674742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:15:36.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329395+0000","last_change":"2026-02-24T19:18:28.208160+0000","last_active":"2026-02-24T19:23:58.329395+0000","last_peered":"2026-02-24T19:23:58.329395+0000","last_clean":"2026-02-24T19:23:58.329395+0000","last_became_active":"2026-02-24T19:18:28.189388+0000","last_became_peered":"2026-02-24T19:18:28.189388+0000","last_unstale":"2026-02-24T19:23:58.329395+0000","last_undegraded":"2026-02-24T19:23:58.329395+0000","last_fullsized":"2026-02-24T19:23:58.329395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:38:11.940782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":623,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:03.131587+0000","last_change":"2026-02-24T19:18:30.249532+0000","last_active":"2026-02-24T19:24:03.131587+0000","last_peered":"2026-02-24T19:24:03.131587+0000","last_clean":"2026-02-24T19:24:03.131587+0000","last_became_active":"2026-02-24T19:18:30.247456+0000","last_became_peered":"2026-02-24T19:18:30.247456+0000","last_unstale":"2026-02-24T19:24:03.131587+0000","last_undegraded":"2026-02-24T19:24:03.131587+0000","last_fullsized":"2026-02-24T19:24:03.131587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:38:54.762951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.321970+0000","last_change":"2026-02-24T19:18:29.118353+0000","last_active":"2026-02-24T19:23:58.321970+0000","last_peered":"2026-02-24T19:23:58.321970+0000","last_clean":"2026-02-24T19:23:58.321970+0000","last_became_active":"2026-02-24T19:18:29.115400+0000","last_became_peered":"2026-02-24T19:18:29.115400+0000","last_unstale":"2026-02-24T19:23:58.321970+0000","last_undegraded":"2026-02-24T19:23:58.321970+0000","last_fullsized":"2026-02-24T19:23:58.321970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:24:41.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.322740+0000","last_change":"2026-02-24T19:18:28.592539+0000","last_active":"2026-02-24T19:23:58.322740+0000","last_peered":"2026-02-24T19:23:58.322740+0000","last_clean":"2026-02-24T19:23:58.322740+0000","last_became_active":"2026-02-24T19:18:28.565625+0000","last_became_peered":"2026-02-24T19:18:28.565625+0000","last_unstale":"2026-02-24T19:23:58.322740+0000","last_undegraded":"2026-02-24T19:23:58.322740+0000","last_fullsized":"2026-02-24T19:23:58.322740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:42:03.341148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":613,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.285712+0000","last_change":"2026-02-24T19:18:28.631307+0000","last_active":"2026-02-24T19:23:58.285712+0000","last_peered":"2026-02-24T19:23:58.285712+0000","last_clean":"2026-02-24T19:23:58.285712+0000","last_became_active":"2026-02-24T19:18:28.626150+0000","last_became_peered":"2026-02-24T19:18:28.626150+0000","last_unstale":"2026-02-24T19:23:58.285712+0000","last_undegraded":"2026-02-24T19:23:58.285712+0000","last_fullsized":"2026-02-24T19:23:58.285712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:39:37.876703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.679046+0000","last_change":"2026-02-24T19:18:30.388644+0000","last_active":"2026-02-24T19:23:59.679046+0000","last_peered":"2026-02-24T19:23:59.679046+0000","last_clean":"2026-02-24T19:23:59.679046+0000","last_became_active":"2026-02-24T19:18:30.386561+0000","last_became_peered":"2026-02-24T19:18:30.386561+0000","last_unstale":"2026-02-24T19:23:59.679046+0000","last_undegraded":"2026-02-24T19:23:59.679046+0000","last_fullsized":"2026-02-24T19:23:59.679046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:24:18.512374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"25'32","reported_seq":676,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.673915+0000","last_change":"2026-02-24T19:17:41.855813+0000","last_active":"2026-02-24T19:23:59.673915+0000","last_peered":"2026-02-24T19:23:59.673915+0000","last_clean":"2026-02-24T19:23:59.673915+0000","last_became_active":"2026-02-24T19:17:41.834152+0000","last_became_peered":"2026-02-24T19:17:41.834152+0000","last_unstale":"2026-02-24T19:23:59.673915+0000","last_undegraded":"2026-02-24T19:23:59.673915+0000","last_fullsized":"2026-02-24T19:23:59.673915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_clean_scrub_stamp":"2026-02-24T19:17:39.980633+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:41:22.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":633,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.315726+0000","last_change":"2026-02-24T19:17:51.734383+0000","last_active":"2026-02-24T19:23:58.315726+0000","last_peered":"2026-02-24T19:23:58.315726+0000","last_clean":"2026-02-24T19:23:58.315726+0000","last_became_active":"2026-02-24T19:17:49.844588+0000","last_became_peered":"2026-02-24T19:17:49.844588+0000","last_unstale":"2026-02-24T19:23:58.315726+0000","last_undegraded":"2026-02-24T19:23:58.315726+0000","last_fullsized":"2026-02-24T19:23:58.315726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:26:51.919573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039325629000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.679882+0000","last_change":"2026-02-24T19:18:28.881103+0000","last_active":"2026-02-24T19:23:59.679882+0000","last_peered":"2026-02-24T19:23:59.679882+0000","last_clean":"2026-02-24T19:23:59.679882+0000","last_became_active":"2026-02-24T19:18:28.879013+0000","last_became_peered":"2026-02-24T19:18:28.879013+0000","last_unstale":"2026-02-24T19:23:59.679882+0000","last_undegraded":"2026-02-24T19:23:59.679882+0000","last_fullsized":"2026-02-24T19:23:59.679882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:34:10.611706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":631,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.252850+0000","last_change":"2026-02-24T19:17:51.879794+0000","last_active":"2026-02-24T19:23:58.252850+0000","last_peered":"2026-02-24T19:23:58.252850+0000","last_clean":"2026-02-24T19:23:58.252850+0000","last_became_active":"2026-02-24T19:17:49.829989+0000","last_became_peered":"2026-02-24T19:17:49.829989+0000","last_unstale":"2026-02-24T19:23:58.252850+0000","last_undegraded":"2026-02-24T19:23:58.252850+0000","last_fullsized":"2026-02-24T19:23:58.252850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:23:30.666021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032260351999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":617,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.322537+0000","last_change":"2026-02-24T19:18:28.728380+0000","last_active":"2026-02-24T19:23:58.322537+0000","last_peered":"2026-02-24T19:23:58.322537+0000","last_clean":"2026-02-24T19:23:58.322537+0000","last_became_active":"2026-02-24T19:18:28.725927+0000","last_became_peered":"2026-02-24T19:18:28.725927+0000","last_unstale":"2026-02-24T19:23:58.322537+0000","last_undegraded":"2026-02-24T19:23:58.322537+0000","last_fullsized":"2026-02-24T19:23:58.322537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:22:34.338905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":629,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.282851+0000","last_change":"2026-02-24T19:17:51.909002+0000","last_active":"2026-02-24T19:23:58.282851+0000","last_peered":"2026-02-24T19:23:58.282851+0000","last_clean":"2026-02-24T19:23:58.282851+0000","last_became_active":"2026-02-24T19:17:50.962180+0000","last_became_peered":"2026-02-24T19:17:50.962180+0000","last_unstale":"2026-02-24T19:23:58.282851+0000","last_undegraded":"2026-02-24T19:23:58.282851+0000","last_fullsized":"2026-02-24T19:23:58.282851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:55:24.848537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034127616999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,14],"acting":[6,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.692086+0000","last_change":"2026-02-24T19:18:29.244450+0000","last_active":"2026-02-24T19:23:59.692086+0000","last_peered":"2026-02-24T19:23:59.692086+0000","last_clean":"2026-02-24T19:23:59.692086+0000","last_became_active":"2026-02-24T19:18:29.241947+0000","last_became_peered":"2026-02-24T19:18:29.241947+0000","last_unstale":"2026-02-24T19:23:59.692086+0000","last_undegraded":"2026-02-24T19:23:59.692086+0000","last_fullsized":"2026-02-24T19:23:59.692086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:17:14.369011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":634,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.313256+0000","last_change":"2026-02-24T19:17:51.726046+0000","last_active":"2026-02-24T19:23:58.313256+0000","last_peered":"2026-02-24T19:23:58.313256+0000","last_clean":"2026-02-24T19:23:58.313256+0000","last_became_active":"2026-02-24T19:17:49.831395+0000","last_became_peered":"2026-02-24T19:17:49.831395+0000","last_unstale":"2026-02-24T19:23:58.313256+0000","last_undegraded":"2026-02-24T19:23:58.313256+0000","last_fullsized":"2026-02-24T19:23:58.313256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:45:35.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363406999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.322946+0000","last_change":"2026-02-24T19:18:29.174512+0000","last_active":"2026-02-24T19:23:58.322946+0000","last_peered":"2026-02-24T19:23:58.322946+0000","last_clean":"2026-02-24T19:23:58.322946+0000","last_became_active":"2026-02-24T19:18:29.172298+0000","last_became_peered":"2026-02-24T19:18:29.172298+0000","last_unstale":"2026-02-24T19:23:58.322946+0000","last_undegraded":"2026-02-24T19:23:58.322946+0000","last_fullsized":"2026-02-24T19:23:58.322946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:53:31.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15],"acting":[8,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":636,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.400437+0000","last_change":"2026-02-24T19:17:51.889910+0000","last_active":"2026-02-24T19:23:59.400437+0000","last_peered":"2026-02-24T19:23:59.400437+0000","last_clean":"2026-02-24T19:23:59.400437+0000","last_became_active":"2026-02-24T19:17:49.867737+0000","last_became_peered":"2026-02-24T19:17:49.867737+0000","last_unstale":"2026-02-24T19:23:59.400437+0000","last_undegraded":"2026-02-24T19:23:59.400437+0000","last_fullsized":"2026-02-24T19:23:59.400437+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:43:43.357779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041050483999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.398466+0000","last_change":"2026-02-24T19:18:29.018360+0000","last_active":"2026-02-24T19:23:59.398466+0000","last_peered":"2026-02-24T19:23:59.398466+0000","last_clean":"2026-02-24T19:23:59.398466+0000","last_became_active":"2026-02-24T19:18:29.015809+0000","last_became_peered":"2026-02-24T19:18:29.015809+0000","last_unstale":"2026-02-24T19:23:59.398466+0000","last_undegraded":"2026-02-24T19:23:59.398466+0000","last_fullsized":"2026-02-24T19:23:59.398466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:52:29.814745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9],"acting":[15,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":636,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.403574+0000","last_change":"2026-02-24T19:17:51.895025+0000","last_active":"2026-02-24T19:23:59.403574+0000","last_peered":"2026-02-24T19:23:59.403574+0000","last_clean":"2026-02-24T19:23:59.403574+0000","last_became_active":"2026-02-24T19:17:49.822380+0000","last_became_peered":"2026-02-24T19:17:49.822380+0000","last_unstale":"2026-02-24T19:23:59.403574+0000","last_undegraded":"2026-02-24T19:23:59.403574+0000","last_fullsized":"2026-02-24T19:23:59.403574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:22:04.516051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031009920999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.676619+0000","last_change":"2026-02-24T19:18:28.599982+0000","last_active":"2026-02-24T19:23:59.676619+0000","last_peered":"2026-02-24T19:23:59.676619+0000","last_clean":"2026-02-24T19:23:59.676619+0000","last_became_active":"2026-02-24T19:18:28.578714+0000","last_became_peered":"2026-02-24T19:18:28.578714+0000","last_unstale":"2026-02-24T19:23:59.676619+0000","last_undegraded":"2026-02-24T19:23:59.676619+0000","last_fullsized":"2026-02-24T19:23:59.676619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:11:52.417883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":635,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.315985+0000","last_change":"2026-02-24T19:17:51.929779+0000","last_active":"2026-02-24T19:23:59.315985+0000","last_peered":"2026-02-24T19:23:59.315985+0000","last_clean":"2026-02-24T19:23:59.315985+0000","last_became_active":"2026-02-24T19:17:49.636104+0000","last_became_peered":"2026-02-24T19:17:49.636104+0000","last_unstale":"2026-02-24T19:23:59.315985+0000","last_undegraded":"2026-02-24T19:23:59.315985+0000","last_fullsized":"2026-02-24T19:23:59.315985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:53:57.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036145872000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":615,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.254381+0000","last_change":"2026-02-24T19:18:28.651861+0000","last_active":"2026-02-24T19:23:58.254381+0000","last_peered":"2026-02-24T19:23:58.254381+0000","last_clean":"2026-02-24T19:23:58.254381+0000","last_became_active":"2026-02-24T19:18:28.629954+0000","last_became_peered":"2026-02-24T19:18:28.629954+0000","last_unstale":"2026-02-24T19:23:58.254381+0000","last_undegraded":"2026-02-24T19:23:58.254381+0000","last_fullsized":"2026-02-24T19:23:58.254381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:13:40.801862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":632,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.321137+0000","last_change":"2026-02-24T19:17:51.735983+0000","last_active":"2026-02-24T19:23:58.321137+0000","last_peered":"2026-02-24T19:23:58.321137+0000","last_clean":"2026-02-24T19:23:58.321137+0000","last_became_active":"2026-02-24T19:17:49.848509+0000","last_became_peered":"2026-02-24T19:17:49.848509+0000","last_unstale":"2026-02-24T19:23:58.321137+0000","last_undegraded":"2026-02-24T19:23:58.321137+0000","last_fullsized":"2026-02-24T19:23:58.321137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:59:49.327706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032515259999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.306622+0000","last_change":"2026-02-24T19:18:29.182530+0000","last_active":"2026-02-24T19:23:59.306622+0000","last_peered":"2026-02-24T19:23:59.306622+0000","last_clean":"2026-02-24T19:23:59.306622+0000","last_became_active":"2026-02-24T19:18:29.176942+0000","last_became_peered":"2026-02-24T19:18:29.176942+0000","last_unstale":"2026-02-24T19:23:59.306622+0000","last_undegraded":"2026-02-24T19:23:59.306622+0000","last_fullsized":"2026-02-24T19:23:59.306622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:20:26.047180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,12],"acting":[9,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.389654+0000","last_change":"2026-02-24T19:18:29.901720+0000","last_active":"2026-02-24T19:23:59.389654+0000","last_peered":"2026-02-24T19:23:59.389654+0000","last_clean":"2026-02-24T19:23:59.389654+0000","last_became_active":"2026-02-24T19:18:29.899492+0000","last_became_peered":"2026-02-24T19:18:29.899492+0000","last_unstale":"2026-02-24T19:23:59.389654+0000","last_undegraded":"2026-02-24T19:23:59.389654+0000","last_fullsized":"2026-02-24T19:23:59.389654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:46:01.639570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14],"acting":[13,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.391170+0000","last_change":"2026-02-24T19:18:28.454346+0000","last_active":"2026-02-24T19:23:59.391170+0000","last_peered":"2026-02-24T19:23:59.391170+0000","last_clean":"2026-02-24T19:23:59.391170+0000","last_became_active":"2026-02-24T19:18:28.448515+0000","last_became_peered":"2026-02-24T19:18:28.448515+0000","last_unstale":"2026-02-24T19:23:59.391170+0000","last_undegraded":"2026-02-24T19:23:59.391170+0000","last_fullsized":"2026-02-24T19:23:59.391170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:54.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":614,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.329506+0000","last_change":"2026-02-24T19:18:28.813537+0000","last_active":"2026-02-24T19:23:59.329506+0000","last_peered":"2026-02-24T19:23:59.329506+0000","last_clean":"2026-02-24T19:23:59.329506+0000","last_became_active":"2026-02-24T19:18:28.805888+0000","last_became_peered":"2026-02-24T19:18:28.805888+0000","last_unstale":"2026-02-24T19:23:59.329506+0000","last_undegraded":"2026-02-24T19:23:59.329506+0000","last_fullsized":"2026-02-24T19:23:59.329506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:21:32.488493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1","version":"33'11","reported_seq":643,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.312144+0000","last_change":"2026-02-24T19:18:28.660457+0000","last_active":"2026-02-24T19:23:58.312144+0000","last_peered":"2026-02-24T19:23:58.312144+0000","last_clean":"2026-02-24T19:23:58.312144+0000","last_became_active":"2026-02-24T19:18:28.658257+0000","last_became_peered":"2026-02-24T19:18:28.658257+0000","last_unstale":"2026-02-24T19:23:58.312144+0000","last_undegraded":"2026-02-24T19:23:58.312144+0000","last_fullsized":"2026-02-24T19:23:58.312144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:56:37.770223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":618,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329992+0000","last_change":"2026-02-24T19:18:28.336280+0000","last_active":"2026-02-24T19:23:58.329992+0000","last_peered":"2026-02-24T19:23:58.329992+0000","last_clean":"2026-02-24T19:23:58.329992+0000","last_became_active":"2026-02-24T19:18:28.334029+0000","last_became_peered":"2026-02-24T19:18:28.334029+0000","last_unstale":"2026-02-24T19:23:58.329992+0000","last_undegraded":"2026-02-24T19:23:58.329992+0000","last_fullsized":"2026-02-24T19:23:58.329992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:54:32.836654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.329780+0000","last_change":"2026-02-24T19:18:28.729903+0000","last_active":"2026-02-24T19:23:58.329780+0000","last_peered":"2026-02-24T19:23:58.329780+0000","last_clean":"2026-02-24T19:23:58.329780+0000","last_became_active":"2026-02-24T19:18:28.727493+0000","last_became_peered":"2026-02-24T19:18:28.727493+0000","last_unstale":"2026-02-24T19:23:58.329780+0000","last_undegraded":"2026-02-24T19:23:58.329780+0000","last_fullsized":"2026-02-24T19:23:58.329780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:30:30.028759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.323713+0000","last_change":"2026-02-24T19:18:29.352492+0000","last_active":"2026-02-24T19:23:58.323713+0000","last_peered":"2026-02-24T19:23:58.323713+0000","last_clean":"2026-02-24T19:23:58.323713+0000","last_became_active":"2026-02-24T19:18:29.350423+0000","last_became_peered":"2026-02-24T19:18:29.350423+0000","last_unstale":"2026-02-24T19:23:58.323713+0000","last_undegraded":"2026-02-24T19:23:58.323713+0000","last_fullsized":"2026-02-24T19:23:58.323713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:16:25.791348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.676171+0000","last_change":"2026-02-24T19:18:29.505834+0000","last_active":"2026-02-24T19:23:59.676171+0000","last_peered":"2026-02-24T19:23:59.676171+0000","last_clean":"2026-02-24T19:23:59.676171+0000","last_became_active":"2026-02-24T19:18:29.503545+0000","last_became_peered":"2026-02-24T19:18:29.503545+0000","last_unstale":"2026-02-24T19:23:59.676171+0000","last_undegraded":"2026-02-24T19:23:59.676171+0000","last_fullsized":"2026-02-24T19:23:59.676171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:38:03.828269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":621,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.677349+0000","last_change":"2026-02-24T19:18:28.360041+0000","last_active":"2026-02-24T19:23:59.677349+0000","last_peered":"2026-02-24T19:23:59.677349+0000","last_clean":"2026-02-24T19:23:59.677349+0000","last_became_active":"2026-02-24T19:18:28.357637+0000","last_became_peered":"2026-02-24T19:18:28.357637+0000","last_unstale":"2026-02-24T19:23:59.677349+0000","last_undegraded":"2026-02-24T19:23:59.677349+0000","last_fullsized":"2026-02-24T19:23:59.677349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:35:29.378705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":615,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-24T19:23:59.677601+0000","last_change":"2026-02-24T19:18:30.010817+0000","last_active":"2026-02-24T19:23:59.677601+0000","last_peered":"2026-02-24T19:23:59.677601+0000","last_clean":"2026-02-24T19:23:59.677601+0000","last_became_active":"2026-02-24T19:18:30.008609+0000","last_became_peered":"2026-02-24T19:18:30.008609+0000","last_unstale":"2026-02-24T19:23:59.677601+0000","last_undegraded":"2026-02-24T19:23:59.677601+0000","last_fullsized":"2026-02-24T19:23:59.677601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:45:00.289172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":616,"reported_epoch":336,"state":"active+clean","last_fresh":"2026-02-24T19:23:58.321788+0000","last_change":"2026-02-24T19:18:29.239229+0000","last_active":"2026-02-24T19:23:58.321788+0000","last_peered":"2026-02-24T19:23:58.321788+0000","last_clean":"2026-02-24T19:23:58.321788+0000","last_became_active":"2026-02-24T19:18:29.237008+0000","last_became_peered":"2026-02-24T19:18:29.237008+0000","last_unstale":"2026-02-24T19:23:58.321788+0000","last_undegraded":"2026-02-24T19:23:58.321788+0000","last_fullsized":"2026-02-24T19:23:58.321788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:19:19.633721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":623,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:03.130699+0000","last_change":"2026-02-24T19:18:28.794132+0000","last_active":"2026-02-24T19:24:03.130699+0000","last_peered":"2026-02-24T19:24:03.130699+0000","last_clean":"2026-02-24T19:24:03.130699+0000","last_became_active":"2026-02-24T19:18:28.791994+0000","last_became_peered":"2026-02-24T19:18:28.791994+0000","last_unstale":"2026-02-24T19:24:03.130699+0000","last_undegraded":"2026-02-24T19:24:03.130699+0000","last_fullsized":"2026-02-24T19:24:03.130699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:37:30.793100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":864256,"data_stored":857120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280590,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6772,"kb_used_omap":3010,"kb_used_meta":23933,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6934528,"data_stored":4264433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3082938,"internal_metadata":24507718},"hb_peers":[0,2,3,4,5,6,7,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313294,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210814,"internal_metadata":27379842},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280591,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":211429,"internal_metadata":27379227},"hb_peers":[1,3,5,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33716,"kb_used_data":6756,"kb_used_omap":3011,"kb_used_meta":23932,"kb_avail":94338124,"statfs":{"total":96636764160,"available":96602238976,"internally_reserved":0,"allocated":6918144,"data_stored":4258324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3084121,"internal_metadata":24506535},"hb_peers":[1,2,3,4,5,6,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313294,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210351,"internal_metadata":27380305},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33780,"kb_used_data":6820,"kb_used_omap":110,"kb_used_meta":26833,"kb_avail":94338060,"statfs":{"total":96636764160,"available":96602173440,"internally_reserved":0,"allocated":6983680,"data_stored":4295884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113659,"internal_metadata":27476997},"hb_peers":[0,1,3,4,5,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208968,"internal_metadata":27381688},"hb_peers":[0,1,3,4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3084465,"internal_metadata":24506191},"hb_peers":[1,2,3,4,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33720,"kb_used_data":6760,"kb_used_omap":207,"kb_used_meta":26736,"kb_avail":94338120,"statfs":{"total":96636764160,"available":96602234880,"internally_reserved":0,"allocated":6922240,"data_stored":4254252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":212730,"internal_metadata":27377926},"hb_peers":[0,1,4,5,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":2920,"kb_used_meta":24023,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2990703,"internal_metadata":24599953},"hb_peers":[0,1,3,4,5,6,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313294,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33716,"kb_used_data":6756,"kb_used_omap":173,"kb_used_meta":26770,"kb_avail":94338124,"statfs":{"total":96636764160,"available":96602238976,"internally_reserved":0,"allocated":6918144,"data_stored":4254233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":177224,"internal_metadata":27413432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6772,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6934528,"data_stored":4264433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":211067,"internal_metadata":27379589},"hb_peers":[1,2,3,4,5,6,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313294,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34104,"kb_used_data":7144,"kb_used_omap":2877,"kb_used_meta":24066,"kb_avail":94337736,"statfs":{"total":96636764160,"available":96601841664,"internally_reserved":0,"allocated":7315456,"data_stored":4652068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2946222,"internal_metadata":24644434},"hb_peers":[0,2,3,4,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34184,"kb_used_data":7224,"kb_used_omap":5765,"kb_used_meta":21178,"kb_avail":94337656,"statfs":{"total":96636764160,"available":96601759744,"internally_reserved":0,"allocated":7397376,"data_stored":4723713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5904083,"internal_metadata":21686573},"hb_peers":[0,1,2,4,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313294,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33712,"kb_used_data":6752,"kb_used_omap":167,"kb_used_meta":26776,"kb_avail":94338128,"statfs":{"total":96636764160,"available":96602243072,"internally_reserved":0,"allocated":6914048,"data_stored":4254228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":172019,"internal_metadata":27418637},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280591,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33716,"kb_used_data":6756,"kb_used_omap":3014,"kb_used_meta":23929,"kb_avail":94338124,"statfs":{"total":96636764160,"available":96602238976,"internally_reserved":0,"allocated":6918144,"data_stored":4254247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087066,"internal_metadata":24503590},"hb_peers":[1,2,3,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:05.491 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:24:05.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.555+0000 7f7cf06b1640 10 monclient: get_monmap_and_config 2026-02-24T19:24:05.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.555+0000 7f7cf06b1640 10 monclient: build_initial_monmap 2026-02-24T19:24:05.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.555+0000 7f7cf06b1640 10 monclient: monmap: 2026-02-24T19:24:05.558 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:05.558 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.558 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:05.555791+0000 2026-02-24T19:24:05.559 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:05.555791+0000 2026-02-24T19:24:05.559 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:05.559 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.559 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:05.559 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:05.559 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:05.559 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 1 Processor -- start 2026-02-24T19:24:05.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 1 -- start start 2026-02-24T19:24:05.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 10 monclient: init 2026-02-24T19:24:05.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 10 monclient(hunting): picked mon.noname-b con 0x7f7ce8058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 10 monclient(hunting): picked mon.noname-a con 0x7f7ce80b0410 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 10 monclient(hunting): picked mon.noname-c con 0x7f7ce81626a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce81655c0 con 0x7f7ce80b0410 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce80b12b0 con 0x7f7ce8058da0 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce80b1590 con 0x7f7ce81626a0 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.556+0000 7f7cf06b1640 10 monclient(hunting): authenticate will time out at 4017.194794s 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.557+0000 7f7cee426640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f7ce8058da0 0x7f7ce81647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34898/0 (socket says 10.20.193.45:34898) 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.557+0000 7f7cee426640 1 -- 10.20.193.45:0/1360919916 learned_addr learned my addr 10.20.193.45:0/1360919916 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:05.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809977357 0 0) 0x7f7ce80b1590 con 0x7f7ce81626a0 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): my global_id is 26552 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cd0003610 con 0x7f7ce81626a0 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70051700 0 0) 0x7f7ce81655c0 con 0x7f7ce80b0410 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): my global_id is 30609 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce80b1590 con 0x7f7ce80b0410 2026-02-24T19:24:05.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3471337139 0 0) 0x7f7ce80b12b0 con 0x7f7ce8058da0 2026-02-24T19:24:05.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 10 monclient(hunting): my global_id is 28078 2026-02-24T19:24:05.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.558+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce81655c0 con 0x7f7ce8058da0 2026-02-24T19:24:05.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1829923964 0 0) 0x7f7cd0003610 con 0x7f7ce81626a0 2026-02-24T19:24:05.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 >> v1:10.20.193.114:6789/0 conn(0x7f7ce8058da0 legacy=0x7f7ce81647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 >> v1:10.20.193.45:6789/0 conn(0x7f7ce80b0410 legacy=0x7f7ce8164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 10 monclient: _finish_hunting 0 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 1 monclient: found mon.noname-c 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce80b1870 con 0x7f7ce81626a0 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 10 monclient: _finish_auth 0 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 10 monclient: _check_auth_tickets 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7ce4003170 con 0x7f7ce81626a0 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:05.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7ced424640 10 monclient: dump: 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7cf06b1640 5 monclient: authenticate success, global_id 26552 2026-02-24T19:24:05.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.560+0000 7f7cf06b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ce4003340 con 0x7f7ce81626a0 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7ced424640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7ced424640 1 -- 10.20.193.45:0/1360919916 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7ce4003780 con 0x7f7ce81626a0 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7ced424640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7ced424640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7ced424640 10 monclient: dump: 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.571 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7cf06b1640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7cf06b1640 4 set_mon_vals no callback set 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7cf06b1640 10 monclient: shutdown 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7cf06b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7cf06b1640 1 -- 10.20.193.45:0/1360919916 >> v1:10.20.193.179:6789/0 conn(0x7f7ce81626a0 legacy=0x7f7ce81c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7cf06b1640 1 -- 10.20.193.45:0/1360919916 shutdown_connections 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7cf06b1640 1 -- 10.20.193.45:0/1360919916 >> 10.20.193.45:0/1360919916 conn(0x7f7ce80b65f0 msgr2=0x7f7ce80b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:05.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7cf06b1640 1 -- 10.20.193.45:0/1360919916 shutdown_connections 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.561+0000 7f7cf06b1640 1 -- 10.20.193.45:0/1360919916 wait complete. 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient: build_initial_monmap 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient: monmap: 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:05.573 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 1 librados: starting msgr at 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 1 librados: starting objecter 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 1 Processor -- start 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 1 -- start start 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 1 librados: setting wanted keys 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 1 librados: calling monclient init 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient: init 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient(hunting): picked mon.noname-a con 0x7f7ce8058da0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:05.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient(hunting): picked mon.noname-b con 0x7f7ce80b0410 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient(hunting): picked mon.noname-c con 0x7f7ce81626a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce81417f0 con 0x7f7ce8058da0 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce8136e10 con 0x7f7ce80b0410 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce81370f0 con 0x7f7ce81626a0 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cf06b1640 10 monclient(hunting): authenticate will time out at 4017.200722s 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cee426640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f7ce8058da0 0x7f7ce80af890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45716/0 (socket says 10.20.193.45:45716) 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.562+0000 7f7cee426640 1 -- 10.20.193.45:0/69456169 learned_addr learned my addr 10.20.193.45:0/69456169 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.563+0000 7f7cceffd640 10 client.?.objecter ms_handle_connect 0x7f7ce8058da0 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.563+0000 7f7cceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.563+0000 7f7cceffd640 10 client.?.objecter ms_handle_connect 0x7f7ce80b0410 2026-02-24T19:24:05.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.563+0000 7f7cceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.563+0000 7f7cceffd640 10 client.?.objecter ms_handle_connect 0x7f7ce81626a0 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.563+0000 7f7cceffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387527509 0 0) 0x7f7ce81417f0 con 0x7f7ce8058da0 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): my global_id is 30612 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb8003610 con 0x7f7ce8058da0 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459831958 0 0) 0x7f7ce8136e10 con 0x7f7ce80b0410 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): my global_id is 28081 2026-02-24T19:24:05.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce81417f0 con 0x7f7ce80b0410 2026-02-24T19:24:05.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185690581 0 0) 0x7f7ce81370f0 con 0x7f7ce81626a0 2026-02-24T19:24:05.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:05.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:05.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:05.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 10 monclient(hunting): my global_id is 26555 2026-02-24T19:24:05.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.564+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce8136e10 con 0x7f7ce81626a0 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2918158927 0 0) 0x7f7ce81417f0 con 0x7f7ce80b0410 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ce81370f0 con 0x7f7ce80b0410 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7cdc003070 con 0x7f7ce80b0410 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): dump: 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.581 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1616603850 0 0) 0x7f7ce8136e10 con 0x7f7ce81626a0 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ce81417f0 con 0x7f7ce81626a0 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7ce40034f0 con 0x7f7ce81626a0 2026-02-24T19:24:05.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): dump: 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.583 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3345383805 0 0) 0x7f7cb8003610 con 0x7f7ce8058da0 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ce8136e10 con 0x7f7ce8058da0 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7cd8003000 con 0x7f7ce8058da0 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.566+0000 7f7cceffd640 10 monclient(hunting): dump: 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.584 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 987392706 0 0) 0x7f7ce81370f0 con 0x7f7ce80b0410 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 >> v1:10.20.193.179:6789/0 conn(0x7f7ce81626a0 legacy=0x7f7ce814a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 >> v1:10.20.193.45:6789/0 conn(0x7f7ce8058da0 legacy=0x7f7ce80af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 1 monclient: found mon.b 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:05.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce81373d0 con 0x7f7ce80b0410 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 5 monclient: authenticate success, global_id 28081 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 10 monclient: _renew_subs 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce81376b0 con 0x7f7ce80b0410 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 10 client.28081.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 10 monclient: _renew_subs 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7ce8136a90 con 0x7f7ce80b0410 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 1 librados: init done 2026-02-24T19:24:05.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.568+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce805a000 con 0x7f7ce80b0410 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.575+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cdc003210 con 0x7f7ce80b0410 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.575+0000 7f7cceffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.575+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f7cdc003890 con 0x7f7ce80b0410 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.575+0000 7f7cceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.575+0000 7f7cceffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.575+0000 7f7cecc23640 4 set_mon_vals no callback set 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.575+0000 7f7cceffd640 10 monclient: dump: 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:05.587 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.576+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f7cdc01c740 con 0x7f7ce80b0410 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.577+0000 7f7cee426640 10 monclient: get_auth_request con 0x7f7cb8077e90 auth_method 0 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.577+0000 7f7cceffd640 10 client.28081.objecter ms_handle_connect 0x7f7cb8077e90 2026-02-24T19:24:05.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.577+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f7cdc0920e0 con 0x7f7ce80b0410 2026-02-24T19:24:05.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.577+0000 7f7cceffd640 10 client.28081.objecter ms_dispatch2 0x7f7ce8000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:05.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.577+0000 7f7cceffd640 3 client.28081.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:05.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.577+0000 7f7cceffd640 3 client.28081.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:05.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.577+0000 7f7cceffd640 20 client.28081.objecter dump_active .. 0 homeless 2026-02-24T19:24:05.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.662+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7cdc05cb10 con 0x7f7ce80b0410 2026-02-24T19:24:05.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.662+0000 7f7cceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:05.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.662+0000 7f7cceffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:05.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.766+0000 7f7cf06b1640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:24:05.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.766+0000 7f7cf06b1640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:24:05.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.766+0000 7f7cf06b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:05.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.766+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ce8059d20 con 0x7f7ce80b0410 2026-02-24T19:24:05.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.789+0000 7f7cceffd640 1 -- 10.20.193.45:0/69456169 <== mon.1 v1:10.20.193.114:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v342) ==== 74+0+23536 (unknown 3944092366 0 3960244233) 0x7f7cdc05c410 con 0x7f7ce80b0410 2026-02-24T19:24:05.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.789+0000 7f7cceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:24:05.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.789+0000 7f7cceffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:24:05.792 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:24:05.792 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":342,"fsid":"738dd6f3-d81f-41eb-89dc-068883b21f11","created":"2026-02-24T19:17:05.025851+0000","modified":"2026-02-24T19:24:04.066736+0000","last_up_change":"2026-02-24T19:17:38.901135+0000","last_in_change":"2026-02-24T19:17:11.992117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":98,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":268,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:39.816057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T19:17:47.256373+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"ceph_test_rados_api_asio","create_time":"2026-02-24T19:18:26.218708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"53650ce1-deec-4943-ba8b-cdf389f4e5e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6805","nonce":3544790624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6806","nonce":3544790624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6808","nonce":3544790624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6807","nonce":3544790624}]},"public_addr":"10.20.193.45:6805/3544790624","cluster_addr":"10.20.193.45:6806/3544790624","heartbeat_back_addr":"10.20.193.45:6808/3544790624","heartbeat_front_addr":"10.20.193.45:6807/3544790624","state":["exists","up"]},{"osd":1,"uuid":"e3d2506e-9e10-4206-96d1-3dd8aa4d91cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6808","nonce":1876170727}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6809","nonce":1876170727}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6811","nonce":1876170727}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6810","nonce":1876170727}]},"public_addr":"10.20.193.114:6808/1876170727","cluster_addr":"10.20.193.114:6809/1876170727","heartbeat_back_addr":"10.20.193.114:6811/1876170727","heartbeat_front_addr":"10.20.193.114:6810/1876170727","state":["exists","up"]},{"osd":2,"uuid":"2fe7f095-bf74-4e4a-996c-c58438826e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6800","nonce":3913807646}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6801","nonce":3913807646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6803","nonce":3913807646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6802","nonce":3913807646}]},"public_addr":"10.20.193.179:6800/3913807646","cluster_addr":"10.20.193.179:6801/3913807646","heartbeat_back_addr":"10.20.193.179:6803/3913807646","heartbeat_front_addr":"10.20.193.179:6802/3913807646","state":["exists","up"]},{"osd":3,"uuid":"270148b3-6c77-4c1f-9d73-05d1c75990c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6804","nonce":3920278128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6805","nonce":3920278128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6807","nonce":3920278128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6806","nonce":3920278128}]},"public_addr":"10.20.193.194:6804/3920278128","cluster_addr":"10.20.193.194:6805/3920278128","heartbeat_back_addr":"10.20.193.194:6807/3920278128","heartbeat_front_addr":"10.20.193.194:6806/3920278128","state":["exists","up"]},{"osd":4,"uuid":"43b91f27-e730-4a81-a86b-b2fefdddd3e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":295,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6801","nonce":1236941460}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6802","nonce":1236941460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6804","nonce":1236941460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6803","nonce":1236941460}]},"public_addr":"10.20.193.45:6801/1236941460","cluster_addr":"10.20.193.45:6802/1236941460","heartbeat_back_addr":"10.20.193.45:6804/1236941460","heartbeat_front_addr":"10.20.193.45:6803/1236941460","state":["exists","up"]},{"osd":5,"uuid":"01c901c8-775a-4e42-b73a-5db3d938dbb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6804","nonce":3576632251}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6805","nonce":3576632251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6807","nonce":3576632251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6806","nonce":3576632251}]},"public_addr":"10.20.193.114:6804/3576632251","cluster_addr":"10.20.193.114:6805/3576632251","heartbeat_back_addr":"10.20.193.114:6807/3576632251","heartbeat_front_addr":"10.20.193.114:6806/3576632251","state":["exists","up"]},{"osd":6,"uuid":"b29d58d3-b5f9-428c-8246-910655dd5490","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6804","nonce":1928709825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6805","nonce":1928709825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6807","nonce":1928709825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6806","nonce":1928709825}]},"public_addr":"10.20.193.179:6804/1928709825","cluster_addr":"10.20.193.179:6805/1928709825","heartbeat_back_addr":"10.20.193.179:6807/1928709825","heartbeat_front_addr":"10.20.193.179:6806/1928709825","state":["exists","up"]},{"osd":7,"uuid":"f182ac9b-e6ee-461e-af0c-0ef4ef51c737","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6800","nonce":598300563}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6801","nonce":598300563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6803","nonce":598300563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6802","nonce":598300563}]},"public_addr":"10.20.193.194:6800/598300563","cluster_addr":"10.20.193.194:6801/598300563","heartbeat_back_addr":"10.20.193.194:6803/598300563","heartbeat_front_addr":"10.20.193.194:6802/598300563","state":["exists","up"]},{"osd":8,"uuid":"b812d673-950b-4168-9a5e-d3719d569a7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6809","nonce":1756229077}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6810","nonce":1756229077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6812","nonce":1756229077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6811","nonce":1756229077}]},"public_addr":"10.20.193.45:6809/1756229077","cluster_addr":"10.20.193.45:6810/1756229077","heartbeat_back_addr":"10.20.193.45:6812/1756229077","heartbeat_front_addr":"10.20.193.45:6811/1756229077","state":["exists","up"]},{"osd":9,"uuid":"442018bc-d405-49b3-8934-0ab83b4613eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6800","nonce":2864194603}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6801","nonce":2864194603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6803","nonce":2864194603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6802","nonce":2864194603}]},"public_addr":"10.20.193.114:6800/2864194603","cluster_addr":"10.20.193.114:6801/2864194603","heartbeat_back_addr":"10.20.193.114:6803/2864194603","heartbeat_front_addr":"10.20.193.114:6802/2864194603","state":["exists","up"]},{"osd":10,"uuid":"e5bf8aa9-8c19-494b-bd7a-c5da71af847b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6808","nonce":2982984950}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6809","nonce":2982984950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6811","nonce":2982984950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6810","nonce":2982984950}]},"public_addr":"10.20.193.179:6808/2982984950","cluster_addr":"10.20.193.179:6809/2982984950","heartbeat_back_addr":"10.20.193.179:6811/2982984950","heartbeat_front_addr":"10.20.193.179:6810/2982984950","state":["exists","up"]},{"osd":11,"uuid":"6cb63f95-82e0-483f-926b-94a88b3c54f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6812","nonce":1154629099}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6813","nonce":1154629099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6815","nonce":1154629099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6814","nonce":1154629099}]},"public_addr":"10.20.193.194:6812/1154629099","cluster_addr":"10.20.193.194:6813/1154629099","heartbeat_back_addr":"10.20.193.194:6815/1154629099","heartbeat_front_addr":"10.20.193.194:6814/1154629099","state":["exists","up"]},{"osd":12,"uuid":"b15b2174-466b-4e9a-9c6d-ed8caabe7b28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6813","nonce":2990889504}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6814","nonce":2990889504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6816","nonce":2990889504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.45:6815","nonce":2990889504}]},"public_addr":"10.20.193.45:6813/2990889504","cluster_addr":"10.20.193.45:6814/2990889504","heartbeat_back_addr":"10.20.193.45:6816/2990889504","heartbeat_front_addr":"10.20.193.45:6815/2990889504","state":["exists","up"]},{"osd":13,"uuid":"d4e5150e-a985-488e-a911-45bf3431c165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6812","nonce":3533295890}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6813","nonce":3533295890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6815","nonce":3533295890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.114:6814","nonce":3533295890}]},"public_addr":"10.20.193.114:6812/3533295890","cluster_addr":"10.20.193.114:6813/3533295890","heartbeat_back_addr":"10.20.193.114:6815/3533295890","heartbeat_front_addr":"10.20.193.114:6814/3533295890","state":["exists","up"]},{"osd":14,"uuid":"0d938446-8802-44bc-be90-db79361a5200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6812","nonce":1196591242}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6813","nonce":1196591242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6815","nonce":1196591242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.179:6814","nonce":1196591242}]},"public_addr":"10.20.193.179:6812/1196591242","cluster_addr":"10.20.193.179:6813/1196591242","heartbeat_back_addr":"10.20.193.179:6815/1196591242","heartbeat_front_addr":"10.20.193.179:6814/1196591242","state":["exists","up"]},{"osd":15,"uuid":"168bd4e0-e43c-4581-819c-9ed544805d2f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6808","nonce":4057136445}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6809","nonce":4057136445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6811","nonce":4057136445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.194:6810","nonce":4057136445}]},"public_addr":"10.20.193.194:6808/4057136445","cluster_addr":"10.20.193.194:6809/4057136445","heartbeat_back_addr":"10.20.193.194:6811/4057136445","heartbeat_front_addr":"10.20.193.194:6810/4057136445","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.220980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.228412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.338875+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.688002+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.014119+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.286056+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.427234+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.631440+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.219386+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.261939+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.709299+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.693747+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.443973+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.370797+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.581997+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:36.896088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":10,"snaps":[{"begin":2,"length":3}]},{"pool":19,"snaps":[{"begin":1,"length":1}]},{"pool":20,"snaps":[{"begin":2,"length":5}]},{"pool":59,"snaps":[{"begin":1,"length":1}]},{"pool":89,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":98,"snaps":[{"begin":1,"length":1}]},{"pool":115,"snaps":[{"begin":1,"length":2}]},{"pool":133,"snaps":[{"begin":3,"length":1}]},{"pool":134,"snaps":[{"begin":2,"length":3}]},{"pool":143,"snaps":[{"begin":2,"length":2}]},{"pool":154,"snaps":[{"begin":2,"length":3}]},{"pool":159,"snaps":[{"begin":2,"length":4}]},{"pool":165,"snaps":[{"begin":2,"length":2}]},{"pool":180,"snaps":[{"begin":2,"length":1}]},{"pool":185,"snaps":[{"begin":1,"length":4}]},{"pool":196,"snaps":[{"begin":4,"length":1},{"begin":6,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:24:05.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 10 librados: watch_flush enter 2026-02-24T19:24:05.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 10 librados: watch_flush exit 2026-02-24T19:24:05.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 20 client.28081.objecter shutdown clearing up homeless session... 2026-02-24T19:24:05.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 10 client.28081.objecter successfully canceled tick 2026-02-24T19:24:05.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 >> v1:10.20.193.45:6800/1599977652 conn(0x7f7cb8077e90 legacy=0x7f7cb8098340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 10 monclient: shutdown 2026-02-24T19:24:05.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:05.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 >> v1:10.20.193.114:6789/0 conn(0x7f7ce80b0410 legacy=0x7f7ce80ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:05.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 shutdown_connections 2026-02-24T19:24:05.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 >> 10.20.193.45:0/69456169 conn(0x7f7ce80b65f0 msgr2=0x7f7ce80559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:05.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 shutdown_connections 2026-02-24T19:24:05.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 1 -- 10.20.193.45:0/69456169 wait complete. 2026-02-24T19:24:05.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:05.790+0000 7f7cf06b1640 1 librados: shutdown 2026-02-24T19:24:06.803 INFO:tasks.ceph:Scrubbing osd.0 2026-02-24T19:24:06.803 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:06.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.873+0000 7f296ea3a640 10 monclient: get_monmap_and_config 2026-02-24T19:24:06.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.873+0000 7f296ea3a640 10 monclient: build_initial_monmap 2026-02-24T19:24:06.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.873+0000 7f296ea3a640 10 monclient: monmap: 2026-02-24T19:24:06.876 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:06.877 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:06.877 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:06.873979+0000 2026-02-24T19:24:06.877 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:06.873979+0000 2026-02-24T19:24:06.877 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:06.877 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:06.877 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:06.877 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:06.877 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:06.877 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:06.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 1 Processor -- start 2026-02-24T19:24:06.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 1 -- start start 2026-02-24T19:24:06.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 10 monclient: init 2026-02-24T19:24:06.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:06.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:06.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 10 monclient(hunting): picked mon.noname-a con 0x7f296815e2a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:06.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 10 monclient(hunting): picked mon.noname-b con 0x7f2968059e10 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:06.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 10 monclient(hunting): picked mon.noname-c con 0x7f29681a5660 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2968162df0 con 0x7f296815e2a0 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29681630d0 con 0x7f2968059e10 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29681633b0 con 0x7f29681a5660 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.874+0000 7f296ea3a640 10 monclient(hunting): authenticate will time out at 4018.512912s 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.875+0000 7f2967fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f296815e2a0 0x7f296805da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45718/0 (socket says 10.20.193.45:45718) 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.875+0000 7f2967fff640 1 -- 10.20.193.45:0/1597573887 learned_addr learned my addr 10.20.193.45:0/1597573887 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.876+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494275793 0 0) 0x7f2968162df0 con 0x7f296815e2a0 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.876+0000 7f2966ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.876+0000 7f2966ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:06.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.876+0000 7f2966ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.876+0000 7f2966ffd640 10 monclient(hunting): my global_id is 30615 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.876+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f294c003610 con 0x7f296815e2a0 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632860985 0 0) 0x7f29681633b0 con 0x7f29681a5660 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 10 monclient(hunting): my global_id is 26558 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2968162df0 con 0x7f29681a5660 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891716788 0 0) 0x7f29681630d0 con 0x7f2968059e10 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:06.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:06.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 10 monclient(hunting): my global_id is 28084 2026-02-24T19:24:06.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.877+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29681633b0 con 0x7f2968059e10 2026-02-24T19:24:06.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3728027281 0 0) 0x7f294c003610 con 0x7f296815e2a0 2026-02-24T19:24:06.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 >> v1:10.20.193.179:6789/0 conn(0x7f29681a5660 legacy=0x7f29681c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:06.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 >> v1:10.20.193.114:6789/0 conn(0x7f2968059e10 legacy=0x7f296815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:06.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:06.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 1 monclient: found mon.noname-a 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2968163690 con 0x7f296815e2a0 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2954002df0 con 0x7f296815e2a0 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f2966ffd640 10 monclient: dump: 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:06.888 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f296ea3a640 5 monclient: authenticate success, global_id 30615 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.878+0000 7f296ea3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:06.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2954002fc0 con 0x7f296815e2a0 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f2966ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f296ea3a640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f296ea3a640 4 set_mon_vals no callback set 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f2966ffd640 1 -- 10.20.193.45:0/1597573887 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2954003400 con 0x7f296815e2a0 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f2966ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f2966ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f2966ffd640 10 monclient: dump: 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.890 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f296ea3a640 10 monclient: shutdown 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f296ea3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f296ea3a640 1 -- 10.20.193.45:0/1597573887 >> v1:10.20.193.45:6789/0 conn(0x7f296815e2a0 legacy=0x7f296805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f296ea3a640 1 -- 10.20.193.45:0/1597573887 shutdown_connections 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f296ea3a640 1 -- 10.20.193.45:0/1597573887 >> 10.20.193.45:0/1597573887 conn(0x7f29680b2f60 msgr2=0x7f29680b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f296ea3a640 1 -- 10.20.193.45:0/1597573887 shutdown_connections 2026-02-24T19:24:06.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.879+0000 7f296ea3a640 1 -- 10.20.193.45:0/1597573887 wait complete. 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 10 monclient: build_initial_monmap 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 10 monclient: monmap: 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:06.892 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 1 librados: starting msgr at 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 1 librados: starting objecter 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 1 Processor -- start 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 1 -- start start 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 1 librados: setting wanted keys 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 1 librados: calling monclient init 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.880+0000 7f296ea3a640 10 monclient: init 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 10 monclient(hunting): picked mon.noname-c con 0x7f2968059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:06.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 10 monclient(hunting): picked mon.noname-a con 0x7f296815e2a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 10 monclient(hunting): picked mon.noname-b con 0x7f29681a5660 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296812e130 con 0x7f296815e2a0 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296812ad90 con 0x7f29681a5660 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29680a79e0 con 0x7f2968059e10 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296ea3a640 10 monclient(hunting): authenticate will time out at 4018.519129s 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296cfb0640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f29681a5660 0x7f29680b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34922/0 (socket says 10.20.193.45:34922) 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f296cfb0640 1 -- 10.20.193.45:0/2278380050 learned_addr learned my addr 10.20.193.45:0/2278380050 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f2964ff9640 10 client.?.objecter ms_handle_connect 0x7f29681a5660 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.881+0000 7f2964ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 10 client.?.objecter ms_handle_connect 0x7f296815e2a0 2026-02-24T19:24:06.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 10 client.?.objecter ms_handle_connect 0x7f2968059e10 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129901700 0 0) 0x7f296812ad90 con 0x7f29681a5660 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 10 monclient(hunting): my global_id is 28087 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.882+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2938003610 con 0x7f29681a5660 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850453380 0 0) 0x7f29681633b0 con 0x7f296815e2a0 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:06.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:06.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 10 monclient(hunting): my global_id is 30618 2026-02-24T19:24:06.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f296812ad90 con 0x7f296815e2a0 2026-02-24T19:24:06.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236795513 0 0) 0x7f29680a79e0 con 0x7f2968059e10 2026-02-24T19:24:06.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:06.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:06.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:06.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 10 monclient(hunting): my global_id is 26561 2026-02-24T19:24:06.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.883+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29681633b0 con 0x7f2968059e10 2026-02-24T19:24:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.885+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1075374792 0 0) 0x7f2938003610 con 0x7f29681a5660 2026-02-24T19:24:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.885+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29680a79e0 con 0x7f29681a5660 2026-02-24T19:24:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.885+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f295c003490 con 0x7f29681a5660 2026-02-24T19:24:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.885+0000 7f2964ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:06.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.885+0000 7f2964ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.885+0000 7f2964ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:06.900 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.885+0000 7f2964ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1966611292 0 0) 0x7f29681633b0 con 0x7f2968059e10 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2938003610 con 0x7f2968059e10 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2954003170 con 0x7f2968059e10 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.901 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1573052255 0 0) 0x7f296812ad90 con 0x7f296815e2a0 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29681633b0 con 0x7f296815e2a0 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2958002fb0 con 0x7f296815e2a0 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.886+0000 7f2964ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:06.902 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 60495203 0 0) 0x7f29680a79e0 con 0x7f29681a5660 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 >> v1:10.20.193.179:6789/0 conn(0x7f2968059e10 legacy=0x7f296812b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:06.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 >> v1:10.20.193.45:6789/0 conn(0x7f296815e2a0 legacy=0x7f2968057170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 1 monclient: found mon.b 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29680a7cc0 con 0x7f29681a5660 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 10 monclient: _finish_auth 0 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f2964ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 5 monclient: authenticate success, global_id 28087 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 10 monclient: _renew_subs 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:06.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f29680a7fa0 con 0x7f29681a5660 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 10 client.28087.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 10 monclient: _renew_subs 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f29680a87a0 con 0x7f29681a5660 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 1 librados: init done 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 10 client.28087.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 15 client.28087.objecter _session_command_op_assign -1 1 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 20 client.28087.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 10 client.28087.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.887+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2968192b50 con 0x7f29681a5660 2026-02-24T19:24:06.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.895+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2968192b50 con 0x7f29681a5660 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.895+0000 7f2964ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.895+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f295c003d30 con 0x7f29681a5660 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.895+0000 7f2964ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.895+0000 7f2964ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.895+0000 7f29667fc640 4 set_mon_vals no callback set 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.895+0000 7f2964ff9640 10 monclient: dump: 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:06.906 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:06.907 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:06.907 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:06.907 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:06.907 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:06.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.896+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f295c003f40 con 0x7f29681a5660 2026-02-24T19:24:06.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2967fff640 10 monclient: get_auth_request con 0x7f2938077ed0 auth_method 0 2026-02-24T19:24:06.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 10 client.28087.objecter ms_handle_connect 0x7f2938077ed0 2026-02-24T19:24:06.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f295c003d30 con 0x7f29681a5660 2026-02-24T19:24:06.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 10 client.28087.objecter ms_dispatch2 0x7f2968000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:06.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 3 client.28087.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 3 client.28087.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 10 client.28087.objecter checking command 1 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 20 client.28087.objecter _get_session s=0x7f29380a21a0 osd=0 3 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 20 client.28087.objecter put_session s=0x7f29380a21a0 osd=0 3 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 15 client.28087.objecter _session_command_op_remove -1 1 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 20 client.28087.objecter _get_session s=0x7f29380a21a0 osd=0 3 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 20 client.28087.objecter get_session s=0x7f29380a21a0 osd=0 3 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 15 client.28087.objecter _session_command_op_assign 0 1 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 20 client.28087.objecter put_session s=0x7f29380a21a0 osd=0 4 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 10 client.28087.objecter _send_command 1 2026-02-24T19:24:06.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.45:6805/3544790624 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29380c44b0 con 0x7f29380a2850 2026-02-24T19:24:06.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 20 client.28087.objecter dump_active .. 0 homeless 2026-02-24T19:24:06.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f295c059aa0 con 0x7f29681a5660 2026-02-24T19:24:06.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.897+0000 7f2964ff9640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:06.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.898+0000 7f29677fe640 10 monclient: get_auth_request con 0x7f29380a2850 auth_method 0 2026-02-24T19:24:06.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.899+0000 7f2964ff9640 10 client.28087.objecter ms_handle_connect 0x7f29380a2850 2026-02-24T19:24:06.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.908+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== osd.0 v1:10.20.193.45:6805/3544790624 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f29380c44b0 con 0x7f29380a2850 2026-02-24T19:24:06.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.908+0000 7f2964ff9640 10 client.28087.objecter ms_dispatch2 0x7f2968000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:06.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.908+0000 7f2964ff9640 10 client.28087.objecter _finish_command 1 = system:0 2026-02-24T19:24:06.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.908+0000 7f2964ff9640 20 client.28087.objecter put_session s=0x7f29380a21a0 osd=0 4 2026-02-24T19:24:06.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.908+0000 7f2964ff9640 15 client.28087.objecter _session_command_op_remove 0 1 2026-02-24T19:24:06.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 10 client.28087.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:06.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 15 client.28087.objecter _session_command_op_assign -1 2 2026-02-24T19:24:06.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 20 client.28087.objecter _get_session s=0x7f29380a21a0 osd=0 3 2026-02-24T19:24:06.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 20 client.28087.objecter put_session s=0x7f29380a21a0 osd=0 3 2026-02-24T19:24:06.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 20 client.28087.objecter _get_session s=0x7f29380a21a0 osd=0 3 2026-02-24T19:24:06.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 15 client.28087.objecter _session_command_op_remove -1 2 2026-02-24T19:24:06.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 20 client.28087.objecter get_session s=0x7f29380a21a0 osd=0 3 2026-02-24T19:24:06.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 15 client.28087.objecter _session_command_op_assign 0 2 2026-02-24T19:24:06.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 20 client.28087.objecter put_session s=0x7f29380a21a0 osd=0 4 2026-02-24T19:24:06.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 10 client.28087.objecter _send_command 2 2026-02-24T19:24:06.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.915+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 --> v1:10.20.193.45:6805/3544790624 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2968192870 con 0x7f29380a2850 2026-02-24T19:24:06.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f2964ff9640 1 -- 10.20.193.45:0/2278380050 <== osd.0 v1:10.20.193.45:6805/3544790624 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f2968192870 con 0x7f29380a2850 2026-02-24T19:24:06.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f2964ff9640 10 client.28087.objecter ms_dispatch2 0x7f2968000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:06.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f2964ff9640 10 client.28087.objecter _finish_command 2 = system:0 2026-02-24T19:24:06.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f2964ff9640 20 client.28087.objecter put_session s=0x7f29380a21a0 osd=0 4 2026-02-24T19:24:06.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f2964ff9640 15 client.28087.objecter _session_command_op_remove 0 2 2026-02-24T19:24:06.926 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:06.926 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:06.927 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:06.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 10 librados: watch_flush enter 2026-02-24T19:24:06.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 10 librados: watch_flush exit 2026-02-24T19:24:06.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 10 client.28087.objecter close_session for osd.0 2026-02-24T19:24:06.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 >> v1:10.20.193.45:6805/3544790624 conn(0x7f29380a2850 legacy=0x7f29380c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:06.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 20 client.28087.objecter put_session s=0x7f29380a21a0 osd=0 1 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 20 client.28087.objecter shutdown clearing up homeless session... 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 10 client.28087.objecter successfully canceled tick 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 >> v1:10.20.193.45:6800/1599977652 conn(0x7f2938077ed0 legacy=0x7f2938098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 10 monclient: shutdown 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 >> v1:10.20.193.114:6789/0 conn(0x7f29681a5660 legacy=0x7f29680b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296cfb0640 1 -- 10.20.193.45:0/2278380050 reap_dead start 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 shutdown_connections 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 >> 10.20.193.45:0/2278380050 conn(0x7f29680b2f60 msgr2=0x7f29680b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 shutdown_connections 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 1 -- 10.20.193.45:0/2278380050 wait complete. 2026-02-24T19:24:06.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.923+0000 7f296ea3a640 1 librados: shutdown 2026-02-24T19:24:06.934 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-24T19:24:07.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 10 monclient: get_monmap_and_config 2026-02-24T19:24:07.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 10 monclient: monmap: 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:06.999113+0000 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:06.999113+0000 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.002 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 1 Processor -- start 2026-02-24T19:24:07.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 1 -- start start 2026-02-24T19:24:07.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 10 monclient: init 2026-02-24T19:24:07.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:07.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 10 monclient(hunting): picked mon.noname-c con 0x7f1cf0157780 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 10 monclient(hunting): picked mon.noname-b con 0x7f1cf0157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 10 monclient(hunting): picked mon.noname-a con 0x7f1cf0164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf005de70 con 0x7f1cf0164d00 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:06.999+0000 7f1cf6e3c640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf0055b20 con 0x7f1cf0157b50 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.000+0000 7f1cf6e3c640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf0055e00 con 0x7f1cf0157780 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.000+0000 7f1cf6e3c640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.000+0000 7f1cf6e3c640 10 monclient(hunting): authenticate will time out at 4018.638011s 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.000+0000 7f1ce7fff640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f1cf0157b50 0x7f1cf01645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34928/0 (socket says 10.20.193.45:34928) 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.000+0000 7f1ce7fff640 1 -- 10.20.193.45:0/592839570 learned_addr learned my addr 10.20.193.45:0/592839570 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838643243 0 0) 0x7f1cf0055b20 con 0x7f1cf0157b50 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): my global_id is 28090 2026-02-24T19:24:07.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cdc003610 con 0x7f1cf0157b50 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286420089 0 0) 0x7f1cf005de70 con 0x7f1cf0164d00 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): my global_id is 30621 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cf0055b20 con 0x7f1cf0164d00 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854454362 0 0) 0x7f1cf0055e00 con 0x7f1cf0157780 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 10 monclient(hunting): my global_id is 26564 2026-02-24T19:24:07.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.001+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cf005de70 con 0x7f1cf0157780 2026-02-24T19:24:07.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3734211476 0 0) 0x7f1cf005de70 con 0x7f1cf0157780 2026-02-24T19:24:07.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 >> v1:10.20.193.114:6789/0 conn(0x7f1cf0157b50 legacy=0x7f1cf01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 >> v1:10.20.193.45:6789/0 conn(0x7f1cf0164d00 legacy=0x7f1cf01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 1 monclient: found mon.noname-c 2026-02-24T19:24:07.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf00560e0 con 0x7f1cf0157780 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f1ce0002d50 con 0x7f1cf0157780 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1ce77fe640 10 monclient: dump: 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.015 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1cf6e3c640 5 monclient: authenticate success, global_id 26564 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.003+0000 7f1cf6e3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ce0002f20 con 0x7f1cf0157780 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1ce77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1ce77fe640 1 -- 10.20.193.45:0/592839570 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f1ce0003360 con 0x7f1cf0157780 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1ce77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1ce77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1ce77fe640 10 monclient: dump: 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.017 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1cf6e3c640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1cf6e3c640 4 set_mon_vals no callback set 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1cf6e3c640 10 monclient: shutdown 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1cf6e3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/592839570 >> v1:10.20.193.179:6789/0 conn(0x7f1cf0157780 legacy=0x7f1cf0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/592839570 shutdown_connections 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/592839570 >> 10.20.193.45:0/592839570 conn(0x7f1cf00b2ef0 msgr2=0x7f1cf00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/592839570 shutdown_connections 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.004+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/592839570 wait complete. 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient: monmap: 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 1 librados: starting msgr at 2026-02-24T19:24:07.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 1 librados: starting objecter 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 1 Processor -- start 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 1 -- start start 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 1 librados: setting wanted keys 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 1 librados: calling monclient init 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient: init 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient(hunting): picked mon.noname-c con 0x7f1cf0157780 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient(hunting): picked mon.noname-b con 0x7f1cf0157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient(hunting): picked mon.noname-a con 0x7f1cf0164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf01358a0 con 0x7f1cf0164d00 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf0135b80 con 0x7f1cf0157b50 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf0135e60 con 0x7f1cf0157780 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.005+0000 7f1cf6e3c640 10 monclient(hunting): authenticate will time out at 4018.643846s 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.006+0000 7f1cf53b2640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f1cf0164d00 0x7f1cf005b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45748/0 (socket says 10.20.193.45:45748) 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.006+0000 7f1cf53b2640 1 -- 10.20.193.45:0/1120531944 learned_addr learned my addr 10.20.193.45:0/1120531944 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.006+0000 7f1ce57fa640 10 client.?.objecter ms_handle_connect 0x7f1cf0157780 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.006+0000 7f1ce57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.006+0000 7f1ce57fa640 10 client.?.objecter ms_handle_connect 0x7f1cf0164d00 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.006+0000 7f1ce57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.006+0000 7f1ce57fa640 10 client.?.objecter ms_handle_connect 0x7f1cf0157b50 2026-02-24T19:24:07.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.006+0000 7f1ce57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501573139 0 0) 0x7f1cf0135e60 con 0x7f1cf0157780 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): my global_id is 26567 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cc0003610 con 0x7f1cf0157780 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399955555 0 0) 0x7f1cf01358a0 con 0x7f1cf0164d00 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): my global_id is 30624 2026-02-24T19:24:07.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cf0135e60 con 0x7f1cf0164d00 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1580376154 0 0) 0x7f1cf0135b80 con 0x7f1cf0157b50 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 10 monclient(hunting): my global_id is 28093 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.007+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cf01358a0 con 0x7f1cf0157b50 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1457179363 0 0) 0x7f1cc0003610 con 0x7f1cf0157780 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1cf0135b80 con 0x7f1cf0157780 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f1ce0003270 con 0x7f1cf0157780 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:07.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 10 monclient(hunting): dump: 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.024 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4176153452 0 0) 0x7f1cf0135e60 con 0x7f1cf0164d00 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1cc0003610 con 0x7f1cf0164d00 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f1cec0033d0 con 0x7f1cf0164d00 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.009+0000 7f1ce57fa640 10 monclient(hunting): dump: 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.025 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.010+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2169340327 0 0) 0x7f1cf01358a0 con 0x7f1cf0157b50 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.010+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1cf0135e60 con 0x7f1cf0157b50 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.010+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f1cd80030b0 con 0x7f1cf0157b50 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.010+0000 7f1ce57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.010+0000 7f1ce57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.010+0000 7f1ce57fa640 10 monclient(hunting): dump: 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.026 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 932517754 0 0) 0x7f1cf0135b80 con 0x7f1cf0157780 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 >> v1:10.20.193.114:6789/0 conn(0x7f1cf0157b50 legacy=0x7f1cf00577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 >> v1:10.20.193.45:6789/0 conn(0x7f1cf0164d00 legacy=0x7f1cf005b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 1 monclient: found mon.c 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf0136140 con 0x7f1cf0157780 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1ce57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 5 monclient: authenticate success, global_id 26567 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 10 monclient: _renew_subs 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf0136420 con 0x7f1cf0157780 2026-02-24T19:24:07.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 10 client.26567.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:07.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 10 monclient: _renew_subs 2026-02-24T19:24:07.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1cf00580b0 con 0x7f1cf0157780 2026-02-24T19:24:07.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 1 librados: init done 2026-02-24T19:24:07.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.011+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf0161ea0 con 0x7f1cf0157780 2026-02-24T19:24:07.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.103+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ce0002ed0 con 0x7f1cf0157780 2026-02-24T19:24:07.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.103+0000 7f1ce57fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.103+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f1ce0003a60 con 0x7f1cf0157780 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.103+0000 7f1ce57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.103+0000 7f1ce57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.103+0000 7f1ce57fa640 10 monclient: dump: 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.107 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.108 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.108 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.108 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.103+0000 7f1ce6ffd640 4 set_mon_vals no callback set 2026-02-24T19:24:07.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.104+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f1ce0003c40 con 0x7f1cf0157780 2026-02-24T19:24:07.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.105+0000 7f1ce7fff640 10 monclient: get_auth_request con 0x7f1cc0077ed0 auth_method 0 2026-02-24T19:24:07.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.105+0000 7f1ce57fa640 10 client.26567.objecter ms_handle_connect 0x7f1cc0077ed0 2026-02-24T19:24:07.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.106+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f1ce0091ec0 con 0x7f1cf0157780 2026-02-24T19:24:07.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.106+0000 7f1ce57fa640 10 client.26567.objecter ms_dispatch2 0x7f1cf0000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:07.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.106+0000 7f1ce57fa640 3 client.26567.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:07.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.106+0000 7f1ce57fa640 3 client.26567.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:07.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.106+0000 7f1ce57fa640 20 client.26567.objecter dump_active .. 0 homeless 2026-02-24T19:24:07.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.107+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f1ce0003a60 con 0x7f1cf0157780 2026-02-24T19:24:07.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.107+0000 7f1ce57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.110 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.107+0000 7f1ce57fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:07.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.217+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f1cf005c7b0 con 0x7f1cc0077ed0 2026-02-24T19:24:07.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.217+0000 7f1ce57fa640 1 -- 10.20.193.45:0/1120531944 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f1cf005c7b0 con 0x7f1cc0077ed0 2026-02-24T19:24:07.220 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 0 to deep-scrub 2026-02-24T19:24:07.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 10 librados: watch_flush enter 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 10 librados: watch_flush exit 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 20 client.26567.objecter shutdown clearing up homeless session... 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 10 client.26567.objecter successfully canceled tick 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 >> v1:10.20.193.45:6800/1599977652 conn(0x7f1cc0077ed0 legacy=0x7f1cc0098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 10 monclient: shutdown 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 >> v1:10.20.193.179:6789/0 conn(0x7f1cf0157780 legacy=0x7f1cf00b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 shutdown_connections 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 >> 10.20.193.45:0/1120531944 conn(0x7f1cf00b2ef0 msgr2=0x7f1cf00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:07.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 shutdown_connections 2026-02-24T19:24:07.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 1 -- 10.20.193.45:0/1120531944 wait complete. 2026-02-24T19:24:07.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.218+0000 7f1cf6e3c640 1 librados: shutdown 2026-02-24T19:24:07.229 INFO:tasks.ceph:Scrubbing osd.4 2026-02-24T19:24:07.230 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:07.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.299+0000 7f3835204640 10 monclient: get_monmap_and_config 2026-02-24T19:24:07.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.299+0000 7f3835204640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.299+0000 7f3835204640 10 monclient: monmap: 2026-02-24T19:24:07.302 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.302 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:07.299542+0000 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:07.299542+0000 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.299+0000 7f3835204640 1 Processor -- start 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.299+0000 7f3835204640 1 -- start start 2026-02-24T19:24:07.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.299+0000 7f3835204640 10 monclient: init 2026-02-24T19:24:07.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 10 monclient(hunting): picked mon.noname-b con 0x7f383015e2a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 10 monclient(hunting): picked mon.noname-c con 0x7f3830059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 10 monclient(hunting): picked mon.noname-a con 0x7f38301a5660 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3830162df0 con 0x7f38301a5660 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38301630d0 con 0x7f383015e2a0 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38301633b0 con 0x7f3830059e10 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f3835204640 10 monclient(hunting): authenticate will time out at 4018.938477s 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f382ed76640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f383015e2a0 0x7f383005da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34938/0 (socket says 10.20.193.45:34938) 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.300+0000 7f382ed76640 1 -- 10.20.193.45:0/3525770198 learned_addr learned my addr 10.20.193.45:0/3525770198 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582947902 0 0) 0x7f38301630d0 con 0x7f383015e2a0 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): my global_id is 28096 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f381c003610 con 0x7f383015e2a0 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48229135 0 0) 0x7f3830162df0 con 0x7f38301a5660 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): my global_id is 30627 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38301630d0 con 0x7f38301a5660 2026-02-24T19:24:07.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027528686 0 0) 0x7f38301633b0 con 0x7f3830059e10 2026-02-24T19:24:07.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 10 monclient(hunting): my global_id is 26570 2026-02-24T19:24:07.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.302+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3830162df0 con 0x7f3830059e10 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2593009003 0 0) 0x7f381c003610 con 0x7f383015e2a0 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 >> v1:10.20.193.179:6789/0 conn(0x7f3830059e10 legacy=0x7f383015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 >> v1:10.20.193.45:6789/0 conn(0x7f38301a5660 legacy=0x7f38301c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 1 monclient: found mon.noname-b 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3830163690 con 0x7f383015e2a0 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3824002df0 con 0x7f383015e2a0 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f382dd74640 10 monclient: dump: 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.315 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f3835204640 5 monclient: authenticate success, global_id 28096 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.303+0000 7f3835204640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.304+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3824002fc0 con 0x7f383015e2a0 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.304+0000 7f382dd74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.304+0000 7f382dd74640 1 -- 10.20.193.45:0/3525770198 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3824003400 con 0x7f383015e2a0 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.304+0000 7f382dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.304+0000 7f382dd74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.304+0000 7f382dd74640 10 monclient: dump: 2026-02-24T19:24:07.316 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.304+0000 7f3835204640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.304+0000 7f3835204640 4 set_mon_vals no callback set 2026-02-24T19:24:07.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 10 monclient: shutdown 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 -- 10.20.193.45:0/3525770198 >> v1:10.20.193.114:6789/0 conn(0x7f383015e2a0 legacy=0x7f383005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 -- 10.20.193.45:0/3525770198 shutdown_connections 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 -- 10.20.193.45:0/3525770198 >> 10.20.193.45:0/3525770198 conn(0x7f38300b2f60 msgr2=0x7f38300b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 -- 10.20.193.45:0/3525770198 shutdown_connections 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 -- 10.20.193.45:0/3525770198 wait complete. 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 10 monclient: monmap: 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:07.318 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 librados: starting msgr at 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 librados: starting objecter 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 Processor -- start 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 -- start start 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 librados: setting wanted keys 2026-02-24T19:24:07.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 1 librados: calling monclient init 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.305+0000 7f3835204640 10 monclient: init 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 10 monclient(hunting): picked mon.noname-c con 0x7f3830059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 10 monclient(hunting): picked mon.noname-a con 0x7f383015e2a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 10 monclient(hunting): picked mon.noname-b con 0x7f38301a5660 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38300adf80 con 0x7f383015e2a0 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38300ae260 con 0x7f38301a5660 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38300ae540 con 0x7f3830059e10 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f3835204640 10 monclient(hunting): authenticate will time out at 4018.944361s 2026-02-24T19:24:07.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f382e575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f383015e2a0 0x7f38300b3330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45778/0 (socket says 10.20.193.45:45778) 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f382e575640 1 -- 10.20.193.45:0/2482918106 learned_addr learned my addr 10.20.193.45:0/2482918106 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f380f7fe640 10 client.?.objecter ms_handle_connect 0x7f383015e2a0 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.306+0000 7f380f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.307+0000 7f380f7fe640 10 client.?.objecter ms_handle_connect 0x7f3830059e10 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.307+0000 7f380f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.307+0000 7f380f7fe640 10 client.?.objecter ms_handle_connect 0x7f38301a5660 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.307+0000 7f380f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.307+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754344560 0 0) 0x7f38300adf80 con 0x7f383015e2a0 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): my global_id is 30630 2026-02-24T19:24:07.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37fc003610 con 0x7f383015e2a0 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338861643 0 0) 0x7f38300ae540 con 0x7f3830059e10 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): my global_id is 26573 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38300adf80 con 0x7f3830059e10 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569952734 0 0) 0x7f38300ae260 con 0x7f38301a5660 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 10 monclient(hunting): my global_id is 28099 2026-02-24T19:24:07.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.308+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38300ae540 con 0x7f38301a5660 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 668458382 0 0) 0x7f38300adf80 con 0x7f3830059e10 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38300ae260 con 0x7f3830059e10 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3824003310 con 0x7f3830059e10 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.323 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1687505073 0 0) 0x7f38300ae540 con 0x7f38301a5660 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38300adf80 con 0x7f38301a5660 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3820003430 con 0x7f38301a5660 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:07.324 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 655532924 0 0) 0x7f37fc003610 con 0x7f383015e2a0 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38300ae540 con 0x7f383015e2a0 2026-02-24T19:24:07.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f38180030c0 con 0x7f383015e2a0 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.310+0000 7f380f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.326 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.327 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4077022932 0 0) 0x7f38300ae260 con 0x7f3830059e10 2026-02-24T19:24:07.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 >> v1:10.20.193.114:6789/0 conn(0x7f38301a5660 legacy=0x7f38301a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 >> v1:10.20.193.45:6789/0 conn(0x7f383015e2a0 legacy=0x7f38300b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 1 monclient: found mon.c 2026-02-24T19:24:07.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38300ae820 con 0x7f3830059e10 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f380f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 5 monclient: authenticate success, global_id 26573 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 10 monclient: _renew_subs 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f38300aeb00 con 0x7f3830059e10 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 10 client.26573.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 10 monclient: _renew_subs 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3830190a70 con 0x7f3830059e10 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 1 librados: init done 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 10 client.26573.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 15 client.26573.objecter _session_command_op_assign -1 1 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 20 client.26573.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 10 client.26573.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.312+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3830192b90 con 0x7f3830059e10 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.320+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3830192b90 con 0x7f3830059e10 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.320+0000 7f380f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.320+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f3824002f80 con 0x7f3830059e10 2026-02-24T19:24:07.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.320+0000 7f380f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.320+0000 7f382d573640 4 set_mon_vals no callback set 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.320+0000 7f380f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.320+0000 7f380f7fe640 10 monclient: dump: 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.333 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.321+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f382401d850 con 0x7f3830059e10 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.321+0000 7f382e575640 10 monclient: get_auth_request con 0x7f37fc077e60 auth_method 0 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.321+0000 7f380f7fe640 10 client.26573.objecter ms_handle_connect 0x7f37fc077e60 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f3824092ed0 con 0x7f3830059e10 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 10 client.26573.objecter ms_dispatch2 0x7f3830000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 3 client.26573.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 3 client.26573.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 10 client.26573.objecter checking command 1 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 20 client.26573.objecter _get_session s=0x7f37fc0a2190 osd=4 3 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 20 client.26573.objecter put_session s=0x7f37fc0a2190 osd=4 3 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 15 client.26573.objecter _session_command_op_remove -1 1 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 20 client.26573.objecter _get_session s=0x7f37fc0a2190 osd=4 3 2026-02-24T19:24:07.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 20 client.26573.objecter get_session s=0x7f37fc0a2190 osd=4 3 2026-02-24T19:24:07.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 15 client.26573.objecter _session_command_op_assign 4 1 2026-02-24T19:24:07.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 20 client.26573.objecter put_session s=0x7f37fc0a2190 osd=4 4 2026-02-24T19:24:07.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 10 client.26573.objecter _send_command 1 2026-02-24T19:24:07.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.45:6801/1236941460 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37fc0c44a0 con 0x7f37fc0a2840 2026-02-24T19:24:07.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 20 client.26573.objecter dump_active .. 0 homeless 2026-02-24T19:24:07.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f382405cfd0 con 0x7f3830059e10 2026-02-24T19:24:07.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.322+0000 7f380f7fe640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:07.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.323+0000 7f382f577640 10 monclient: get_auth_request con 0x7f37fc0a2840 auth_method 0 2026-02-24T19:24:07.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.324+0000 7f380f7fe640 10 client.26573.objecter ms_handle_connect 0x7f37fc0a2840 2026-02-24T19:24:07.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.334+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== osd.4 v1:10.20.193.45:6801/1236941460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f37fc0c44a0 con 0x7f37fc0a2840 2026-02-24T19:24:07.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.334+0000 7f380f7fe640 10 client.26573.objecter ms_dispatch2 0x7f3830000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:07.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.334+0000 7f380f7fe640 10 client.26573.objecter _finish_command 1 = system:0 2026-02-24T19:24:07.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.334+0000 7f380f7fe640 20 client.26573.objecter put_session s=0x7f37fc0a2190 osd=4 4 2026-02-24T19:24:07.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.334+0000 7f380f7fe640 15 client.26573.objecter _session_command_op_remove 4 1 2026-02-24T19:24:07.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 10 client.26573.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:07.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 15 client.26573.objecter _session_command_op_assign -1 2 2026-02-24T19:24:07.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 20 client.26573.objecter _get_session s=0x7f37fc0a2190 osd=4 3 2026-02-24T19:24:07.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 20 client.26573.objecter put_session s=0x7f37fc0a2190 osd=4 3 2026-02-24T19:24:07.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 20 client.26573.objecter _get_session s=0x7f37fc0a2190 osd=4 3 2026-02-24T19:24:07.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 15 client.26573.objecter _session_command_op_remove -1 2 2026-02-24T19:24:07.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 20 client.26573.objecter get_session s=0x7f37fc0a2190 osd=4 3 2026-02-24T19:24:07.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 15 client.26573.objecter _session_command_op_assign 4 2 2026-02-24T19:24:07.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 20 client.26573.objecter put_session s=0x7f37fc0a2190 osd=4 4 2026-02-24T19:24:07.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 10 client.26573.objecter _send_command 2 2026-02-24T19:24:07.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.341+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 --> v1:10.20.193.45:6801/1236941460 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3830120c90 con 0x7f37fc0a2840 2026-02-24T19:24:07.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f380f7fe640 1 -- 10.20.193.45:0/2482918106 <== osd.4 v1:10.20.193.45:6801/1236941460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f3830120c90 con 0x7f37fc0a2840 2026-02-24T19:24:07.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f380f7fe640 10 client.26573.objecter ms_dispatch2 0x7f3830000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:07.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f380f7fe640 10 client.26573.objecter _finish_command 2 = system:0 2026-02-24T19:24:07.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f380f7fe640 20 client.26573.objecter put_session s=0x7f37fc0a2190 osd=4 4 2026-02-24T19:24:07.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f380f7fe640 15 client.26573.objecter _session_command_op_remove 4 2 2026-02-24T19:24:07.351 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:07.351 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:07.352 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:07.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 10 librados: watch_flush enter 2026-02-24T19:24:07.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 10 librados: watch_flush exit 2026-02-24T19:24:07.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 10 client.26573.objecter close_session for osd.4 2026-02-24T19:24:07.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 >> v1:10.20.193.45:6801/1236941460 conn(0x7f37fc0a2840 legacy=0x7f37fc0c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 20 client.26573.objecter put_session s=0x7f37fc0a2190 osd=4 1 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 20 client.26573.objecter shutdown clearing up homeless session... 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 10 client.26573.objecter successfully canceled tick 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 >> v1:10.20.193.45:6800/1599977652 conn(0x7f37fc077e60 legacy=0x7f37fc098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 10 monclient: shutdown 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 >> v1:10.20.193.179:6789/0 conn(0x7f3830059e10 legacy=0x7f3830190360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f382f577640 1 -- 10.20.193.45:0/2482918106 reap_dead start 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 shutdown_connections 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 >> 10.20.193.45:0/2482918106 conn(0x7f38300b2f60 msgr2=0x7f383015d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 shutdown_connections 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 1 -- 10.20.193.45:0/2482918106 wait complete. 2026-02-24T19:24:07.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.348+0000 7f3835204640 1 librados: shutdown 2026-02-24T19:24:07.359 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-24T19:24:07.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.425+0000 7f1504102640 10 monclient: get_monmap_and_config 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.425+0000 7f1504102640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.425+0000 7f1504102640 10 monclient: monmap: 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:07.425281+0000 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:07.425281+0000 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.428 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.429 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.429 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.425+0000 7f1504102640 1 Processor -- start 2026-02-24T19:24:07.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.425+0000 7f1504102640 1 -- start start 2026-02-24T19:24:07.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.425+0000 7f1504102640 10 monclient: init 2026-02-24T19:24:07.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:07.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 10 monclient(hunting): picked mon.noname-b con 0x7f14fc157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 10 monclient(hunting): picked mon.noname-c con 0x7f14fc157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 10 monclient(hunting): picked mon.noname-a con 0x7f14fc164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc05de70 con 0x7f14fc164d00 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc055b20 con 0x7f14fc157780 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc055e00 con 0x7f14fc157b50 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1504102640 10 monclient(hunting): authenticate will time out at 4019.064180s 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1502678640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f14fc164d00 0x7f14fc1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45794/0 (socket says 10.20.193.45:45794) 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.426+0000 7f1502678640 1 -- 10.20.193.45:0/3617955237 learned_addr learned my addr 10.20.193.45:0/3617955237 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.427+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961781035 0 0) 0x7f14fc055b20 con 0x7f14fc157780 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): my global_id is 28102 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e4003610 con 0x7f14fc157780 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466353314 0 0) 0x7f14fc05de70 con 0x7f14fc164d00 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): my global_id is 30633 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14fc055b20 con 0x7f14fc164d00 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475745397 0 0) 0x7f14fc055e00 con 0x7f14fc157b50 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 10 monclient(hunting): my global_id is 26576 2026-02-24T19:24:07.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.428+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14fc05de70 con 0x7f14fc157b50 2026-02-24T19:24:07.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.429+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 505232405 0 0) 0x7f14e4003610 con 0x7f14fc157780 2026-02-24T19:24:07.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.429+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 >> v1:10.20.193.179:6789/0 conn(0x7f14fc157b50 legacy=0x7f14fc1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.429+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 >> v1:10.20.193.45:6789/0 conn(0x7f14fc164d00 legacy=0x7f14fc1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 1 monclient: found mon.noname-b 2026-02-24T19:24:07.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14fc0560e0 con 0x7f14fc157780 2026-02-24T19:24:07.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f14ec002df0 con 0x7f14fc157780 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1500e75640 10 monclient: dump: 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.439 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1504102640 5 monclient: authenticate success, global_id 28102 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.430+0000 7f1504102640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14ec002fc0 con 0x7f14fc157780 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1500e75640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1500e75640 1 -- 10.20.193.45:0/3617955237 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f14ec003400 con 0x7f14fc157780 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1500e75640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1500e75640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:07.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1500e75640 10 monclient: dump: 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 4 set_mon_vals no callback set 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 10 monclient: shutdown 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 1 -- 10.20.193.45:0/3617955237 >> v1:10.20.193.114:6789/0 conn(0x7f14fc157780 legacy=0x7f14fc056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 1 -- 10.20.193.45:0/3617955237 shutdown_connections 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 1 -- 10.20.193.45:0/3617955237 >> 10.20.193.45:0/3617955237 conn(0x7f14fc0b2ef0 msgr2=0x7f14fc0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 1 -- 10.20.193.45:0/3617955237 shutdown_connections 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 1 -- 10.20.193.45:0/3617955237 wait complete. 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 10 monclient: monmap: 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:07.442 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 1 librados: starting msgr at 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 1 librados: starting objecter 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.431+0000 7f1504102640 1 Processor -- start 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 1 -- start start 2026-02-24T19:24:07.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 1 librados: setting wanted keys 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 1 librados: calling monclient init 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 10 monclient: init 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 10 monclient(hunting): picked mon.noname-a con 0x7f14fc157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 10 monclient(hunting): picked mon.noname-c con 0x7f14fc157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 10 monclient(hunting): picked mon.noname-b con 0x7f14fc164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc130b60 con 0x7f14fc157780 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc130e40 con 0x7f14fc164d00 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc131120 con 0x7f14fc157b50 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1504102640 10 monclient(hunting): authenticate will time out at 4019.070404s 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1501676640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f14fc157b50 0x7f14fc0ac7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:41926/0 (socket says 10.20.193.45:41926) 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1501676640 1 -- 10.20.193.45:0/2687265572 learned_addr learned my addr 10.20.193.45:0/2687265572 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f1501e77640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f14fc157780 0x7f14fc0ae8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45802/0 (socket says 10.20.193.45:45802) 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f14ea7fc640 10 client.?.objecter ms_handle_connect 0x7f14fc157780 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f14ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f14ea7fc640 10 client.?.objecter ms_handle_connect 0x7f14fc164d00 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.432+0000 7f14ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.433+0000 7f14ea7fc640 10 client.?.objecter ms_handle_connect 0x7f14fc157b50 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.433+0000 7f14ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.433+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652789526 0 0) 0x7f14fc130e40 con 0x7f14fc164d00 2026-02-24T19:24:07.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.433+0000 7f14ea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.433+0000 7f14ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.433+0000 7f14ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.433+0000 7f14ea7fc640 10 monclient(hunting): my global_id is 28105 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.433+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14cc003610 con 0x7f14fc164d00 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349836099 0 0) 0x7f14fc130b60 con 0x7f14fc157780 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 10 monclient(hunting): my global_id is 30636 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14fc130e40 con 0x7f14fc157780 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955253145 0 0) 0x7f14fc131120 con 0x7f14fc157b50 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 10 monclient(hunting): my global_id is 26579 2026-02-24T19:24:07.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.434+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14fc130b60 con 0x7f14fc157b50 2026-02-24T19:24:07.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2472176437 0 0) 0x7f14cc003610 con 0x7f14fc164d00 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14fc131120 con 0x7f14fc164d00 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f14f8003370 con 0x7f14fc164d00 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.450 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3687412113 0 0) 0x7f14fc130b60 con 0x7f14fc157b50 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14cc003610 con 0x7f14fc157b50 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f14f0003170 con 0x7f14fc157b50 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:07.451 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2690133614 0 0) 0x7f14fc130e40 con 0x7f14fc157780 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14fc130b60 con 0x7f14fc157780 2026-02-24T19:24:07.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f14ec003310 con 0x7f14fc157780 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.436+0000 7f14ea7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.453 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 204045624 0 0) 0x7f14fc131120 con 0x7f14fc164d00 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 >> v1:10.20.193.179:6789/0 conn(0x7f14fc157b50 legacy=0x7f14fc0ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 >> v1:10.20.193.45:6789/0 conn(0x7f14fc157780 legacy=0x7f14fc0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 1 monclient: found mon.b 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14fc131400 con 0x7f14fc164d00 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f14ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 5 monclient: authenticate success, global_id 28105 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 10 monclient: _renew_subs 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f14fc1316e0 con 0x7f14fc164d00 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 10 client.28105.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 10 monclient: _renew_subs 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f14fc156fd0 con 0x7f14fc164d00 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 1 librados: init done 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.438+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14fc0b5660 con 0x7f14fc164d00 2026-02-24T19:24:07.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.529+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14f80038b0 con 0x7f14fc164d00 2026-02-24T19:24:07.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.529+0000 7f14ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.529+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f14f8004df0 con 0x7f14fc164d00 2026-02-24T19:24:07.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.529+0000 7f14ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.529+0000 7f14ea7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:07.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.529+0000 7f14ea7fc640 10 monclient: dump: 2026-02-24T19:24:07.532 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.529+0000 7f14ebfff640 4 set_mon_vals no callback set 2026-02-24T19:24:07.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.530+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f14f801dc60 con 0x7f14fc164d00 2026-02-24T19:24:07.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.530+0000 7f1501e77640 10 monclient: get_auth_request con 0x7f14cc077d80 auth_method 0 2026-02-24T19:24:07.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.531+0000 7f14ea7fc640 10 client.28105.objecter ms_handle_connect 0x7f14cc077d80 2026-02-24T19:24:07.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.531+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f14f8093450 con 0x7f14fc164d00 2026-02-24T19:24:07.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.531+0000 7f14ea7fc640 10 client.28105.objecter ms_dispatch2 0x7f14fc000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:07.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.531+0000 7f14ea7fc640 3 client.28105.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:07.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.531+0000 7f14ea7fc640 3 client.28105.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:07.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.531+0000 7f14ea7fc640 20 client.28105.objecter dump_active .. 0 homeless 2026-02-24T19:24:07.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.533+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f14f805de80 con 0x7f14fc164d00 2026-02-24T19:24:07.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.533+0000 7f14ea7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.533+0000 7f14ea7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:07.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.642+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f14fc0b5380 con 0x7f14cc077d80 2026-02-24T19:24:07.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.642+0000 7f14ea7fc640 1 -- 10.20.193.45:0/2687265572 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f14fc0b5380 con 0x7f14cc077d80 2026-02-24T19:24:07.645 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 4 to deep-scrub 2026-02-24T19:24:07.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 10 librados: watch_flush enter 2026-02-24T19:24:07.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 10 librados: watch_flush exit 2026-02-24T19:24:07.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 20 client.28105.objecter shutdown clearing up homeless session... 2026-02-24T19:24:07.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 10 client.28105.objecter successfully canceled tick 2026-02-24T19:24:07.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 >> v1:10.20.193.45:6800/1599977652 conn(0x7f14cc077d80 legacy=0x7f14cc098230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 10 monclient: shutdown 2026-02-24T19:24:07.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:07.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 >> v1:10.20.193.114:6789/0 conn(0x7f14fc164d00 legacy=0x7f14fc1210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 shutdown_connections 2026-02-24T19:24:07.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 >> 10.20.193.45:0/2687265572 conn(0x7f14fc0b2ef0 msgr2=0x7f14fc058bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:07.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.643+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 shutdown_connections 2026-02-24T19:24:07.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.644+0000 7f1504102640 1 -- 10.20.193.45:0/2687265572 wait complete. 2026-02-24T19:24:07.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.644+0000 7f1504102640 1 librados: shutdown 2026-02-24T19:24:07.655 INFO:tasks.ceph:Scrubbing osd.8 2026-02-24T19:24:07.656 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:07.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.723+0000 7f33be4c9640 10 monclient: get_monmap_and_config 2026-02-24T19:24:07.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.723+0000 7f33be4c9640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.723+0000 7f33be4c9640 10 monclient: monmap: 2026-02-24T19:24:07.726 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.726 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.726 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:07.723693+0000 2026-02-24T19:24:07.726 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:07.723693+0000 2026-02-24T19:24:07.727 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.727 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.727 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.727 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.727 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.727 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 1 Processor -- start 2026-02-24T19:24:07.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 1 -- start start 2026-02-24T19:24:07.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 10 monclient: init 2026-02-24T19:24:07.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:07.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 10 monclient(hunting): picked mon.noname-a con 0x7f33b8159e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 10 monclient(hunting): picked mon.noname-c con 0x7f33b815a1e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 10 monclient(hunting): picked mon.noname-b con 0x7f33b8161ac0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b8055ab0 con 0x7f33b8159e10 2026-02-24T19:24:07.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b8055d50 con 0x7f33b8161ac0 2026-02-24T19:24:07.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b8056030 con 0x7f33b815a1e0 2026-02-24T19:24:07.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.724+0000 7f33be4c9640 10 monclient(hunting): authenticate will time out at 4019.362613s 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.725+0000 7f33bca3f640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f33b8161ac0 0x7f33b815fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34962/0 (socket says 10.20.193.45:34962) 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.725+0000 7f33bca3f640 1 -- 10.20.193.45:0/2879145070 learned_addr learned my addr 10.20.193.45:0/2879145070 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 599315412 0 0) 0x7f33b8056030 con 0x7f33b815a1e0 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 10 monclient(hunting): my global_id is 26582 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f339c003610 con 0x7f33b815a1e0 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600179402 0 0) 0x7f33b8055ab0 con 0x7f33b8159e10 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 10 monclient(hunting): my global_id is 30639 2026-02-24T19:24:07.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.726+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b8056030 con 0x7f33b8159e10 2026-02-24T19:24:07.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.727+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716033565 0 0) 0x7f33b8055d50 con 0x7f33b8161ac0 2026-02-24T19:24:07.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.727+0000 7f33b6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.727+0000 7f33b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.727+0000 7f33b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.727+0000 7f33b6ffd640 10 monclient(hunting): my global_id is 28108 2026-02-24T19:24:07.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.727+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b8055ab0 con 0x7f33b8161ac0 2026-02-24T19:24:07.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2493520356 0 0) 0x7f339c003610 con 0x7f33b815a1e0 2026-02-24T19:24:07.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 >> v1:10.20.193.114:6789/0 conn(0x7f33b8161ac0 legacy=0x7f33b815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 >> v1:10.20.193.45:6789/0 conn(0x7f33b8159e10 legacy=0x7f33b8059c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 1 monclient: found mon.noname-c 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b8056310 con 0x7f33b815a1e0 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f33a8002de0 con 0x7f33b815a1e0 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33b6ffd640 10 monclient: dump: 2026-02-24T19:24:07.740 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33be4c9640 5 monclient: authenticate success, global_id 26582 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.728+0000 7f33be4c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:07.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33a8002fb0 con 0x7f33b815a1e0 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33b6ffd640 1 -- 10.20.193.45:0/2879145070 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f33a80033f0 con 0x7f33b815a1e0 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33b6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33b6ffd640 10 monclient: dump: 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.742 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 4 set_mon_vals no callback set 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 10 monclient: shutdown 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 1 -- 10.20.193.45:0/2879145070 >> v1:10.20.193.179:6789/0 conn(0x7f33b815a1e0 legacy=0x7f33b81613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 1 -- 10.20.193.45:0/2879145070 shutdown_connections 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 1 -- 10.20.193.45:0/2879145070 >> 10.20.193.45:0/2879145070 conn(0x7f33b80b2f60 msgr2=0x7f33b80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 1 -- 10.20.193.45:0/2879145070 shutdown_connections 2026-02-24T19:24:07.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 1 -- 10.20.193.45:0/2879145070 wait complete. 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 10 monclient: monmap: 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 1 librados: starting msgr at 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 1 librados: starting objecter 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.729+0000 7f33be4c9640 1 Processor -- start 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 1 -- start start 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 1 librados: setting wanted keys 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 1 librados: calling monclient init 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 10 monclient: init 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 10 monclient(hunting): picked mon.noname-a con 0x7f33b8159e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 10 monclient(hunting): picked mon.noname-c con 0x7f33b815a1e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 10 monclient(hunting): picked mon.noname-b con 0x7f33b8161ac0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b8157f00 con 0x7f33b8159e10 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b81fbac0 con 0x7f33b8161ac0 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b81fbda0 con 0x7f33b815a1e0 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33be4c9640 10 monclient(hunting): authenticate will time out at 4019.368470s 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33b7fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f33b8159e10 0x7f33b81fb180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45820/0 (socket says 10.20.193.45:45820) 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33b7fff640 1 -- 10.20.193.45:0/1557127937 learned_addr learned my addr 10.20.193.45:0/1557127937 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33b4ff9640 10 client.?.objecter ms_handle_connect 0x7f33b8159e10 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33b4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33b4ff9640 10 client.?.objecter ms_handle_connect 0x7f33b8161ac0 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.730+0000 7f33b4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.731+0000 7f33b4ff9640 10 client.?.objecter ms_handle_connect 0x7f33b815a1e0 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.731+0000 7f33b4ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.731+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779098407 0 0) 0x7f33b8157f00 con 0x7f33b8159e10 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.731+0000 7f33b4ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.731+0000 7f33b4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.731+0000 7f33b4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.731+0000 7f33b4ff9640 10 monclient(hunting): my global_id is 30642 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.731+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3388003610 con 0x7f33b8159e10 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.731+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955382971 0 0) 0x7f33b81fbda0 con 0x7f33b815a1e0 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 10 monclient(hunting): my global_id is 26585 2026-02-24T19:24:07.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b8157f00 con 0x7f33b815a1e0 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578488810 0 0) 0x7f33b81fbac0 con 0x7f33b8161ac0 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 10 monclient(hunting): my global_id is 28111 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.732+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b81fbda0 con 0x7f33b8161ac0 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 384236521 0 0) 0x7f3388003610 con 0x7f33b8159e10 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33b81fbac0 con 0x7f33b8159e10 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f33a4003190 con 0x7f33b8159e10 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:07.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3008850410 0 0) 0x7f33b81fbda0 con 0x7f33b8161ac0 2026-02-24T19:24:07.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3388003610 con 0x7f33b8161ac0 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f33ac003330 con 0x7f33b8161ac0 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.750 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 973671709 0 0) 0x7f33b8157f00 con 0x7f33b815a1e0 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33b81fbda0 con 0x7f33b815a1e0 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f33a8003300 con 0x7f33b815a1e0 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.734+0000 7f33b4ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.751 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.735+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2428545108 0 0) 0x7f33b81fbac0 con 0x7f33b8159e10 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.735+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 >> v1:10.20.193.179:6789/0 conn(0x7f33b815a1e0 legacy=0x7f33b80a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.735+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 >> v1:10.20.193.114:6789/0 conn(0x7f33b8161ac0 legacy=0x7f33b805caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.735+0000 7f33b4ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.735+0000 7f33b4ff9640 1 monclient: found mon.a 2026-02-24T19:24:07.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.735+0000 7f33b4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33b4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b81fe810 con 0x7f33b8159e10 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33b4ff9640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33b4ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33b4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 5 monclient: authenticate success, global_id 30642 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 10 monclient: _renew_subs 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f33b81feaf0 con 0x7f33b8159e10 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 10 client.30642.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 10 monclient: _renew_subs 2026-02-24T19:24:07.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:07.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f33b805d1b0 con 0x7f33b8159e10 2026-02-24T19:24:07.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 1 librados: init done 2026-02-24T19:24:07.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 10 client.30642.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 15 client.30642.objecter _session_command_op_assign -1 1 2026-02-24T19:24:07.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 20 client.30642.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:07.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 10 client.30642.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:07.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:07.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.736+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f33b81fc080 con 0x7f33b8159e10 2026-02-24T19:24:07.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.744+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33b81fc080 con 0x7f33b8159e10 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.744+0000 7f33b4ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.744+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f33a40039b0 con 0x7f33b8159e10 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.744+0000 7f33b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.744+0000 7f33b4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.744+0000 7f33b4ff9640 10 monclient: dump: 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.757 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.744+0000 7f33b67fc640 4 set_mon_vals no callback set 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.745+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f33a4003b90 con 0x7f33b8159e10 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.746+0000 7f33b77fe640 10 monclient: get_auth_request con 0x7f3388077ea0 auth_method 0 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.746+0000 7f33b4ff9640 10 client.30642.objecter ms_handle_connect 0x7f3388077ea0 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f33a4093080 con 0x7f33b8159e10 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 10 client.30642.objecter ms_dispatch2 0x7f33b8000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:07.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 3 client.30642.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 3 client.30642.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 10 client.30642.objecter checking command 1 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 20 client.30642.objecter _get_session s=0x7f33880a2170 osd=8 3 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 20 client.30642.objecter put_session s=0x7f33880a2170 osd=8 3 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 15 client.30642.objecter _session_command_op_remove -1 1 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 20 client.30642.objecter _get_session s=0x7f33880a2170 osd=8 3 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 20 client.30642.objecter get_session s=0x7f33880a2170 osd=8 3 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 15 client.30642.objecter _session_command_op_assign 8 1 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 20 client.30642.objecter put_session s=0x7f33880a2170 osd=8 4 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 10 client.30642.objecter _send_command 1 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.45:6809/1756229077 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33880c4520 con 0x7f33880a2820 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 20 client.30642.objecter dump_active .. 0 homeless 2026-02-24T19:24:07.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f33a405cab0 con 0x7f33b8159e10 2026-02-24T19:24:07.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33b4ff9640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:07.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.747+0000 7f33bca3f640 10 monclient: get_auth_request con 0x7f33880a2820 auth_method 0 2026-02-24T19:24:07.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.749+0000 7f33b4ff9640 10 client.30642.objecter ms_handle_connect 0x7f33880a2820 2026-02-24T19:24:07.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.758+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== osd.8 v1:10.20.193.45:6809/1756229077 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f33880c4520 con 0x7f33880a2820 2026-02-24T19:24:07.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.758+0000 7f33b4ff9640 10 client.30642.objecter ms_dispatch2 0x7f33b8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:07.761 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.758+0000 7f33b4ff9640 10 client.30642.objecter _finish_command 1 = system:0 2026-02-24T19:24:07.761 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.758+0000 7f33b4ff9640 20 client.30642.objecter put_session s=0x7f33880a2170 osd=8 4 2026-02-24T19:24:07.761 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.758+0000 7f33b4ff9640 15 client.30642.objecter _session_command_op_remove 8 1 2026-02-24T19:24:07.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 10 client.30642.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:07.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 15 client.30642.objecter _session_command_op_assign -1 2 2026-02-24T19:24:07.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 20 client.30642.objecter _get_session s=0x7f33880a2170 osd=8 3 2026-02-24T19:24:07.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 20 client.30642.objecter put_session s=0x7f33880a2170 osd=8 3 2026-02-24T19:24:07.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 20 client.30642.objecter _get_session s=0x7f33880a2170 osd=8 3 2026-02-24T19:24:07.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 15 client.30642.objecter _session_command_op_remove -1 2 2026-02-24T19:24:07.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 20 client.30642.objecter get_session s=0x7f33880a2170 osd=8 3 2026-02-24T19:24:07.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 15 client.30642.objecter _session_command_op_assign 8 2 2026-02-24T19:24:07.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 20 client.30642.objecter put_session s=0x7f33880a2170 osd=8 4 2026-02-24T19:24:07.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 10 client.30642.objecter _send_command 2 2026-02-24T19:24:07.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.766+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 --> v1:10.20.193.45:6809/1756229077 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f33b8056c80 con 0x7f33880a2820 2026-02-24T19:24:07.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33b4ff9640 1 -- 10.20.193.45:0/1557127937 <== osd.8 v1:10.20.193.45:6809/1756229077 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f33b8056c80 con 0x7f33880a2820 2026-02-24T19:24:07.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33b4ff9640 10 client.30642.objecter ms_dispatch2 0x7f33b8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:07.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33b4ff9640 10 client.30642.objecter _finish_command 2 = system:0 2026-02-24T19:24:07.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33b4ff9640 20 client.30642.objecter put_session s=0x7f33880a2170 osd=8 4 2026-02-24T19:24:07.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33b4ff9640 15 client.30642.objecter _session_command_op_remove 8 2 2026-02-24T19:24:07.778 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:07.778 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:07.778 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:07.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 10 librados: watch_flush enter 2026-02-24T19:24:07.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 10 librados: watch_flush exit 2026-02-24T19:24:07.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 10 client.30642.objecter close_session for osd.8 2026-02-24T19:24:07.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 >> v1:10.20.193.45:6809/1756229077 conn(0x7f33880a2820 legacy=0x7f33880c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 20 client.30642.objecter put_session s=0x7f33880a2170 osd=8 1 2026-02-24T19:24:07.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 20 client.30642.objecter shutdown clearing up homeless session... 2026-02-24T19:24:07.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 10 client.30642.objecter successfully canceled tick 2026-02-24T19:24:07.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 >> v1:10.20.193.45:6800/1599977652 conn(0x7f3388077ea0 legacy=0x7f3388098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 10 monclient: shutdown 2026-02-24T19:24:07.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:07.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 >> v1:10.20.193.45:6789/0 conn(0x7f33b8159e10 legacy=0x7f33b81fb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33bca3f640 1 -- 10.20.193.45:0/1557127937 reap_dead start 2026-02-24T19:24:07.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 shutdown_connections 2026-02-24T19:24:07.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 >> 10.20.193.45:0/1557127937 conn(0x7f33b80b2f60 msgr2=0x7f33b8058000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:07.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 shutdown_connections 2026-02-24T19:24:07.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 1 -- 10.20.193.45:0/1557127937 wait complete. 2026-02-24T19:24:07.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.775+0000 7f33be4c9640 1 librados: shutdown 2026-02-24T19:24:07.786 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-24T19:24:07.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.852+0000 7fea53d9b640 10 monclient: get_monmap_and_config 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.852+0000 7fea53d9b640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.852+0000 7fea53d9b640 10 monclient: monmap: 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:07.852330+0000 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:07.852330+0000 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.855 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.856 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.852+0000 7fea53d9b640 1 Processor -- start 2026-02-24T19:24:07.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.852+0000 7fea53d9b640 1 -- start start 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.852+0000 7fea53d9b640 10 monclient: init 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 10 monclient(hunting): picked mon.noname-a con 0x7fea4c157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 10 monclient(hunting): picked mon.noname-c con 0x7fea4c157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 10 monclient(hunting): picked mon.noname-b con 0x7fea4c164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4c05de70 con 0x7fea4c157780 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4c055b20 con 0x7fea4c164d00 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4c055e00 con 0x7fea4c157b50 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea53d9b640 10 monclient(hunting): authenticate will time out at 4019.491218s 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea5130f640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fea4c157b50 0x7fea4c1645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:41950/0 (socket says 10.20.193.45:41950) 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.853+0000 7fea5130f640 1 -- 10.20.193.45:0/2431531707 learned_addr learned my addr 10.20.193.45:0/2431531707 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051836431 0 0) 0x7fea4c055e00 con 0x7fea4c157b50 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): my global_id is 26588 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea34003610 con 0x7fea4c157b50 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582984980 0 0) 0x7fea4c05de70 con 0x7fea4c157780 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): my global_id is 30645 2026-02-24T19:24:07.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea4c055e00 con 0x7fea4c157780 2026-02-24T19:24:07.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411407735 0 0) 0x7fea4c055b20 con 0x7fea4c164d00 2026-02-24T19:24:07.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 10 monclient(hunting): my global_id is 28114 2026-02-24T19:24:07.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.855+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea4c05de70 con 0x7fea4c164d00 2026-02-24T19:24:07.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 817557351 0 0) 0x7fea34003610 con 0x7fea4c157b50 2026-02-24T19:24:07.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 >> v1:10.20.193.114:6789/0 conn(0x7fea4c164d00 legacy=0x7fea4c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 >> v1:10.20.193.45:6789/0 conn(0x7fea4c157780 legacy=0x7fea4c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 1 monclient: found mon.noname-c 2026-02-24T19:24:07.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:07.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4c0560e0 con 0x7fea4c157b50 2026-02-24T19:24:07.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fea40002df0 con 0x7fea4c157b50 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: dump: 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.868 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea53d9b640 5 monclient: authenticate success, global_id 26588 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea53d9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea40002fc0 con 0x7fea4c157b50 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 1 -- 10.20.193.45:0/2431531707 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fea40003400 con 0x7fea4c157b50 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea53d9b640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea53d9b640 4 set_mon_vals no callback set 2026-02-24T19:24:07.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.857+0000 7fea50b0e640 10 monclient: dump: 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 10 monclient: shutdown 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 1 -- 10.20.193.45:0/2431531707 >> v1:10.20.193.179:6789/0 conn(0x7fea4c157b50 legacy=0x7fea4c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 1 -- 10.20.193.45:0/2431531707 shutdown_connections 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 1 -- 10.20.193.45:0/2431531707 >> 10.20.193.45:0/2431531707 conn(0x7fea4c0b2ef0 msgr2=0x7fea4c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 1 -- 10.20.193.45:0/2431531707 shutdown_connections 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 1 -- 10.20.193.45:0/2431531707 wait complete. 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 10 monclient: build_initial_monmap 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 10 monclient: monmap: 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:07.871 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 1 librados: starting msgr at 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 1 librados: starting objecter 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.858+0000 7fea53d9b640 1 Processor -- start 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 1 -- start start 2026-02-24T19:24:07.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 1 librados: setting wanted keys 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 1 librados: calling monclient init 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 10 monclient: init 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 10 monclient(hunting): picked mon.noname-b con 0x7fea4c157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 10 monclient(hunting): picked mon.noname-c con 0x7fea4c157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 10 monclient(hunting): picked mon.noname-a con 0x7fea4c164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4c145870 con 0x7fea4c164d00 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4c0ae9a0 con 0x7fea4c157780 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4c0aec80 con 0x7fea4c157b50 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:07.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea53d9b640 10 monclient(hunting): authenticate will time out at 4019.497406s 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea51b10640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fea4c157780 0x7fea4c1465f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34992/0 (socket says 10.20.193.45:34992) 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.859+0000 7fea51b10640 1 -- 10.20.193.45:0/776405960 learned_addr learned my addr 10.20.193.45:0/776405960 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.860+0000 7fea3a7fc640 10 client.?.objecter ms_handle_connect 0x7fea4c157780 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.860+0000 7fea3a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.860+0000 7fea3a7fc640 10 client.?.objecter ms_handle_connect 0x7fea4c164d00 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.860+0000 7fea3a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.860+0000 7fea3a7fc640 10 client.?.objecter ms_handle_connect 0x7fea4c157b50 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.860+0000 7fea3a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011326960 0 0) 0x7fea4c0ae9a0 con 0x7fea4c157780 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): my global_id is 28117 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea1c003610 con 0x7fea4c157780 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803118814 0 0) 0x7fea4c145870 con 0x7fea4c164d00 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): my global_id is 30648 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea4c0ae9a0 con 0x7fea4c164d00 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317034421 0 0) 0x7fea4c0aec80 con 0x7fea4c157b50 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:07.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 10 monclient(hunting): my global_id is 26591 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.861+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea4c145870 con 0x7fea4c157b50 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4043375329 0 0) 0x7fea1c003610 con 0x7fea4c157780 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea4c0aec80 con 0x7fea4c157780 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fea3c003160 con 0x7fea4c157780 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.876 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1417871852 0 0) 0x7fea4c0ae9a0 con 0x7fea4c164d00 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea1c003610 con 0x7fea4c164d00 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fea48003330 con 0x7fea4c164d00 2026-02-24T19:24:07.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.863+0000 7fea3a7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.864+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 49471065 0 0) 0x7fea4c145870 con 0x7fea4c157b50 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.864+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea4c0ae9a0 con 0x7fea4c157b50 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.864+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fea40003310 con 0x7fea4c157b50 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.864+0000 7fea3a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.864+0000 7fea3a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.864+0000 7fea3a7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.879 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.880 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.880 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.880 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2370903988 0 0) 0x7fea4c0aec80 con 0x7fea4c157780 2026-02-24T19:24:07.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 >> v1:10.20.193.179:6789/0 conn(0x7fea4c157b50 legacy=0x7fea4c13a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 >> v1:10.20.193.45:6789/0 conn(0x7fea4c164d00 legacy=0x7fea4c147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 1 monclient: found mon.b 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4c145b10 con 0x7fea4c157780 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea3a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 5 monclient: authenticate success, global_id 28117 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 10 monclient: _renew_subs 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea4c145df0 con 0x7fea4c157780 2026-02-24T19:24:07.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 10 client.28117.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:07.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 10 monclient: _renew_subs 2026-02-24T19:24:07.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fea4c146d00 con 0x7fea4c157780 2026-02-24T19:24:07.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 1 librados: init done 2026-02-24T19:24:07.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:07.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.865+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea4c055b20 con 0x7fea4c157780 2026-02-24T19:24:07.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.958+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea3c003510 con 0x7fea4c157780 2026-02-24T19:24:07.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.958+0000 7fea3a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:07.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.958+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fea3c003b50 con 0x7fea4c157780 2026-02-24T19:24:07.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.958+0000 7fea3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:07.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.958+0000 7fea3a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:07.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.958+0000 7fea3a7fc640 10 monclient: dump: 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:07.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.958+0000 7fea3bfff640 4 set_mon_vals no callback set 2026-02-24T19:24:07.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.959+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fea3c003d30 con 0x7fea4c157780 2026-02-24T19:24:07.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.960+0000 7fea5130f640 10 monclient: get_auth_request con 0x7fea1c077ed0 auth_method 0 2026-02-24T19:24:07.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.960+0000 7fea3a7fc640 10 client.28117.objecter ms_handle_connect 0x7fea1c077ed0 2026-02-24T19:24:07.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.960+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fea3c0931c0 con 0x7fea4c157780 2026-02-24T19:24:07.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.960+0000 7fea3a7fc640 10 client.28117.objecter ms_dispatch2 0x7fea4c000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:07.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.960+0000 7fea3a7fc640 3 client.28117.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:07.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.960+0000 7fea3a7fc640 3 client.28117.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:07.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.960+0000 7fea3a7fc640 20 client.28117.objecter dump_active .. 0 homeless 2026-02-24T19:24:07.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.961+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fea4c055b20 con 0x7fea4c157780 2026-02-24T19:24:07.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.961+0000 7fea3a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:07.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:07.961+0000 7fea3a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:08.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.065+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7fea4c146fe0 con 0x7fea1c077ed0 2026-02-24T19:24:08.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.065+0000 7fea3a7fc640 1 -- 10.20.193.45:0/776405960 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (unknown 1222854447 0 0) 0x7fea4c146fe0 con 0x7fea1c077ed0 2026-02-24T19:24:08.069 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 8 to deep-scrub 2026-02-24T19:24:08.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 10 librados: watch_flush enter 2026-02-24T19:24:08.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 10 librados: watch_flush exit 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 20 client.28117.objecter shutdown clearing up homeless session... 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 10 client.28117.objecter successfully canceled tick 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 >> v1:10.20.193.45:6800/1599977652 conn(0x7fea1c077ed0 legacy=0x7fea1c098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 10 monclient: shutdown 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 >> v1:10.20.193.114:6789/0 conn(0x7fea4c157780 legacy=0x7fea4c1465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 shutdown_connections 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 >> 10.20.193.45:0/776405960 conn(0x7fea4c0b2ef0 msgr2=0x7fea4c13bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 shutdown_connections 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 1 -- 10.20.193.45:0/776405960 wait complete. 2026-02-24T19:24:08.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.066+0000 7fea53d9b640 1 librados: shutdown 2026-02-24T19:24:08.079 INFO:tasks.ceph:Scrubbing osd.12 2026-02-24T19:24:08.079 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:08.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.147+0000 7fe7b094d640 10 monclient: get_monmap_and_config 2026-02-24T19:24:08.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.147+0000 7fe7b094d640 10 monclient: build_initial_monmap 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.147+0000 7fe7b094d640 10 monclient: monmap: 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:08.148354+0000 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:08.148354+0000 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:08.151 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.147+0000 7fe7b094d640 1 Processor -- start 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.147+0000 7fe7b094d640 1 -- start start 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.147+0000 7fe7b094d640 10 monclient: init 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 10 monclient(hunting): picked mon.noname-b con 0x7fe7a815e2a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 10 monclient(hunting): picked mon.noname-c con 0x7fe7a8059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 10 monclient(hunting): picked mon.noname-a con 0x7fe7a81a5660 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a8162df0 con 0x7fe7a81a5660 2026-02-24T19:24:08.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a81630d0 con 0x7fe7a815e2a0 2026-02-24T19:24:08.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a81633b0 con 0x7fe7a8059e10 2026-02-24T19:24:08.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:08.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7b094d640 10 monclient(hunting): authenticate will time out at 4019.787303s 2026-02-24T19:24:08.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7aeec3640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe7a81a5660 0x7fe7a81c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45856/0 (socket says 10.20.193.45:45856) 2026-02-24T19:24:08.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.148+0000 7fe7aeec3640 1 -- 10.20.193.45:0/1767748608 learned_addr learned my addr 10.20.193.45:0/1767748608 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042743678 0 0) 0x7fe7a81633b0 con 0x7fe7a8059e10 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 10 monclient(hunting): my global_id is 26594 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe798003610 con 0x7fe7a8059e10 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224912742 0 0) 0x7fe7a81630d0 con 0x7fe7a815e2a0 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 10 monclient(hunting): my global_id is 28120 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.150+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7a81633b0 con 0x7fe7a815e2a0 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2785416908 0 0) 0x7fe798003610 con 0x7fe7a8059e10 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 >> v1:10.20.193.114:6789/0 conn(0x7fe7a815e2a0 legacy=0x7fe7a805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 >> v1:10.20.193.45:6789/0 conn(0x7fe7a81a5660 legacy=0x7fe7a81c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 10 monclient: _finish_hunting 0 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 1 monclient: found mon.noname-c 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a8163690 con 0x7fe7a8059e10 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 10 monclient: _finish_auth 0 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 10 monclient: _check_auth_tickets 2026-02-24T19:24:08.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe794002df0 con 0x7fe7a8059e10 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7ad6c0640 10 monclient: dump: 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.160 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7b094d640 5 monclient: authenticate success, global_id 26594 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.151+0000 7fe7b094d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.152+0000 7fe7ad6c0640 1 -- 10.20.193.45:0/1767748608 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe794003000 con 0x7fe7a8059e10 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.152+0000 7fe7ad6c0640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.152+0000 7fe7b094d640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.152+0000 7fe7b094d640 4 set_mon_vals no callback set 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 10 monclient: shutdown 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 -- 10.20.193.45:0/1767748608 >> v1:10.20.193.179:6789/0 conn(0x7fe7a8059e10 legacy=0x7fe7a815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 -- 10.20.193.45:0/1767748608 shutdown_connections 2026-02-24T19:24:08.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 -- 10.20.193.45:0/1767748608 >> 10.20.193.45:0/1767748608 conn(0x7fe7a80b2f60 msgr2=0x7fe7a80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 -- 10.20.193.45:0/1767748608 shutdown_connections 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 -- 10.20.193.45:0/1767748608 wait complete. 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 10 monclient: build_initial_monmap 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 10 monclient: monmap: 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:08.162 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 librados: starting msgr at 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 librados: starting objecter 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 Processor -- start 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 -- start start 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 librados: setting wanted keys 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 1 librados: calling monclient init 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.153+0000 7fe7b094d640 10 monclient: init 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 10 monclient(hunting): picked mon.noname-c con 0x7fe7a8059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:08.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 10 monclient(hunting): picked mon.noname-b con 0x7fe7a815e2a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 10 monclient(hunting): picked mon.noname-a con 0x7fe7a81a5660 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a8129470 con 0x7fe7a81a5660 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a8129750 con 0x7fe7a815e2a0 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7a8129a30 con 0x7fe7a8059e10 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7b094d640 10 monclient(hunting): authenticate will time out at 4019.793292s 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7adec1640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fe7a815e2a0 0x7fe7a812a7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:34998/0 (socket says 10.20.193.45:34998) 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe7adec1640 1 -- 10.20.193.45:0/2568396775 learned_addr learned my addr 10.20.193.45:0/2568396775 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe792ffd640 10 client.?.objecter ms_handle_connect 0x7fe7a815e2a0 2026-02-24T19:24:08.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.154+0000 7fe792ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.155+0000 7fe792ffd640 10 client.?.objecter ms_handle_connect 0x7fe7a8059e10 2026-02-24T19:24:08.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.155+0000 7fe792ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.155+0000 7fe792ffd640 10 client.?.objecter ms_handle_connect 0x7fe7a81a5660 2026-02-24T19:24:08.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.155+0000 7fe792ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.156+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834535292 0 0) 0x7fe7a8129470 con 0x7fe7a81a5660 2026-02-24T19:24:08.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.156+0000 7fe792ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.156+0000 7fe792ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.156+0000 7fe792ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.156+0000 7fe792ffd640 10 monclient(hunting): my global_id is 30654 2026-02-24T19:24:08.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.156+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe778003610 con 0x7fe7a81a5660 2026-02-24T19:24:08.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.187+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2309389662 0 0) 0x7fe778003610 con 0x7fe7a81a5660 2026-02-24T19:24:08.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.187+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7a8129470 con 0x7fe7a81a5660 2026-02-24T19:24:08.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.187+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe79c003250 con 0x7fe7a81a5660 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.187+0000 7fe792ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.187+0000 7fe792ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.187+0000 7fe792ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.192 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.193 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.187+0000 7fe792ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:08.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4049600592 0 0) 0x7fe7a8129470 con 0x7fe7a81a5660 2026-02-24T19:24:08.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 >> v1:10.20.193.179:6789/0 conn(0x7fe7a8059e10 legacy=0x7fe7a8191e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 >> v1:10.20.193.114:6789/0 conn(0x7fe7a815e2a0 legacy=0x7fe7a812a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 1 monclient: found mon.a 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a8129d10 con 0x7fe7a81a5660 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe792ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe7b094d640 5 monclient: authenticate success, global_id 30654 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe7b094d640 10 monclient: _renew_subs 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe7b094d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a8129ff0 con 0x7fe7a81a5660 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe7b094d640 10 client.30654.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:08.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe7b094d640 10 monclient: _renew_subs 2026-02-24T19:24:08.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe7b094d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:08.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe7a812af00 con 0x7fe7a81a5660 2026-02-24T19:24:08.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.189+0000 7fe7b094d640 1 librados: init done 2026-02-24T19:24:08.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.190+0000 7fe7b094d640 10 client.30654.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:08.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.190+0000 7fe7b094d640 15 client.30654.objecter _session_command_op_assign -1 1 2026-02-24T19:24:08.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.190+0000 7fe7b094d640 20 client.30654.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:08.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.190+0000 7fe7b094d640 10 client.30654.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:08.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.190+0000 7fe7b094d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:08.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.190+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe7a8129220 con 0x7fe7a81a5660 2026-02-24T19:24:08.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.198+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7a8129220 con 0x7fe7a81a5660 2026-02-24T19:24:08.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.198+0000 7fe792ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:08.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.198+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe79c004c50 con 0x7fe7a81a5660 2026-02-24T19:24:08.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.198+0000 7fe792ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.198+0000 7fe792ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.198+0000 7fe7acebf640 4 set_mon_vals no callback set 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.198+0000 7fe792ffd640 10 monclient: dump: 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.202 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.203 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.198+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fe79c004e60 con 0x7fe7a81a5660 2026-02-24T19:24:08.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.199+0000 7fe7ae6c2640 10 monclient: get_auth_request con 0x7fe778077c30 auth_method 0 2026-02-24T19:24:08.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.199+0000 7fe792ffd640 10 client.30654.objecter ms_handle_connect 0x7fe778077c30 2026-02-24T19:24:08.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fe79c093470 con 0x7fe7a81a5660 2026-02-24T19:24:08.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 10 client.30654.objecter ms_dispatch2 0x7fe7a8000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 3 client.30654.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 3 client.30654.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 10 client.30654.objecter checking command 1 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 20 client.30654.objecter _get_session s=0x7fe7780a1f00 osd=12 3 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 20 client.30654.objecter put_session s=0x7fe7780a1f00 osd=12 3 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 15 client.30654.objecter _session_command_op_remove -1 1 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 20 client.30654.objecter _get_session s=0x7fe7780a1f00 osd=12 3 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 20 client.30654.objecter get_session s=0x7fe7780a1f00 osd=12 3 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 15 client.30654.objecter _session_command_op_assign 12 1 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 20 client.30654.objecter put_session s=0x7fe7780a1f00 osd=12 4 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 10 client.30654.objecter _send_command 1 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 --> v1:10.20.193.45:6813/2990889504 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7780c42b0 con 0x7fe7780a25b0 2026-02-24T19:24:08.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 20 client.30654.objecter dump_active .. 0 homeless 2026-02-24T19:24:08.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fe79c05d570 con 0x7fe7a81a5660 2026-02-24T19:24:08.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe792ffd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:08.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.200+0000 7fe7adec1640 10 monclient: get_auth_request con 0x7fe7780a25b0 auth_method 0 2026-02-24T19:24:08.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.201+0000 7fe792ffd640 10 client.30654.objecter ms_handle_connect 0x7fe7780a25b0 2026-02-24T19:24:08.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.211+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== osd.12 v1:10.20.193.45:6813/2990889504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe7780c42b0 con 0x7fe7780a25b0 2026-02-24T19:24:08.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.211+0000 7fe792ffd640 10 client.30654.objecter ms_dispatch2 0x7fe7a8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:08.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.211+0000 7fe792ffd640 10 client.30654.objecter _finish_command 1 = system:0 2026-02-24T19:24:08.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.211+0000 7fe792ffd640 20 client.30654.objecter put_session s=0x7fe7780a1f00 osd=12 4 2026-02-24T19:24:08.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.211+0000 7fe792ffd640 15 client.30654.objecter _session_command_op_remove 12 1 2026-02-24T19:24:08.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 10 client.30654.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 15 client.30654.objecter _session_command_op_assign -1 2 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 20 client.30654.objecter _get_session s=0x7fe7780a1f00 osd=12 3 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 20 client.30654.objecter put_session s=0x7fe7780a1f00 osd=12 3 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 20 client.30654.objecter _get_session s=0x7fe7780a1f00 osd=12 3 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 15 client.30654.objecter _session_command_op_remove -1 2 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 20 client.30654.objecter get_session s=0x7fe7780a1f00 osd=12 3 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 15 client.30654.objecter _session_command_op_assign 12 2 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 20 client.30654.objecter put_session s=0x7fe7780a1f00 osd=12 4 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 10 client.30654.objecter _send_command 2 2026-02-24T19:24:08.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.218+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 --> v1:10.20.193.45:6813/2990889504 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe7a80afa10 con 0x7fe7780a25b0 2026-02-24T19:24:08.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe792ffd640 1 -- 10.20.193.45:0/2568396775 <== osd.12 v1:10.20.193.45:6813/2990889504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe794003fb0 con 0x7fe7780a25b0 2026-02-24T19:24:08.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe792ffd640 10 client.30654.objecter ms_dispatch2 0x7fe7a8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:08.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe792ffd640 10 client.30654.objecter _finish_command 2 = system:0 2026-02-24T19:24:08.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe792ffd640 20 client.30654.objecter put_session s=0x7fe7780a1f00 osd=12 4 2026-02-24T19:24:08.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe792ffd640 15 client.30654.objecter _session_command_op_remove 12 2 2026-02-24T19:24:08.230 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:08.230 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:08.230 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 10 librados: watch_flush enter 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 10 librados: watch_flush exit 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 10 client.30654.objecter close_session for osd.12 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 >> v1:10.20.193.45:6813/2990889504 conn(0x7fe7780a25b0 legacy=0x7fe7780c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 20 client.30654.objecter put_session s=0x7fe7780a1f00 osd=12 1 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 20 client.30654.objecter shutdown clearing up homeless session... 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 10 client.30654.objecter successfully canceled tick 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 >> v1:10.20.193.45:6800/1599977652 conn(0x7fe778077c30 legacy=0x7fe7780980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 10 monclient: shutdown 2026-02-24T19:24:08.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:08.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 >> v1:10.20.193.45:6789/0 conn(0x7fe7a81a5660 legacy=0x7fe7a81a49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7aeec3640 1 -- 10.20.193.45:0/2568396775 reap_dead start 2026-02-24T19:24:08.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 shutdown_connections 2026-02-24T19:24:08.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 >> 10.20.193.45:0/2568396775 conn(0x7fe7a80b2f60 msgr2=0x7fe7a80b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:08.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 shutdown_connections 2026-02-24T19:24:08.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 1 -- 10.20.193.45:0/2568396775 wait complete. 2026-02-24T19:24:08.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.226+0000 7fe7b094d640 1 librados: shutdown 2026-02-24T19:24:08.238 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-24T19:24:08.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.302+0000 7f02a7513640 10 monclient: get_monmap_and_config 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.302+0000 7f02a7513640 10 monclient: build_initial_monmap 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.302+0000 7f02a7513640 10 monclient: monmap: 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:08.303529+0000 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:08.303529+0000 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:08.306 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:08.307 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.302+0000 7f02a7513640 1 Processor -- start 2026-02-24T19:24:08.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.302+0000 7f02a7513640 1 -- start start 2026-02-24T19:24:08.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.302+0000 7f02a7513640 10 monclient: init 2026-02-24T19:24:08.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:08.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:08.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 10 monclient(hunting): picked mon.noname-b con 0x7f02a0157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:08.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 10 monclient(hunting): picked mon.noname-a con 0x7f02a0157b50 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:08.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 10 monclient(hunting): picked mon.noname-c con 0x7f02a0164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a005de70 con 0x7f02a0157b50 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a0055b20 con 0x7f02a0157780 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a0055e00 con 0x7f02a0164d00 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a7513640 10 monclient(hunting): authenticate will time out at 4019.942437s 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a4a87640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f02a0157b50 0x7f02a01645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45878/0 (socket says 10.20.193.45:45878) 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.303+0000 7f02a4a87640 1 -- 10.20.193.45:0/4188488228 learned_addr learned my addr 10.20.193.45:0/4188488228 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2309569382 0 0) 0x7f02a0055e00 con 0x7f02a0164d00 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): my global_id is 26597 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0288003610 con 0x7f02a0164d00 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450214781 0 0) 0x7f02a005de70 con 0x7f02a0157b50 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): my global_id is 30657 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a0055e00 con 0x7f02a0157b50 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 906726437 0 0) 0x7f02a0055b20 con 0x7f02a0157780 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 10 monclient(hunting): my global_id is 28123 2026-02-24T19:24:08.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.305+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a005de70 con 0x7f02a0157780 2026-02-24T19:24:08.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3747263791 0 0) 0x7f02a005de70 con 0x7f02a0157780 2026-02-24T19:24:08.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 >> v1:10.20.193.179:6789/0 conn(0x7f02a0164d00 legacy=0x7f02a01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 >> v1:10.20.193.45:6789/0 conn(0x7f02a0157b50 legacy=0x7f02a01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:08.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 1 monclient: found mon.noname-b 2026-02-24T19:24:08.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a00560e0 con 0x7f02a0157780 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 10 monclient: _finish_auth 0 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f0290002dd0 con 0x7f02a0157780 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f028ffff640 10 monclient: dump: 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.318 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f02a7513640 5 monclient: authenticate success, global_id 28123 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.306+0000 7f02a7513640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.307+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0290002fa0 con 0x7f02a0157780 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.307+0000 7f028ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.307+0000 7f028ffff640 1 -- 10.20.193.45:0/4188488228 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f02900033e0 con 0x7f02a0157780 2026-02-24T19:24:08.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.307+0000 7f02a7513640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.307+0000 7f028ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.307+0000 7f02a7513640 4 set_mon_vals no callback set 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.307+0000 7f028ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.307+0000 7f028ffff640 10 monclient: dump: 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.320 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 10 monclient: shutdown 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 -- 10.20.193.45:0/4188488228 >> v1:10.20.193.114:6789/0 conn(0x7f02a0157780 legacy=0x7f02a0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 -- 10.20.193.45:0/4188488228 shutdown_connections 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 -- 10.20.193.45:0/4188488228 >> 10.20.193.45:0/4188488228 conn(0x7f02a00b2ef0 msgr2=0x7f02a00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 -- 10.20.193.45:0/4188488228 shutdown_connections 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 -- 10.20.193.45:0/4188488228 wait complete. 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 10 monclient: build_initial_monmap 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 10 monclient: monmap: 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:08.321 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 librados: starting msgr at 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 librados: starting objecter 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 Processor -- start 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 -- start start 2026-02-24T19:24:08.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 librados: setting wanted keys 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 1 librados: calling monclient init 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.308+0000 7f02a7513640 10 monclient: init 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 10 monclient(hunting): picked mon.noname-b con 0x7f02a0157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 10 monclient(hunting): picked mon.noname-a con 0x7f02a0157b50 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 10 monclient(hunting): picked mon.noname-c con 0x7f02a0164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a0058140 con 0x7f02a0157b50 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a0146c90 con 0x7f02a0157780 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a0146f70 con 0x7f02a0164d00 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a7513640 10 monclient(hunting): authenticate will time out at 4019.948285s 2026-02-24T19:24:08.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a4a87640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f02a0157b50 0x7f02a014a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45882/0 (socket says 10.20.193.45:45882) 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f02a4a87640 1 -- 10.20.193.45:0/4086262095 learned_addr learned my addr 10.20.193.45:0/4086262095 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f028dffb640 10 client.?.objecter ms_handle_connect 0x7f02a0157b50 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f028dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f028dffb640 10 client.?.objecter ms_handle_connect 0x7f02a0164d00 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.309+0000 7f028dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 client.?.objecter ms_handle_connect 0x7f02a0157780 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214931192 0 0) 0x7f02a0058140 con 0x7f02a0157b50 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 monclient(hunting): my global_id is 30660 2026-02-24T19:24:08.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0270003610 con 0x7f02a0157b50 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078496527 0 0) 0x7f02a0146f70 con 0x7f02a0164d00 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 10 monclient(hunting): my global_id is 26600 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.310+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a0058140 con 0x7f02a0164d00 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.311+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330146567 0 0) 0x7f02a0146c90 con 0x7f02a0157780 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.311+0000 7f028dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.311+0000 7f028dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.311+0000 7f028dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.311+0000 7f028dffb640 10 monclient(hunting): my global_id is 28126 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.311+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a0146f70 con 0x7f02a0157780 2026-02-24T19:24:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 346817919 0 0) 0x7f02a0058140 con 0x7f02a0164d00 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02a0146c90 con 0x7f02a0164d00 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3911502957 0 0) 0x7f0270003610 con 0x7f02a0157b50 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02a0058140 con 0x7f02a0157b50 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f02940030f0 con 0x7f02a0157b50 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): dump: 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.326 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f029c0033d0 con 0x7f02a0164d00 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): dump: 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.327 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1719460392 0 0) 0x7f02a0146f70 con 0x7f02a0157780 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0270003610 con 0x7f02a0157780 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f02900032f0 con 0x7f02a0157780 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.313+0000 7f028dffb640 10 monclient(hunting): dump: 2026-02-24T19:24:08.328 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.329 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.329 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.329 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.329 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.329 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.329 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.329 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.329 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.329 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4291954008 0 0) 0x7f02a0146c90 con 0x7f02a0164d00 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 >> v1:10.20.193.114:6789/0 conn(0x7f02a0157780 legacy=0x7f02a0146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 >> v1:10.20.193.45:6789/0 conn(0x7f02a0157b50 legacy=0x7f02a014a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 1 monclient: found mon.c 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a0147250 con 0x7f02a0164d00 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:08.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f028dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 5 monclient: authenticate success, global_id 26600 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 10 monclient: _renew_subs 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02a01359e0 con 0x7f02a0164d00 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 10 client.26600.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 10 monclient: _renew_subs 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f02a013acf0 con 0x7f02a0164d00 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 1 librados: init done 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:08.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.315+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a015ea20 con 0x7f02a0164d00 2026-02-24T19:24:08.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.405+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f029c0038d0 con 0x7f02a0164d00 2026-02-24T19:24:08.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.405+0000 7f028dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:08.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.405+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f029c003c20 con 0x7f02a0164d00 2026-02-24T19:24:08.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.405+0000 7f028dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.405+0000 7f028f7fe640 4 set_mon_vals no callback set 2026-02-24T19:24:08.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.405+0000 7f028dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:08.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.405+0000 7f028dffb640 10 monclient: dump: 2026-02-24T19:24:08.409 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.410 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.410 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.410 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.410 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.410 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.410 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.410 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.410 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.410 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.406+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f029c01ca90 con 0x7f02a0164d00 2026-02-24T19:24:08.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.406+0000 7f02a5288640 10 monclient: get_auth_request con 0x7f0270077ef0 auth_method 0 2026-02-24T19:24:08.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.407+0000 7f028dffb640 10 client.26600.objecter ms_handle_connect 0x7f0270077ef0 2026-02-24T19:24:08.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.407+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f029c0921d0 con 0x7f02a0164d00 2026-02-24T19:24:08.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.407+0000 7f028dffb640 10 client.26600.objecter ms_dispatch2 0x7f02a0000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:08.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.407+0000 7f028dffb640 3 client.26600.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:08.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.407+0000 7f028dffb640 3 client.26600.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:08.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.407+0000 7f028dffb640 20 client.26600.objecter dump_active .. 0 homeless 2026-02-24T19:24:08.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.408+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f029c05cc00 con 0x7f02a0164d00 2026-02-24T19:24:08.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.408+0000 7f028dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:08.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.408+0000 7f028dffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:08.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.515+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7f02a0056660 con 0x7f0270077ef0 2026-02-24T19:24:08.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.515+0000 7f028dffb640 1 -- 10.20.193.45:0/4086262095 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (unknown 660425183 0 0) 0x7f0290005820 con 0x7f0270077ef0 2026-02-24T19:24:08.519 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 12 to deep-scrub 2026-02-24T19:24:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 10 librados: watch_flush enter 2026-02-24T19:24:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 10 librados: watch_flush exit 2026-02-24T19:24:08.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 20 client.26600.objecter shutdown clearing up homeless session... 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 10 client.26600.objecter successfully canceled tick 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 >> v1:10.20.193.45:6800/1599977652 conn(0x7f0270077ef0 legacy=0x7f02700983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 10 monclient: shutdown 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 >> v1:10.20.193.179:6789/0 conn(0x7f02a0164d00 legacy=0x7f02a0057a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 shutdown_connections 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 >> 10.20.193.45:0/4086262095 conn(0x7f02a00b2ef0 msgr2=0x7f02a013b890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 shutdown_connections 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 1 -- 10.20.193.45:0/4086262095 wait complete. 2026-02-24T19:24:08.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.516+0000 7f02a7513640 1 librados: shutdown 2026-02-24T19:24:08.528 INFO:tasks.ceph:Scrubbing osd.1 2026-02-24T19:24:08.529 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:08.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.594+0000 7f6e02c46640 10 monclient: get_monmap_and_config 2026-02-24T19:24:08.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.594+0000 7f6e02c46640 10 monclient: build_initial_monmap 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.594+0000 7f6e02c46640 10 monclient: monmap: 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:08.595312+0000 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:08.595312+0000 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:08.598 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.594+0000 7f6e02c46640 1 Processor -- start 2026-02-24T19:24:08.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.594+0000 7f6e02c46640 1 -- start start 2026-02-24T19:24:08.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.594+0000 7f6e02c46640 10 monclient: init 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 10 monclient(hunting): picked mon.noname-a con 0x7f6dfc15e2a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 10 monclient(hunting): picked mon.noname-c con 0x7f6dfc059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 10 monclient(hunting): picked mon.noname-b con 0x7f6dfc1a5660 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc162df0 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc1630d0 con 0x7f6dfc1a5660 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc1633b0 con 0x7f6dfc059e10 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.595+0000 7f6e02c46640 10 monclient(hunting): authenticate will time out at 4020.234651s 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.596+0000 7f6e011bc640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f6dfc1a5660 0x7f6dfc1c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35038/0 (socket says 10.20.193.45:35038) 2026-02-24T19:24:08.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.596+0000 7f6e011bc640 1 -- 10.20.193.45:0/1934502370 learned_addr learned my addr 10.20.193.45:0/1934502370 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:08.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037361524 0 0) 0x7f6dfc1630d0 con 0x7f6dfc1a5660 2026-02-24T19:24:08.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 10 monclient(hunting): my global_id is 28129 2026-02-24T19:24:08.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6de8003610 con 0x7f6dfc1a5660 2026-02-24T19:24:08.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408438273 0 0) 0x7f6dfc162df0 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 10 monclient(hunting): my global_id is 30663 2026-02-24T19:24:08.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.597+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dfc1630d0 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506998814 0 0) 0x7f6dfc1633b0 con 0x7f6dfc059e10 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient(hunting): my global_id is 26603 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dfc162df0 con 0x7f6dfc059e10 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1567325770 0 0) 0x7f6de8003610 con 0x7f6dfc1a5660 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 >> v1:10.20.193.179:6789/0 conn(0x7f6dfc059e10 legacy=0x7f6dfc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 >> v1:10.20.193.45:6789/0 conn(0x7f6dfc15e2a0 legacy=0x7f6dfc05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 1 monclient: found mon.noname-b 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:24:08.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc163690 con 0x7f6dfc1a5660 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6df8003170 con 0x7f6dfc1a5660 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6df37fe640 10 monclient: dump: 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.609 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6e02c46640 5 monclient: authenticate success, global_id 28129 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.598+0000 7f6e02c46640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.599+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6df8003340 con 0x7f6dfc1a5660 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.599+0000 7f6df37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.599+0000 7f6df37fe640 1 -- 10.20.193.45:0/1934502370 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6df8003780 con 0x7f6dfc1a5660 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.599+0000 7f6df37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.599+0000 7f6df37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.599+0000 7f6df37fe640 10 monclient: dump: 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.599+0000 7f6e02c46640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:08.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.599+0000 7f6e02c46640 4 set_mon_vals no callback set 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 10 monclient: shutdown 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 -- 10.20.193.45:0/1934502370 >> v1:10.20.193.114:6789/0 conn(0x7f6dfc1a5660 legacy=0x7f6dfc1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 -- 10.20.193.45:0/1934502370 shutdown_connections 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 -- 10.20.193.45:0/1934502370 >> 10.20.193.45:0/1934502370 conn(0x7f6dfc0b2f60 msgr2=0x7f6dfc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 -- 10.20.193.45:0/1934502370 shutdown_connections 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 -- 10.20.193.45:0/1934502370 wait complete. 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 10 monclient: build_initial_monmap 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 10 monclient: monmap: 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:08.612 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 librados: starting msgr at 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 librados: starting objecter 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 Processor -- start 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 -- start start 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 librados: setting wanted keys 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 1 librados: calling monclient init 2026-02-24T19:24:08.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.600+0000 7f6e02c46640 10 monclient: init 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 10 monclient(hunting): picked mon.noname-a con 0x7f6dfc059e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 10 monclient(hunting): picked mon.noname-b con 0x7f6dfc15e2a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 10 monclient(hunting): picked mon.noname-c con 0x7f6dfc1a5660 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc1946b0 con 0x7f6dfc059e10 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc194990 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc194c70 con 0x7f6dfc1a5660 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e02c46640 10 monclient(hunting): authenticate will time out at 4020.240335s 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e009bb640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6dfc059e10 0x7f6dfc190c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45908/0 (socket says 10.20.193.45:45908) 2026-02-24T19:24:08.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6e009bb640 1 -- 10.20.193.45:0/2275677120 learned_addr learned my addr 10.20.193.45:0/2275677120 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6df17fa640 10 client.?.objecter ms_handle_connect 0x7f6dfc059e10 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6df17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6df17fa640 10 client.?.objecter ms_handle_connect 0x7f6dfc1a5660 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.601+0000 7f6df17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 client.?.objecter ms_handle_connect 0x7f6dfc15e2a0 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330660773 0 0) 0x7f6dfc194c70 con 0x7f6dfc1a5660 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): my global_id is 26606 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dcc003610 con 0x7f6dfc1a5660 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408591168 0 0) 0x7f6dfc1946b0 con 0x7f6dfc059e10 2026-02-24T19:24:08.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): my global_id is 30666 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dfc194c70 con 0x7f6dfc059e10 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576660645 0 0) 0x7f6dfc194990 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 10 monclient(hunting): my global_id is 28132 2026-02-24T19:24:08.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.602+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dfc1946b0 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 33182703 0 0) 0x7f6dfc1946b0 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6dfc194990 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6de4002fb0 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): dump: 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2639826698 0 0) 0x7f6dcc003610 con 0x7f6dfc1a5660 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6dfc1946b0 con 0x7f6dfc1a5660 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6df80034f0 con 0x7f6dfc1a5660 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): dump: 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.622 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2726773229 0 0) 0x7f6dfc194c70 con 0x7f6dfc059e10 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6dcc003610 con 0x7f6dfc059e10 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6dec003190 con 0x7f6dfc059e10 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.605+0000 7f6df17fa640 10 monclient(hunting): dump: 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.623 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 682036984 0 0) 0x7f6dfc194990 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 >> v1:10.20.193.179:6789/0 conn(0x7f6dfc1a5660 legacy=0x7f6dfc195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 >> v1:10.20.193.45:6789/0 conn(0x7f6dfc059e10 legacy=0x7f6dfc190c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 1 monclient: found mon.b 2026-02-24T19:24:08.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc194f50 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6df17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6e02c46640 5 monclient: authenticate success, global_id 28132 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6e02c46640 10 monclient: _renew_subs 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6e02c46640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6dfc195230 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6e02c46640 10 client.28132.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6e02c46640 10 monclient: _renew_subs 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6e02c46640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:08.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6dfc1289f0 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.606+0000 7f6e02c46640 1 librados: init done 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.607+0000 7f6e02c46640 10 client.28132.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.607+0000 7f6e02c46640 15 client.28132.objecter _session_command_op_assign -1 1 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.607+0000 7f6e02c46640 20 client.28132.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.607+0000 7f6e02c46640 10 client.28132.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.607+0000 7f6e02c46640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.607+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6dfc15c020 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.614+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6dfc15c020 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.614+0000 7f6df17fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.614+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6de4003700 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.614+0000 7f6df17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.614+0000 7f6df17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:08.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.614+0000 7f6df17fa640 10 monclient: dump: 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.614+0000 7f6df2ffd640 4 set_mon_vals no callback set 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.615+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f6de401c5b0 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6e009bb640 10 monclient: get_auth_request con 0x7f6dcc077ef0 auth_method 0 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 10 client.28132.objecter ms_handle_connect 0x7f6dcc077ef0 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f6de4091d60 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 10 client.28132.objecter ms_dispatch2 0x7f6dfc000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 3 client.28132.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 3 client.28132.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 10 client.28132.objecter checking command 1 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 20 client.28132.objecter _get_session s=0x7f6dcc0a21c0 osd=1 3 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 20 client.28132.objecter put_session s=0x7f6dcc0a21c0 osd=1 3 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 15 client.28132.objecter _session_command_op_remove -1 1 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 20 client.28132.objecter _get_session s=0x7f6dcc0a21c0 osd=1 3 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 20 client.28132.objecter get_session s=0x7f6dcc0a21c0 osd=1 3 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 15 client.28132.objecter _session_command_op_assign 1 1 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 20 client.28132.objecter put_session s=0x7f6dcc0a21c0 osd=1 4 2026-02-24T19:24:08.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 10 client.28132.objecter _send_command 1 2026-02-24T19:24:08.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.114:6808/1876170727 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6dcc0c44d0 con 0x7f6dcc0a2870 2026-02-24T19:24:08.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 20 client.28132.objecter dump_active .. 0 homeless 2026-02-24T19:24:08.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f6de405be60 con 0x7f6dfc15e2a0 2026-02-24T19:24:08.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.616+0000 7f6df17fa640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:08.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.617+0000 7f6e011bc640 10 monclient: get_auth_request con 0x7f6dcc0a2870 auth_method 0 2026-02-24T19:24:08.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.618+0000 7f6df17fa640 10 client.28132.objecter ms_handle_connect 0x7f6dcc0a2870 2026-02-24T19:24:08.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.628+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== osd.1 v1:10.20.193.114:6808/1876170727 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6dcc0c44d0 con 0x7f6dcc0a2870 2026-02-24T19:24:08.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.628+0000 7f6df17fa640 10 client.28132.objecter ms_dispatch2 0x7f6dfc000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:08.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.628+0000 7f6df17fa640 10 client.28132.objecter _finish_command 1 = system:0 2026-02-24T19:24:08.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.628+0000 7f6df17fa640 20 client.28132.objecter put_session s=0x7f6dcc0a21c0 osd=1 4 2026-02-24T19:24:08.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.628+0000 7f6df17fa640 15 client.28132.objecter _session_command_op_remove 1 1 2026-02-24T19:24:08.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 10 client.28132.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:08.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 15 client.28132.objecter _session_command_op_assign -1 2 2026-02-24T19:24:08.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 20 client.28132.objecter _get_session s=0x7f6dcc0a21c0 osd=1 3 2026-02-24T19:24:08.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 20 client.28132.objecter put_session s=0x7f6dcc0a21c0 osd=1 3 2026-02-24T19:24:08.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 20 client.28132.objecter _get_session s=0x7f6dcc0a21c0 osd=1 3 2026-02-24T19:24:08.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 15 client.28132.objecter _session_command_op_remove -1 2 2026-02-24T19:24:08.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 20 client.28132.objecter get_session s=0x7f6dcc0a21c0 osd=1 3 2026-02-24T19:24:08.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 15 client.28132.objecter _session_command_op_assign 1 2 2026-02-24T19:24:08.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 20 client.28132.objecter put_session s=0x7f6dcc0a21c0 osd=1 4 2026-02-24T19:24:08.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 10 client.28132.objecter _send_command 2 2026-02-24T19:24:08.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.635+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 --> v1:10.20.193.114:6808/1876170727 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6dfc15bd40 con 0x7f6dcc0a2870 2026-02-24T19:24:08.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6df17fa640 1 -- 10.20.193.45:0/2275677120 <== osd.1 v1:10.20.193.114:6808/1876170727 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f6dfc15bd40 con 0x7f6dcc0a2870 2026-02-24T19:24:08.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6df17fa640 10 client.28132.objecter ms_dispatch2 0x7f6dfc000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:08.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6df17fa640 10 client.28132.objecter _finish_command 2 = system:0 2026-02-24T19:24:08.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6df17fa640 20 client.28132.objecter put_session s=0x7f6dcc0a21c0 osd=1 4 2026-02-24T19:24:08.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6df17fa640 15 client.28132.objecter _session_command_op_remove 1 2 2026-02-24T19:24:08.646 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:08.646 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:08.646 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:08.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 10 librados: watch_flush enter 2026-02-24T19:24:08.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 10 librados: watch_flush exit 2026-02-24T19:24:08.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 10 client.28132.objecter close_session for osd.1 2026-02-24T19:24:08.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 >> v1:10.20.193.114:6808/1876170727 conn(0x7f6dcc0a2870 legacy=0x7f6dcc0c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 20 client.28132.objecter put_session s=0x7f6dcc0a21c0 osd=1 1 2026-02-24T19:24:08.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 20 client.28132.objecter shutdown clearing up homeless session... 2026-02-24T19:24:08.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 10 client.28132.objecter successfully canceled tick 2026-02-24T19:24:08.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6dcc077ef0 legacy=0x7f6dcc0983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 10 monclient: shutdown 2026-02-24T19:24:08.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:08.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 >> v1:10.20.193.114:6789/0 conn(0x7f6dfc15e2a0 legacy=0x7f6dfc0af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e011bc640 1 -- 10.20.193.45:0/2275677120 reap_dead start 2026-02-24T19:24:08.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 shutdown_connections 2026-02-24T19:24:08.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 >> 10.20.193.45:0/2275677120 conn(0x7f6dfc0b2f60 msgr2=0x7f6dfc05da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:08.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 shutdown_connections 2026-02-24T19:24:08.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 1 -- 10.20.193.45:0/2275677120 wait complete. 2026-02-24T19:24:08.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.642+0000 7f6e02c46640 1 librados: shutdown 2026-02-24T19:24:08.653 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-24T19:24:08.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.715+0000 7fc73ff44640 10 monclient: get_monmap_and_config 2026-02-24T19:24:08.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.715+0000 7fc73ff44640 10 monclient: build_initial_monmap 2026-02-24T19:24:08.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.715+0000 7fc73ff44640 10 monclient: monmap: 2026-02-24T19:24:08.719 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:08.719 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.719 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:08.716930+0000 2026-02-24T19:24:08.719 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:08.716930+0000 2026-02-24T19:24:08.720 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:08.720 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.720 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:08.720 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:08.720 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:08.720 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 1 Processor -- start 2026-02-24T19:24:08.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 1 -- start start 2026-02-24T19:24:08.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 10 monclient: init 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 10 monclient(hunting): picked mon.noname-a con 0x7fc738157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 10 monclient(hunting): picked mon.noname-c con 0x7fc738157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 10 monclient(hunting): picked mon.noname-b con 0x7fc738164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc73805de70 con 0x7fc738157780 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc738055b20 con 0x7fc738164d00 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc738055e00 con 0x7fc738157b50 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.716+0000 7fc73ff44640 10 monclient(hunting): authenticate will time out at 4020.355815s 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.717+0000 7fc73e4ba640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fc738164d00 0x7fc7381c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35056/0 (socket says 10.20.193.45:35056) 2026-02-24T19:24:08.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.717+0000 7fc73e4ba640 1 -- 10.20.193.45:0/1026960249 learned_addr learned my addr 10.20.193.45:0/1026960249 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179936020 0 0) 0x7fc738055e00 con 0x7fc738157b50 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): my global_id is 26609 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc720003610 con 0x7fc738157b50 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1549216653 0 0) 0x7fc738055b20 con 0x7fc738164d00 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): my global_id is 28135 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc738055e00 con 0x7fc738164d00 2026-02-24T19:24:08.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831163033 0 0) 0x7fc73805de70 con 0x7fc738157780 2026-02-24T19:24:08.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 10 monclient(hunting): my global_id is 30669 2026-02-24T19:24:08.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.718+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc738055b20 con 0x7fc738157780 2026-02-24T19:24:08.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 861310906 0 0) 0x7fc720003610 con 0x7fc738157b50 2026-02-24T19:24:08.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 >> v1:10.20.193.114:6789/0 conn(0x7fc738164d00 legacy=0x7fc7381c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 >> v1:10.20.193.45:6789/0 conn(0x7fc738157780 legacy=0x7fc738056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: _finish_hunting 0 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 1 monclient: found mon.noname-c 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7380560e0 con 0x7fc738157b50 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: _finish_auth 0 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: _check_auth_tickets 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc72c002df0 con 0x7fc738157b50 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:08.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: dump: 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ff44640 5 monclient: authenticate success, global_id 26609 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ff44640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:08.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc72c003040 con 0x7fc738157b50 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 1 -- 10.20.193.45:0/1026960249 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc72c003480 con 0x7fc738157b50 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ccb7640 10 monclient: dump: 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.733 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ff44640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.720+0000 7fc73ff44640 4 set_mon_vals no callback set 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 10 monclient: shutdown 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 1 -- 10.20.193.45:0/1026960249 >> v1:10.20.193.179:6789/0 conn(0x7fc738157b50 legacy=0x7fc7381645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 1 -- 10.20.193.45:0/1026960249 shutdown_connections 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 1 -- 10.20.193.45:0/1026960249 >> 10.20.193.45:0/1026960249 conn(0x7fc7380b2ef0 msgr2=0x7fc7380b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 1 -- 10.20.193.45:0/1026960249 shutdown_connections 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 1 -- 10.20.193.45:0/1026960249 wait complete. 2026-02-24T19:24:08.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 10 monclient: build_initial_monmap 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 10 monclient: monmap: 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 1 librados: starting msgr at 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 1 librados: starting objecter 2026-02-24T19:24:08.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.721+0000 7fc73ff44640 1 Processor -- start 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 1 -- start start 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 1 librados: setting wanted keys 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 1 librados: calling monclient init 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 10 monclient: init 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 10 monclient(hunting): picked mon.noname-a con 0x7fc738157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 10 monclient(hunting): picked mon.noname-b con 0x7fc738157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 10 monclient(hunting): picked mon.noname-c con 0x7fc738164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc738147890 con 0x7fc738157780 2026-02-24T19:24:08.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc738058140 con 0x7fc738157b50 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc73805bfa0 con 0x7fc738164d00 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73ff44640 10 monclient(hunting): authenticate will time out at 4020.361380s 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73d4b8640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fc738157b50 0x7fc738057a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35064/0 (socket says 10.20.193.45:35064) 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc73d4b8640 1 -- 10.20.193.45:0/1155129943 learned_addr learned my addr 10.20.193.45:0/1155129943 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc7267fc640 10 client.?.objecter ms_handle_connect 0x7fc738157780 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc7267fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc7267fc640 10 client.?.objecter ms_handle_connect 0x7fc738164d00 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.722+0000 7fc7267fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 client.?.objecter ms_handle_connect 0x7fc738157b50 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433159152 0 0) 0x7fc738147890 con 0x7fc738157780 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 monclient(hunting): my global_id is 30672 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc708003610 con 0x7fc738157780 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3772452746 0 0) 0x7fc73805bfa0 con 0x7fc738164d00 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 10 monclient(hunting): my global_id is 26612 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.723+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc738147890 con 0x7fc738164d00 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.724+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2546854588 0 0) 0x7fc738058140 con 0x7fc738157b50 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.724+0000 7fc7267fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:08.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.724+0000 7fc7267fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.724+0000 7fc7267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.724+0000 7fc7267fc640 10 monclient(hunting): my global_id is 28138 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.724+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc73805bfa0 con 0x7fc738157b50 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3388203216 0 0) 0x7fc708003610 con 0x7fc738157780 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc738058140 con 0x7fc738157780 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc728003060 con 0x7fc738157780 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): dump: 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.739 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 510128320 0 0) 0x7fc738147890 con 0x7fc738164d00 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc708003610 con 0x7fc738164d00 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc734003250 con 0x7fc738164d00 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): dump: 2026-02-24T19:24:08.740 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1823204693 0 0) 0x7fc73805bfa0 con 0x7fc738157b50 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc738147890 con 0x7fc738157b50 2026-02-24T19:24:08.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc72c0033d0 con 0x7fc738157b50 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.726+0000 7fc7267fc640 10 monclient(hunting): dump: 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.742 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1517041348 0 0) 0x7fc738058140 con 0x7fc738157780 2026-02-24T19:24:08.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 >> v1:10.20.193.179:6789/0 conn(0x7fc738164d00 legacy=0x7fc738148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 >> v1:10.20.193.114:6789/0 conn(0x7fc738157b50 legacy=0x7fc738057a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:08.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 1 monclient: found mon.a 2026-02-24T19:24:08.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:08.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73805c280 con 0x7fc738157780 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc7267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc73ff44640 5 monclient: authenticate success, global_id 30672 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc73ff44640 10 monclient: _renew_subs 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc73ff44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc73805c560 con 0x7fc738157780 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc73ff44640 10 client.30672.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc73ff44640 10 monclient: _renew_subs 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc73ff44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc738148760 con 0x7fc738157780 2026-02-24T19:24:08.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.727+0000 7fc73ff44640 1 librados: init done 2026-02-24T19:24:08.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.728+0000 7fc73ff44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:08.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.728+0000 7fc73ff44640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:08.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.728+0000 7fc73ff44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:08.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.728+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73805e250 con 0x7fc738157780 2026-02-24T19:24:08.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.860+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc728003200 con 0x7fc738157780 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.860+0000 7fc7267fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.860+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc728003920 con 0x7fc738157780 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.860+0000 7fc7267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.860+0000 7fc7267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.860+0000 7fc7267fc640 10 monclient: dump: 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:08.865 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:08.866 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:08.866 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:08.866 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:08.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.860+0000 7fc727fff640 4 set_mon_vals no callback set 2026-02-24T19:24:08.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.861+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fc72801c790 con 0x7fc738157780 2026-02-24T19:24:08.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.861+0000 7fc73d4b8640 10 monclient: get_auth_request con 0x7fc708077e20 auth_method 0 2026-02-24T19:24:08.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.862+0000 7fc7267fc640 10 client.30672.objecter ms_handle_connect 0x7fc708077e20 2026-02-24T19:24:08.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.864+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fc728091f70 con 0x7fc738157780 2026-02-24T19:24:08.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.864+0000 7fc7267fc640 10 client.30672.objecter ms_dispatch2 0x7fc738000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:08.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.864+0000 7fc7267fc640 3 client.30672.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:08.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.864+0000 7fc7267fc640 3 client.30672.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:08.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.864+0000 7fc7267fc640 20 client.30672.objecter dump_active .. 0 homeless 2026-02-24T19:24:08.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.864+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc73805e250 con 0x7fc738157780 2026-02-24T19:24:08.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.864+0000 7fc7267fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:08.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.864+0000 7fc7267fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:08.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.968+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fc73815e920 con 0x7fc708077e20 2026-02-24T19:24:08.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.968+0000 7fc7267fc640 1 -- 10.20.193.45:0/1155129943 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7fc73815e920 con 0x7fc708077e20 2026-02-24T19:24:08.972 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 1 to deep-scrub 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 10 librados: watch_flush enter 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 10 librados: watch_flush exit 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 20 client.30672.objecter shutdown clearing up homeless session... 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 10 client.30672.objecter successfully canceled tick 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 >> v1:10.20.193.45:6800/1599977652 conn(0x7fc708077e20 legacy=0x7fc7080982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 10 monclient: shutdown 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 >> v1:10.20.193.45:6789/0 conn(0x7fc738157780 legacy=0x7fc73805b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 shutdown_connections 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 >> 10.20.193.45:0/1155129943 conn(0x7fc7380b2ef0 msgr2=0x7fc73813b880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:08.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 shutdown_connections 2026-02-24T19:24:08.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 1 -- 10.20.193.45:0/1155129943 wait complete. 2026-02-24T19:24:08.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:08.969+0000 7fc73ff44640 1 librados: shutdown 2026-02-24T19:24:08.981 INFO:tasks.ceph:Scrubbing osd.5 2026-02-24T19:24:08.981 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:09.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.046+0000 7fc710f9b640 10 monclient: get_monmap_and_config 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.046+0000 7fc710f9b640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.046+0000 7fc710f9b640 10 monclient: monmap: 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:09.047436+0000 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:09.047436+0000 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.050 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.051 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.051 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.046+0000 7fc710f9b640 1 Processor -- start 2026-02-24T19:24:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.046+0000 7fc710f9b640 1 -- start start 2026-02-24T19:24:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.046+0000 7fc710f9b640 10 monclient: init 2026-02-24T19:24:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 10 monclient(hunting): picked mon.noname-c con 0x7fc70c1667a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 10 monclient(hunting): picked mon.noname-b con 0x7fc70c165cf0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 10 monclient(hunting): picked mon.noname-a con 0x7fc70c159b10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70c05e260 con 0x7fc70c159b10 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70c164540 con 0x7fc70c165cf0 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70c164820 con 0x7fc70c1667a0 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc710f9b640 10 monclient(hunting): authenticate will time out at 4020.686435s 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc70ad76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc70c159b10 0x7fc70c1c88d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45928/0 (socket says 10.20.193.45:45928) 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc70ad76640 1 -- 10.20.193.45:0/289891801 learned_addr learned my addr 10.20.193.45:0/289891801 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.047+0000 7fc709d74640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fc70c165cf0 0x7fc70c159400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35072/0 (socket says 10.20.193.45:35072) 2026-02-24T19:24:09.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440464642 0 0) 0x7fc70c164540 con 0x7fc70c165cf0 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): my global_id is 28141 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6f8003610 con 0x7fc70c165cf0 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048051251 0 0) 0x7fc70c05e260 con 0x7fc70c159b10 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): my global_id is 30675 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc70c164540 con 0x7fc70c159b10 2026-02-24T19:24:09.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546598013 0 0) 0x7fc70c164820 con 0x7fc70c1667a0 2026-02-24T19:24:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 10 monclient(hunting): my global_id is 26615 2026-02-24T19:24:09.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.049+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc70c05e260 con 0x7fc70c1667a0 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2734208955 0 0) 0x7fc6f8003610 con 0x7fc70c165cf0 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 >> v1:10.20.193.179:6789/0 conn(0x7fc70c1667a0 legacy=0x7fc70c1655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 >> v1:10.20.193.45:6789/0 conn(0x7fc70c159b10 legacy=0x7fc70c1c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 1 monclient: found mon.noname-b 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70c164b00 con 0x7fc70c165cf0 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc6f4002df0 con 0x7fc70c165cf0 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc709573640 10 monclient: dump: 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.064 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc710f9b640 5 monclient: authenticate success, global_id 28141 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.050+0000 7fc710f9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.051+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6f4002fc0 con 0x7fc70c165cf0 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.051+0000 7fc709573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.051+0000 7fc709573640 1 -- 10.20.193.45:0/289891801 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc6f4003400 con 0x7fc70c165cf0 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.051+0000 7fc710f9b640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.051+0000 7fc710f9b640 4 set_mon_vals no callback set 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.051+0000 7fc709573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.051+0000 7fc709573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc709573640 10 monclient: dump: 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 10 monclient: shutdown 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 -- 10.20.193.45:0/289891801 >> v1:10.20.193.114:6789/0 conn(0x7fc70c165cf0 legacy=0x7fc70c159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 -- 10.20.193.45:0/289891801 shutdown_connections 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 -- 10.20.193.45:0/289891801 >> 10.20.193.45:0/289891801 conn(0x7fc70c0b2f60 msgr2=0x7fc70c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 -- 10.20.193.45:0/289891801 shutdown_connections 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 -- 10.20.193.45:0/289891801 wait complete. 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 10 monclient: monmap: 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:09.067 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 librados: starting msgr at 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 librados: starting objecter 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 Processor -- start 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 -- start start 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 librados: setting wanted keys 2026-02-24T19:24:09.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 1 librados: calling monclient init 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.052+0000 7fc710f9b640 10 monclient: init 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 10 monclient(hunting): picked mon.noname-c con 0x7fc70c159b10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 10 monclient(hunting): picked mon.noname-a con 0x7fc70c165cf0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 10 monclient(hunting): picked mon.noname-b con 0x7fc70c1667a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70c136d50 con 0x7fc70c165cf0 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70c0a92d0 con 0x7fc70c1667a0 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70c1409f0 con 0x7fc70c159b10 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc710f9b640 10 monclient(hunting): authenticate will time out at 4020.692330s 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc70ad76640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fc70c1667a0 0x7fc70c056b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35088/0 (socket says 10.20.193.45:35088) 2026-02-24T19:24:09.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc70ad76640 1 -- 10.20.193.45:0/4167617516 learned_addr learned my addr 10.20.193.45:0/4167617516 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc6f2ffd640 10 client.?.objecter ms_handle_connect 0x7fc70c165cf0 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc6f2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc6f2ffd640 10 client.?.objecter ms_handle_connect 0x7fc70c1667a0 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.053+0000 7fc6f2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288308173 0 0) 0x7fc70c136d50 con 0x7fc70c165cf0 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 monclient(hunting): my global_id is 30678 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6d8003610 con 0x7fc70c165cf0 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198522003 0 0) 0x7fc70c0a92d0 con 0x7fc70c1667a0 2026-02-24T19:24:09.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 monclient(hunting): my global_id is 28144 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc70c136d50 con 0x7fc70c1667a0 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 client.?.objecter ms_handle_connect 0x7fc70c159b10 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.054+0000 7fc6f2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.055+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564262458 0 0) 0x7fc70c1409f0 con 0x7fc70c159b10 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.055+0000 7fc6f2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.055+0000 7fc6f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.055+0000 7fc6f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.055+0000 7fc6f2ffd640 10 monclient(hunting): my global_id is 26618 2026-02-24T19:24:09.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.055+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc70c0a92d0 con 0x7fc70c159b10 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2459782648 0 0) 0x7fc70c136d50 con 0x7fc70c1667a0 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc70c1409f0 con 0x7fc70c1667a0 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc6fc003430 con 0x7fc70c1667a0 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.072 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1421773761 0 0) 0x7fc6d8003610 con 0x7fc70c165cf0 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc70c136d50 con 0x7fc70c165cf0 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc6f4003170 con 0x7fc70c165cf0 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.057+0000 7fc6f2ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:09.073 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4229590639 0 0) 0x7fc70c0a92d0 con 0x7fc70c159b10 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6d8003610 con 0x7fc70c159b10 2026-02-24T19:24:09.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc700002fb0 con 0x7fc70c159b10 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.075 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3798030579 0 0) 0x7fc70c1409f0 con 0x7fc70c1667a0 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 >> v1:10.20.193.179:6789/0 conn(0x7fc70c159b10 legacy=0x7fc70c137aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 >> v1:10.20.193.45:6789/0 conn(0x7fc70c165cf0 legacy=0x7fc70c0a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 1 monclient: found mon.b 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70c136fc0 con 0x7fc70c1667a0 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc6f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc710f9b640 5 monclient: authenticate success, global_id 28144 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc710f9b640 10 monclient: _renew_subs 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc710f9b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc70c1372a0 con 0x7fc70c1667a0 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc710f9b640 10 client.28144.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc710f9b640 10 monclient: _renew_subs 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc710f9b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc70c057230 con 0x7fc70c1667a0 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.058+0000 7fc710f9b640 1 librados: init done 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.059+0000 7fc710f9b640 10 client.28144.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.059+0000 7fc710f9b640 15 client.28144.objecter _session_command_op_assign -1 1 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.059+0000 7fc710f9b640 20 client.28144.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:09.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.059+0000 7fc710f9b640 10 client.28144.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:09.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.059+0000 7fc710f9b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:09.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.059+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc70c0590b0 con 0x7fc70c1667a0 2026-02-24T19:24:09.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.064+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc70c0590b0 con 0x7fc70c1667a0 2026-02-24T19:24:09.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.064+0000 7fc6f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.064+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc6fc004f00 con 0x7fc70c1667a0 2026-02-24T19:24:09.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.064+0000 7fc6f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.064+0000 7fc6f2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:09.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.064+0000 7fc708d72640 4 set_mon_vals no callback set 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.064+0000 7fc6f2ffd640 10 monclient: dump: 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.067+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fc6fc01dbd0 con 0x7fc70c1667a0 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.067+0000 7fc70a575640 10 monclient: get_auth_request con 0x7fc6d8077e70 auth_method 0 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.067+0000 7fc6f2ffd640 10 client.28144.objecter ms_handle_connect 0x7fc6d8077e70 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fc6fc093410 con 0x7fc70c1667a0 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 10 client.28144.objecter ms_dispatch2 0x7fc70c000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 3 client.28144.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 3 client.28144.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 10 client.28144.objecter checking command 1 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 20 client.28144.objecter _get_session s=0x7fc6d80a21a0 osd=5 3 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 20 client.28144.objecter put_session s=0x7fc6d80a21a0 osd=5 3 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 15 client.28144.objecter _session_command_op_remove -1 1 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 20 client.28144.objecter _get_session s=0x7fc6d80a21a0 osd=5 3 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 20 client.28144.objecter get_session s=0x7fc6d80a21a0 osd=5 3 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 15 client.28144.objecter _session_command_op_assign 5 1 2026-02-24T19:24:09.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 20 client.28144.objecter put_session s=0x7fc6d80a21a0 osd=5 4 2026-02-24T19:24:09.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 10 client.28144.objecter _send_command 1 2026-02-24T19:24:09.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.114:6804/3576632251 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6d80c44b0 con 0x7fc6d80a2850 2026-02-24T19:24:09.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.068+0000 7fc6f2ffd640 20 client.28144.objecter dump_active .. 0 homeless 2026-02-24T19:24:09.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.069+0000 7fc709d74640 10 monclient: get_auth_request con 0x7fc6d80a2850 auth_method 0 2026-02-24T19:24:09.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.069+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fc6fc059ab0 con 0x7fc70c1667a0 2026-02-24T19:24:09.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.069+0000 7fc6f2ffd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:09.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.070+0000 7fc6f2ffd640 10 client.28144.objecter ms_handle_connect 0x7fc6d80a2850 2026-02-24T19:24:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.079+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== osd.5 v1:10.20.193.114:6804/3576632251 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc6d80c44b0 con 0x7fc6d80a2850 2026-02-24T19:24:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.079+0000 7fc6f2ffd640 10 client.28144.objecter ms_dispatch2 0x7fc70c000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.079+0000 7fc6f2ffd640 10 client.28144.objecter _finish_command 1 = system:0 2026-02-24T19:24:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.079+0000 7fc6f2ffd640 20 client.28144.objecter put_session s=0x7fc6d80a21a0 osd=5 4 2026-02-24T19:24:09.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.079+0000 7fc6f2ffd640 15 client.28144.objecter _session_command_op_remove 5 1 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 10 client.28144.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 15 client.28144.objecter _session_command_op_assign -1 2 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 20 client.28144.objecter _get_session s=0x7fc6d80a21a0 osd=5 3 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 20 client.28144.objecter put_session s=0x7fc6d80a21a0 osd=5 3 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 20 client.28144.objecter _get_session s=0x7fc6d80a21a0 osd=5 3 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 15 client.28144.objecter _session_command_op_remove -1 2 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 20 client.28144.objecter get_session s=0x7fc6d80a21a0 osd=5 3 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 15 client.28144.objecter _session_command_op_assign 5 2 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 20 client.28144.objecter put_session s=0x7fc6d80a21a0 osd=5 4 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 10 client.28144.objecter _send_command 2 2026-02-24T19:24:09.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.086+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 --> v1:10.20.193.114:6804/3576632251 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc70c058dd0 con 0x7fc6d80a2850 2026-02-24T19:24:09.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc6f2ffd640 1 -- 10.20.193.45:0/4167617516 <== osd.5 v1:10.20.193.114:6804/3576632251 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc70c058dd0 con 0x7fc6d80a2850 2026-02-24T19:24:09.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc6f2ffd640 10 client.28144.objecter ms_dispatch2 0x7fc70c000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:09.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc6f2ffd640 10 client.28144.objecter _finish_command 2 = system:0 2026-02-24T19:24:09.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc6f2ffd640 20 client.28144.objecter put_session s=0x7fc6d80a21a0 osd=5 4 2026-02-24T19:24:09.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc6f2ffd640 15 client.28144.objecter _session_command_op_remove 5 2 2026-02-24T19:24:09.098 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:09.098 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:09.098 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:09.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 10 librados: watch_flush enter 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 10 librados: watch_flush exit 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 10 client.28144.objecter close_session for osd.5 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 >> v1:10.20.193.114:6804/3576632251 conn(0x7fc6d80a2850 legacy=0x7fc6d80c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 20 client.28144.objecter put_session s=0x7fc6d80a21a0 osd=5 1 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 20 client.28144.objecter shutdown clearing up homeless session... 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 10 client.28144.objecter successfully canceled tick 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 >> v1:10.20.193.45:6800/1599977652 conn(0x7fc6d8077e70 legacy=0x7fc6d8098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 10 monclient: shutdown 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 >> v1:10.20.193.114:6789/0 conn(0x7fc70c1667a0 legacy=0x7fc70c056b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc70ad76640 1 -- 10.20.193.45:0/4167617516 reap_dead start 2026-02-24T19:24:09.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 shutdown_connections 2026-02-24T19:24:09.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 >> 10.20.193.45:0/4167617516 conn(0x7fc70c0b2f60 msgr2=0x7fc70c1591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 shutdown_connections 2026-02-24T19:24:09.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 1 -- 10.20.193.45:0/4167617516 wait complete. 2026-02-24T19:24:09.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.094+0000 7fc710f9b640 1 librados: shutdown 2026-02-24T19:24:09.104 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-24T19:24:09.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.168+0000 7f675a016640 10 monclient: get_monmap_and_config 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.168+0000 7f675a016640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.168+0000 7f675a016640 10 monclient: monmap: 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:09.169393+0000 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:09.169393+0000 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.172 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.173 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.168+0000 7f675a016640 1 Processor -- start 2026-02-24T19:24:09.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.168+0000 7f675a016640 1 -- start start 2026-02-24T19:24:09.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.168+0000 7f675a016640 10 monclient: init 2026-02-24T19:24:09.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:09.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 10 monclient(hunting): picked mon.noname-b con 0x7f675415d070 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 10 monclient(hunting): picked mon.noname-c con 0x7f675415d440 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 10 monclient(hunting): picked mon.noname-a con 0x7f6754166f60 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6754164e60 con 0x7f6754166f60 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67540b1790 con 0x7f675415d070 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67540b1a70 con 0x7f675415d440 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f675a016640 10 monclient(hunting): authenticate will time out at 4020.808381s 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f6753fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6754166f60 0x7f67540b5260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45944/0 (socket says 10.20.193.45:45944) 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.169+0000 7f6753fff640 1 -- 10.20.193.45:0/3330360004 learned_addr learned my addr 10.20.193.45:0/3330360004 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298394163 0 0) 0x7f6754164e60 con 0x7f6754166f60 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): my global_id is 30681 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6738003610 con 0x7f6754166f60 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504016504 0 0) 0x7f67540b1a70 con 0x7f675415d440 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): my global_id is 26621 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6754164e60 con 0x7f675415d440 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3654888018 0 0) 0x7f67540b1790 con 0x7f675415d070 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 10 monclient(hunting): my global_id is 28147 2026-02-24T19:24:09.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.171+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67540b1a70 con 0x7f675415d070 2026-02-24T19:24:09.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1134531375 0 0) 0x7f6754164e60 con 0x7f675415d440 2026-02-24T19:24:09.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 >> v1:10.20.193.114:6789/0 conn(0x7f675415d070 legacy=0x7f6754164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 >> v1:10.20.193.45:6789/0 conn(0x7f6754166f60 legacy=0x7f67540b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 1 monclient: found mon.noname-c 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67540b1d50 con 0x7f675415d440 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6744002df0 con 0x7f675415d440 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f67527fc640 10 monclient: dump: 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.184 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f675a016640 5 monclient: authenticate success, global_id 26621 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.172+0000 7f675a016640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:09.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6744002fc0 con 0x7f675415d440 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f67527fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f67527fc640 1 -- 10.20.193.45:0/3330360004 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6744003400 con 0x7f675415d440 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f67527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f67527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f67527fc640 10 monclient: dump: 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.186 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f675a016640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f675a016640 4 set_mon_vals no callback set 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f675a016640 10 monclient: shutdown 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f675a016640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f675a016640 1 -- 10.20.193.45:0/3330360004 >> v1:10.20.193.179:6789/0 conn(0x7f675415d440 legacy=0x7f6754166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f675a016640 1 -- 10.20.193.45:0/3330360004 shutdown_connections 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f675a016640 1 -- 10.20.193.45:0/3330360004 >> 10.20.193.45:0/3330360004 conn(0x7f67540b2ef0 msgr2=0x7f67540b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f675a016640 1 -- 10.20.193.45:0/3330360004 shutdown_connections 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.173+0000 7f675a016640 1 -- 10.20.193.45:0/3330360004 wait complete. 2026-02-24T19:24:09.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 10 monclient: monmap: 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 1 librados: starting msgr at 2026-02-24T19:24:09.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 1 librados: starting objecter 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 1 Processor -- start 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 1 -- start start 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 1 librados: setting wanted keys 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 1 librados: calling monclient init 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.174+0000 7f675a016640 10 monclient: init 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 10 monclient(hunting): picked mon.noname-c con 0x7f675415d070 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 10 monclient(hunting): picked mon.noname-b con 0x7f675415d440 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 10 monclient(hunting): picked mon.noname-a con 0x7f6754166f60 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6754157fe0 con 0x7f6754166f60 2026-02-24T19:24:09.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67541fd7c0 con 0x7f675415d440 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67541fdaa0 con 0x7f675415d070 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f675a016640 10 monclient(hunting): authenticate will time out at 4020.814183s 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f6753fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6754166f60 0x7f67541f95c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45958/0 (socket says 10.20.193.45:45958) 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f6753fff640 1 -- 10.20.193.45:0/2870458730 learned_addr learned my addr 10.20.193.45:0/2870458730 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f672ffff640 10 client.?.objecter ms_handle_connect 0x7f6754166f60 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f672ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f672ffff640 10 client.?.objecter ms_handle_connect 0x7f675415d440 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f672ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f672ffff640 10 client.?.objecter ms_handle_connect 0x7f675415d070 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.175+0000 7f672ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107915092 0 0) 0x7f6754157fe0 con 0x7f6754166f60 2026-02-24T19:24:09.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): my global_id is 30684 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6724003610 con 0x7f6754166f60 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2197561439 0 0) 0x7f67541fdaa0 con 0x7f675415d070 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): my global_id is 26624 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6754157fe0 con 0x7f675415d070 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1100904391 0 0) 0x7f67541fd7c0 con 0x7f675415d440 2026-02-24T19:24:09.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 10 monclient(hunting): my global_id is 28150 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.176+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67541fdaa0 con 0x7f675415d440 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1840965682 0 0) 0x7f6754157fe0 con 0x7f675415d070 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67541fd7c0 con 0x7f675415d070 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6740003060 con 0x7f675415d070 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): dump: 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.192 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3814893699 0 0) 0x7f6724003610 con 0x7f6754166f60 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6754157fe0 con 0x7f6754166f60 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6748003290 con 0x7f6754166f60 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): dump: 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2941971322 0 0) 0x7f67541fdaa0 con 0x7f675415d440 2026-02-24T19:24:09.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6724003610 con 0x7f675415d440 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6744003310 con 0x7f675415d440 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.179+0000 7f672ffff640 10 monclient(hunting): dump: 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.195 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 544181086 0 0) 0x7f67541fd7c0 con 0x7f675415d070 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 >> v1:10.20.193.114:6789/0 conn(0x7f675415d440 legacy=0x7f67540b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 >> v1:10.20.193.45:6789/0 conn(0x7f6754166f60 legacy=0x7f67541f95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 1 monclient: found mon.c 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67541fdd80 con 0x7f675415d070 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f672ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f675a016640 5 monclient: authenticate success, global_id 26624 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f675a016640 10 monclient: _renew_subs 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f675a016640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67541fe060 con 0x7f675415d070 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f675a016640 10 client.26624.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f675a016640 10 monclient: _renew_subs 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f675a016640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f67541f90a0 con 0x7f675415d070 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.180+0000 7f675a016640 1 librados: init done 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.181+0000 7f675a016640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:09.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.181+0000 7f675a016640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:09.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.181+0000 7f675a016640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.181+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f675405a050 con 0x7f675415d070 2026-02-24T19:24:09.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.273+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6740003200 con 0x7f675415d070 2026-02-24T19:24:09.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.273+0000 7f672ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.273+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6740003920 con 0x7f675415d070 2026-02-24T19:24:09.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.273+0000 7f672ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.273+0000 7f672ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:09.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.273+0000 7f672ffff640 10 monclient: dump: 2026-02-24T19:24:09.277 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.277 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.278 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.278 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.278 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.278 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.278 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.278 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.278 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.278 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.273+0000 7f6751ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:09.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.274+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f674001c790 con 0x7f675415d070 2026-02-24T19:24:09.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.275+0000 7f6752ffd640 10 monclient: get_auth_request con 0x7f6724077dd0 auth_method 0 2026-02-24T19:24:09.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.275+0000 7f672ffff640 10 client.26624.objecter ms_handle_connect 0x7f6724077dd0 2026-02-24T19:24:09.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.276+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f6740091f50 con 0x7f675415d070 2026-02-24T19:24:09.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.276+0000 7f672ffff640 10 client.26624.objecter ms_dispatch2 0x7f6754000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:09.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.276+0000 7f672ffff640 3 client.26624.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:09.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.276+0000 7f672ffff640 3 client.26624.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:09.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.276+0000 7f672ffff640 20 client.26624.objecter dump_active .. 0 homeless 2026-02-24T19:24:09.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.278+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f674005c980 con 0x7f675415d070 2026-02-24T19:24:09.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.278+0000 7f672ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:09.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.278+0000 7f672ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:09.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.383+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f6754165d30 con 0x7f6724077dd0 2026-02-24T19:24:09.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.383+0000 7f672ffff640 1 -- 10.20.193.45:0/2870458730 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7f6754165d30 con 0x7f6724077dd0 2026-02-24T19:24:09.387 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 5 to deep-scrub 2026-02-24T19:24:09.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 10 librados: watch_flush enter 2026-02-24T19:24:09.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 10 librados: watch_flush exit 2026-02-24T19:24:09.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 20 client.26624.objecter shutdown clearing up homeless session... 2026-02-24T19:24:09.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 10 client.26624.objecter successfully canceled tick 2026-02-24T19:24:09.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6724077dd0 legacy=0x7f6724098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 10 monclient: shutdown 2026-02-24T19:24:09.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 >> v1:10.20.193.179:6789/0 conn(0x7f675415d070 legacy=0x7f67541578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 shutdown_connections 2026-02-24T19:24:09.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 >> 10.20.193.45:0/2870458730 conn(0x7f67540b2ef0 msgr2=0x7f67540b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 shutdown_connections 2026-02-24T19:24:09.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 1 -- 10.20.193.45:0/2870458730 wait complete. 2026-02-24T19:24:09.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.385+0000 7f675a016640 1 librados: shutdown 2026-02-24T19:24:09.397 INFO:tasks.ceph:Scrubbing osd.9 2026-02-24T19:24:09.397 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:09.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.464+0000 7f64b0da2640 10 monclient: get_monmap_and_config 2026-02-24T19:24:09.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.464+0000 7f64b0da2640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.464+0000 7f64b0da2640 10 monclient: monmap: 2026-02-24T19:24:09.467 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.468 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.468 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:09.465144+0000 2026-02-24T19:24:09.468 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:09.465144+0000 2026-02-24T19:24:09.468 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.468 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.468 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.468 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.468 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.468 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.464+0000 7f64b0da2640 1 Processor -- start 2026-02-24T19:24:09.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.464+0000 7f64b0da2640 1 -- start start 2026-02-24T19:24:09.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.464+0000 7f64b0da2640 10 monclient: init 2026-02-24T19:24:09.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:09.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 10 monclient(hunting): picked mon.noname-c con 0x7f64ac15e2a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 10 monclient(hunting): picked mon.noname-a con 0x7f64ac059e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 10 monclient(hunting): picked mon.noname-b con 0x7f64ac1a5660 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac162df0 con 0x7f64ac059e10 2026-02-24T19:24:09.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac1630d0 con 0x7f64ac1a5660 2026-02-24T19:24:09.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac1633b0 con 0x7f64ac15e2a0 2026-02-24T19:24:09.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64b0da2640 10 monclient(hunting): authenticate will time out at 4021.104205s 2026-02-24T19:24:09.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64a9d74640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f64ac059e10 0x7f64ac15ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45968/0 (socket says 10.20.193.45:45968) 2026-02-24T19:24:09.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.465+0000 7f64a9d74640 1 -- 10.20.193.45:0/1805037432 learned_addr learned my addr 10.20.193.45:0/1805037432 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159949636 0 0) 0x7f64ac1633b0 con 0x7f64ac15e2a0 2026-02-24T19:24:09.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): my global_id is 26627 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6498003610 con 0x7f64ac15e2a0 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616077838 0 0) 0x7f64ac162df0 con 0x7f64ac059e10 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): my global_id is 30687 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64ac1633b0 con 0x7f64ac059e10 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577451242 0 0) 0x7f64ac1630d0 con 0x7f64ac1a5660 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 10 monclient(hunting): my global_id is 28153 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.467+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64ac162df0 con 0x7f64ac1a5660 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2651629664 0 0) 0x7f6498003610 con 0x7f64ac15e2a0 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 >> v1:10.20.193.114:6789/0 conn(0x7f64ac1a5660 legacy=0x7f64ac1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 >> v1:10.20.193.45:6789/0 conn(0x7f64ac059e10 legacy=0x7f64ac15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 1 monclient: found mon.noname-c 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac163690 con 0x7f64ac15e2a0 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f64a0002df0 con 0x7f64ac15e2a0 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64a9573640 10 monclient: dump: 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.479 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64b0da2640 5 monclient: authenticate success, global_id 26627 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.468+0000 7f64b0da2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64a0002fc0 con 0x7f64ac15e2a0 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64a9573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64a9573640 1 -- 10.20.193.45:0/1805037432 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f64a0003400 con 0x7f64ac15e2a0 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64a9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64a9573640 10 monclient: dump: 2026-02-24T19:24:09.480 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64b0da2640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64b0da2640 4 set_mon_vals no callback set 2026-02-24T19:24:09.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64b0da2640 10 monclient: shutdown 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64b0da2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64b0da2640 1 -- 10.20.193.45:0/1805037432 >> v1:10.20.193.179:6789/0 conn(0x7f64ac15e2a0 legacy=0x7f64ac05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64b0da2640 1 -- 10.20.193.45:0/1805037432 shutdown_connections 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64b0da2640 1 -- 10.20.193.45:0/1805037432 >> 10.20.193.45:0/1805037432 conn(0x7f64ac0b2f60 msgr2=0x7f64ac0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64b0da2640 1 -- 10.20.193.45:0/1805037432 shutdown_connections 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.469+0000 7f64b0da2640 1 -- 10.20.193.45:0/1805037432 wait complete. 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 10 monclient: monmap: 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:09.482 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 1 librados: starting msgr at 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 1 librados: starting objecter 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 1 Processor -- start 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 1 -- start start 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 1 librados: setting wanted keys 2026-02-24T19:24:09.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 1 librados: calling monclient init 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.470+0000 7f64b0da2640 10 monclient: init 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 10 monclient(hunting): picked mon.noname-a con 0x7f64ac059e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 10 monclient(hunting): picked mon.noname-c con 0x7f64ac15e2a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 10 monclient(hunting): picked mon.noname-b con 0x7f64ac1a5660 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac1289b0 con 0x7f64ac059e10 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac056090 con 0x7f64ac1a5660 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ac1952a0 con 0x7f64ac15e2a0 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64b0da2640 10 monclient(hunting): authenticate will time out at 4021.110147s 2026-02-24T19:24:09.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64aa575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f64ac059e10 0x7f64ac057890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45978/0 (socket says 10.20.193.45:45978) 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f64aa575640 1 -- 10.20.193.45:0/195889437 learned_addr learned my addr 10.20.193.45:0/195889437 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f6492ffd640 10 client.?.objecter ms_handle_connect 0x7f64ac059e10 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f6492ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f6492ffd640 10 client.?.objecter ms_handle_connect 0x7f64ac1a5660 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f6492ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f6492ffd640 10 client.?.objecter ms_handle_connect 0x7f64ac15e2a0 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.471+0000 7f6492ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537295386 0 0) 0x7f64ac1289b0 con 0x7f64ac059e10 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 10 monclient(hunting): my global_id is 30690 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6478003610 con 0x7f64ac059e10 2026-02-24T19:24:09.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395141976 0 0) 0x7f64ac056090 con 0x7f64ac1a5660 2026-02-24T19:24:09.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 10 monclient(hunting): my global_id is 28156 2026-02-24T19:24:09.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.472+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64ac1289b0 con 0x7f64ac1a5660 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.473+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229929639 0 0) 0x7f64ac1952a0 con 0x7f64ac15e2a0 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.473+0000 7f6492ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.473+0000 7f6492ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.473+0000 7f6492ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.473+0000 7f6492ffd640 10 monclient(hunting): my global_id is 26630 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.473+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64ac056090 con 0x7f64ac15e2a0 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.475+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3910939302 0 0) 0x7f6478003610 con 0x7f64ac059e10 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.475+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f64ac1952a0 con 0x7f64ac059e10 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.475+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f64a0003310 con 0x7f64ac059e10 2026-02-24T19:24:09.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.475+0000 7f6492ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.475+0000 7f6492ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.475+0000 7f6492ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.490 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.475+0000 7f6492ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.476+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2742974462 0 0) 0x7f64ac056090 con 0x7f64ac15e2a0 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.476+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6478003610 con 0x7f64ac15e2a0 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.476+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6494002ff0 con 0x7f64ac15e2a0 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.476+0000 7f6492ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.476+0000 7f6492ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.476+0000 7f6492ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.491 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.477+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3710236185 0 0) 0x7f64ac1289b0 con 0x7f64ac1a5660 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.477+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f64ac056090 con 0x7f64ac1a5660 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.477+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f649c003410 con 0x7f64ac1a5660 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.477+0000 7f6492ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.477+0000 7f6492ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.477+0000 7f6492ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:09.492 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2056691668 0 0) 0x7f64ac1952a0 con 0x7f64ac059e10 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 >> v1:10.20.193.179:6789/0 conn(0x7f64ac15e2a0 legacy=0x7f64ac055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 >> v1:10.20.193.114:6789/0 conn(0x7f64ac1a5660 legacy=0x7f64ac1292b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 1 monclient: found mon.a 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac195580 con 0x7f64ac059e10 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f6492ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 5 monclient: authenticate success, global_id 30690 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 10 monclient: _renew_subs 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac195860 con 0x7f64ac059e10 2026-02-24T19:24:09.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 10 client.30690.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 10 monclient: _renew_subs 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f64ac195e20 con 0x7f64ac059e10 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 1 librados: init done 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 10 client.30690.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 15 client.30690.objecter _session_command_op_assign -1 1 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 20 client.30690.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 10 client.30690.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:09.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.478+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f64ac0b05e0 con 0x7f64ac059e10 2026-02-24T19:24:09.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.487+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64ac0b05e0 con 0x7f64ac059e10 2026-02-24T19:24:09.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.487+0000 7f6492ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.487+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f64a0003960 con 0x7f64ac059e10 2026-02-24T19:24:09.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.487+0000 7f6492ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.487+0000 7f6492ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:09.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.487+0000 7f64a8d72640 4 set_mon_vals no callback set 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.487+0000 7f6492ffd640 10 monclient: dump: 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.487+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f64a0003b70 con 0x7f64ac059e10 2026-02-24T19:24:09.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.488+0000 7f64a9d74640 10 monclient: get_auth_request con 0x7f6478077e20 auth_method 0 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.488+0000 7f6492ffd640 10 client.30690.objecter ms_handle_connect 0x7f6478077e20 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f64a0093110 con 0x7f64ac059e10 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 10 client.30690.objecter ms_dispatch2 0x7f64ac000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 3 client.30690.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 3 client.30690.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 10 client.30690.objecter checking command 1 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 20 client.30690.objecter _get_session s=0x7f64780a20f0 osd=9 3 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 20 client.30690.objecter put_session s=0x7f64780a20f0 osd=9 3 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 15 client.30690.objecter _session_command_op_remove -1 1 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 20 client.30690.objecter _get_session s=0x7f64780a20f0 osd=9 3 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 20 client.30690.objecter get_session s=0x7f64780a20f0 osd=9 3 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 15 client.30690.objecter _session_command_op_assign 9 1 2026-02-24T19:24:09.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 20 client.30690.objecter put_session s=0x7f64780a20f0 osd=9 4 2026-02-24T19:24:09.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 10 client.30690.objecter _send_command 1 2026-02-24T19:24:09.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.114:6800/2864194603 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64a0002fc0 con 0x7f64780a27a0 2026-02-24T19:24:09.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 20 client.30690.objecter dump_active .. 0 homeless 2026-02-24T19:24:09.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f64a00597b0 con 0x7f64ac059e10 2026-02-24T19:24:09.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f6492ffd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:09.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.489+0000 7f64aad76640 10 monclient: get_auth_request con 0x7f64780a27a0 auth_method 0 2026-02-24T19:24:09.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.491+0000 7f6492ffd640 10 client.30690.objecter ms_handle_connect 0x7f64780a27a0 2026-02-24T19:24:09.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.502+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== osd.9 v1:10.20.193.114:6800/2864194603 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f64a0002fc0 con 0x7f64780a27a0 2026-02-24T19:24:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.502+0000 7f6492ffd640 10 client.30690.objecter ms_dispatch2 0x7f64ac000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.502+0000 7f6492ffd640 10 client.30690.objecter _finish_command 1 = system:0 2026-02-24T19:24:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.502+0000 7f6492ffd640 20 client.30690.objecter put_session s=0x7f64780a20f0 osd=9 4 2026-02-24T19:24:09.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.502+0000 7f6492ffd640 15 client.30690.objecter _session_command_op_remove 9 1 2026-02-24T19:24:09.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 10 client.30690.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 15 client.30690.objecter _session_command_op_assign -1 2 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 20 client.30690.objecter _get_session s=0x7f64780a20f0 osd=9 3 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 20 client.30690.objecter put_session s=0x7f64780a20f0 osd=9 3 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 20 client.30690.objecter _get_session s=0x7f64780a20f0 osd=9 3 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 15 client.30690.objecter _session_command_op_remove -1 2 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 20 client.30690.objecter get_session s=0x7f64780a20f0 osd=9 3 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 15 client.30690.objecter _session_command_op_assign 9 2 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 20 client.30690.objecter put_session s=0x7f64780a20f0 osd=9 4 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 10 client.30690.objecter _send_command 2 2026-02-24T19:24:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.509+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 --> v1:10.20.193.114:6800/2864194603 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f64ac196520 con 0x7f64780a27a0 2026-02-24T19:24:09.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f6492ffd640 1 -- 10.20.193.45:0/195889437 <== osd.9 v1:10.20.193.114:6800/2864194603 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f64ac196520 con 0x7f64780a27a0 2026-02-24T19:24:09.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f6492ffd640 10 client.30690.objecter ms_dispatch2 0x7f64ac000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:09.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f6492ffd640 10 client.30690.objecter _finish_command 2 = system:0 2026-02-24T19:24:09.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f6492ffd640 20 client.30690.objecter put_session s=0x7f64780a20f0 osd=9 4 2026-02-24T19:24:09.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f6492ffd640 15 client.30690.objecter _session_command_op_remove 9 2 2026-02-24T19:24:09.522 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:09.522 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:09.522 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:09.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 10 librados: watch_flush enter 2026-02-24T19:24:09.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 10 librados: watch_flush exit 2026-02-24T19:24:09.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 10 client.30690.objecter close_session for osd.9 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 >> v1:10.20.193.114:6800/2864194603 conn(0x7f64780a27a0 legacy=0x7f64780c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 20 client.30690.objecter put_session s=0x7f64780a20f0 osd=9 1 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 20 client.30690.objecter shutdown clearing up homeless session... 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 10 client.30690.objecter successfully canceled tick 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6478077e20 legacy=0x7f64780982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 10 monclient: shutdown 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 >> v1:10.20.193.45:6789/0 conn(0x7f64ac059e10 legacy=0x7f64ac057890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.517+0000 7f64aad76640 1 -- 10.20.193.45:0/195889437 reap_dead start 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.518+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 shutdown_connections 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.518+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 >> 10.20.193.45:0/195889437 conn(0x7f64ac0b2f60 msgr2=0x7f64ac15bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.518+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 shutdown_connections 2026-02-24T19:24:09.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.518+0000 7f64b0da2640 1 -- 10.20.193.45:0/195889437 wait complete. 2026-02-24T19:24:09.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.518+0000 7f64b0da2640 1 librados: shutdown 2026-02-24T19:24:09.529 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-24T19:24:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.592+0000 7f59a3ee8640 10 monclient: get_monmap_and_config 2026-02-24T19:24:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.592+0000 7f59a3ee8640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.592+0000 7f59a3ee8640 10 monclient: monmap: 2026-02-24T19:24:09.596 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.596 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.596 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:09.593888+0000 2026-02-24T19:24:09.596 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:09.593888+0000 2026-02-24T19:24:09.597 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.597 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.597 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.597 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.597 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.597 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 1 Processor -- start 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 1 -- start start 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 10 monclient: init 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 10 monclient(hunting): picked mon.noname-a con 0x7f599c157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 10 monclient(hunting): picked mon.noname-c con 0x7f599c157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 10 monclient(hunting): picked mon.noname-b con 0x7f599c164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c05de70 con 0x7f599c157780 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c055b20 con 0x7f599c164d00 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c055e00 con 0x7f599c157b50 2026-02-24T19:24:09.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.593+0000 7f59a3ee8640 10 monclient(hunting): authenticate will time out at 4021.232802s 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.594+0000 7f59a245e640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f599c164d00 0x7f599c1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35118/0 (socket says 10.20.193.45:35118) 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.594+0000 7f59a245e640 1 -- 10.20.193.45:0/2015203781 learned_addr learned my addr 10.20.193.45:0/2015203781 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813275793 0 0) 0x7f599c055e00 con 0x7f599c157b50 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): my global_id is 26633 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5984003610 con 0x7f599c157b50 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384379131 0 0) 0x7f599c055b20 con 0x7f599c164d00 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): my global_id is 28159 2026-02-24T19:24:09.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f599c055e00 con 0x7f599c164d00 2026-02-24T19:24:09.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018891184 0 0) 0x7f599c05de70 con 0x7f599c157780 2026-02-24T19:24:09.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 10 monclient(hunting): my global_id is 30693 2026-02-24T19:24:09.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.595+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f599c055b20 con 0x7f599c157780 2026-02-24T19:24:09.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1165245453 0 0) 0x7f5984003610 con 0x7f599c157b50 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 >> v1:10.20.193.114:6789/0 conn(0x7f599c164d00 legacy=0x7f599c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 >> v1:10.20.193.45:6789/0 conn(0x7f599c157780 legacy=0x7f599c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 1 monclient: found mon.noname-c 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c0560e0 con 0x7f599c157b50 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5990002df0 con 0x7f599c157b50 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a0c5b640 10 monclient: dump: 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.609 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a3ee8640 5 monclient: authenticate success, global_id 26633 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.597+0000 7f59a3ee8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.598+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5990002fc0 con 0x7f599c157b50 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.598+0000 7f59a0c5b640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.598+0000 7f59a0c5b640 1 -- 10.20.193.45:0/2015203781 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5990003400 con 0x7f599c157b50 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.598+0000 7f59a0c5b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.598+0000 7f59a0c5b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.598+0000 7f59a0c5b640 10 monclient: dump: 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.610 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.598+0000 7f59a3ee8640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.598+0000 7f59a3ee8640 4 set_mon_vals no callback set 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.599+0000 7f59a3ee8640 10 monclient: shutdown 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.599+0000 7f59a3ee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.599+0000 7f59a3ee8640 1 -- 10.20.193.45:0/2015203781 >> v1:10.20.193.179:6789/0 conn(0x7f599c157b50 legacy=0x7f599c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.599+0000 7f59a3ee8640 1 -- 10.20.193.45:0/2015203781 shutdown_connections 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.599+0000 7f59a3ee8640 1 -- 10.20.193.45:0/2015203781 >> 10.20.193.45:0/2015203781 conn(0x7f599c0b2ef0 msgr2=0x7f599c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.599+0000 7f59a3ee8640 1 -- 10.20.193.45:0/2015203781 shutdown_connections 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.599+0000 7f59a3ee8640 1 -- 10.20.193.45:0/2015203781 wait complete. 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient: monmap: 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.612 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 1 librados: starting msgr at 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 1 librados: starting objecter 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 1 Processor -- start 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 1 -- start start 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 1 librados: setting wanted keys 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 1 librados: calling monclient init 2026-02-24T19:24:09.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient: init 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient(hunting): picked mon.noname-a con 0x7f599c157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient(hunting): picked mon.noname-c con 0x7f599c157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient(hunting): picked mon.noname-b con 0x7f599c164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c146ce0 con 0x7f599c157780 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c135bf0 con 0x7f599c164d00 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c135ed0 con 0x7f599c157b50 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.600+0000 7f59a3ee8640 10 monclient(hunting): authenticate will time out at 4021.239903s 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.601+0000 7f59a1c5d640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f599c157780 0x7f599c149ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45996/0 (socket says 10.20.193.45:45996) 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.601+0000 7f59a1c5d640 1 -- 10.20.193.45:0/1546066981 learned_addr learned my addr 10.20.193.45:0/1546066981 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.601+0000 7f598a7fc640 10 client.?.objecter ms_handle_connect 0x7f599c157780 2026-02-24T19:24:09.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.601+0000 7f598a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.601+0000 7f598a7fc640 10 client.?.objecter ms_handle_connect 0x7f599c164d00 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.601+0000 7f598a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.601+0000 7f598a7fc640 10 client.?.objecter ms_handle_connect 0x7f599c157b50 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.601+0000 7f598a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056419089 0 0) 0x7f599c146ce0 con 0x7f599c157780 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): my global_id is 30696 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f596c003610 con 0x7f599c157780 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211266359 0 0) 0x7f599c135bf0 con 0x7f599c164d00 2026-02-24T19:24:09.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): my global_id is 28162 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f599c146ce0 con 0x7f599c164d00 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220117520 0 0) 0x7f599c135ed0 con 0x7f599c157b50 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 10 monclient(hunting): my global_id is 26636 2026-02-24T19:24:09.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.602+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f599c135bf0 con 0x7f599c157b50 2026-02-24T19:24:09.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1114914654 0 0) 0x7f596c003610 con 0x7f599c157780 2026-02-24T19:24:09.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f599c135ed0 con 0x7f599c157780 2026-02-24T19:24:09.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f598c003170 con 0x7f599c157780 2026-02-24T19:24:09.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:09.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:09.619 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.619 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.619 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3669453958 0 0) 0x7f599c146ce0 con 0x7f599c164d00 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f596c003610 con 0x7f599c164d00 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5998003370 con 0x7f599c164d00 2026-02-24T19:24:09.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 76543737 0 0) 0x7f599c135bf0 con 0x7f599c157b50 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f599c146ce0 con 0x7f599c157b50 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5990003310 con 0x7f599c157b50 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.605+0000 7f598a7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.622 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3689595473 0 0) 0x7f599c135ed0 con 0x7f599c157780 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 >> v1:10.20.193.179:6789/0 conn(0x7f599c157b50 legacy=0x7f599c0577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 >> v1:10.20.193.114:6789/0 conn(0x7f599c164d00 legacy=0x7f599c145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 1 monclient: found mon.a 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c1361b0 con 0x7f599c157780 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f598a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f59a3ee8640 5 monclient: authenticate success, global_id 30696 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f59a3ee8640 10 monclient: _renew_subs 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f59a3ee8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f599c057ed0 con 0x7f599c157780 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f59a3ee8640 10 client.30696.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f59a3ee8640 10 monclient: _renew_subs 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f59a3ee8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f599c146880 con 0x7f599c157780 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.606+0000 7f59a3ee8640 1 librados: init done 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.607+0000 7f59a3ee8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.607+0000 7f59a3ee8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.607+0000 7f59a3ee8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:09.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.607+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c165740 con 0x7f599c157780 2026-02-24T19:24:09.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.736+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f598c003310 con 0x7f599c157780 2026-02-24T19:24:09.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.736+0000 7f598a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.736+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f598c003b50 con 0x7f599c157780 2026-02-24T19:24:09.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.736+0000 7f598a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.736+0000 7f598a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:09.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.736+0000 7f598a7fc640 10 monclient: dump: 2026-02-24T19:24:09.740 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.740 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.740 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.741 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.741 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.741 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.741 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.741 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.741 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.741 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.736+0000 7f598bfff640 4 set_mon_vals no callback set 2026-02-24T19:24:09.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.737+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f598c003d30 con 0x7f599c157780 2026-02-24T19:24:09.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.737+0000 7f59a145c640 10 monclient: get_auth_request con 0x7f596c077e70 auth_method 0 2026-02-24T19:24:09.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.737+0000 7f598a7fc640 10 client.30696.objecter ms_handle_connect 0x7f596c077e70 2026-02-24T19:24:09.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.740+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f598c093250 con 0x7f599c157780 2026-02-24T19:24:09.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.740+0000 7f598a7fc640 10 client.30696.objecter ms_dispatch2 0x7f599c000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:09.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.740+0000 7f598a7fc640 3 client.30696.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:09.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.740+0000 7f598a7fc640 3 client.30696.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:09.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.740+0000 7f598a7fc640 20 client.30696.objecter dump_active .. 0 homeless 2026-02-24T19:24:09.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.740+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f599c165740 con 0x7f599c157780 2026-02-24T19:24:09.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.740+0000 7f598a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:09.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.740+0000 7f598a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:09.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.845+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7f599c05e250 con 0x7f596c077e70 2026-02-24T19:24:09.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.845+0000 7f598a7fc640 1 -- 10.20.193.45:0/1546066981 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (unknown 795720238 0 0) 0x7f599c05e250 con 0x7f596c077e70 2026-02-24T19:24:09.849 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 9 to deep-scrub 2026-02-24T19:24:09.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 10 librados: watch_flush enter 2026-02-24T19:24:09.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 10 librados: watch_flush exit 2026-02-24T19:24:09.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 20 client.30696.objecter shutdown clearing up homeless session... 2026-02-24T19:24:09.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 10 client.30696.objecter successfully canceled tick 2026-02-24T19:24:09.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 >> v1:10.20.193.45:6800/1599977652 conn(0x7f596c077e70 legacy=0x7f596c098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 10 monclient: shutdown 2026-02-24T19:24:09.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 >> v1:10.20.193.45:6789/0 conn(0x7f599c157780 legacy=0x7f599c149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 shutdown_connections 2026-02-24T19:24:09.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 >> 10.20.193.45:0/1546066981 conn(0x7f599c0b2ef0 msgr2=0x7f599c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 shutdown_connections 2026-02-24T19:24:09.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 1 -- 10.20.193.45:0/1546066981 wait complete. 2026-02-24T19:24:09.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.846+0000 7f59a3ee8640 1 librados: shutdown 2026-02-24T19:24:09.859 INFO:tasks.ceph:Scrubbing osd.13 2026-02-24T19:24:09.859 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:09.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.926+0000 7fc3786c6640 10 monclient: get_monmap_and_config 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.926+0000 7fc3786c6640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.926+0000 7fc3786c6640 10 monclient: monmap: 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:09.927482+0000 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:09.927482+0000 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.930 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.931 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.931 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.926+0000 7fc3786c6640 1 Processor -- start 2026-02-24T19:24:09.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.926+0000 7fc3786c6640 1 -- start start 2026-02-24T19:24:09.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.926+0000 7fc3786c6640 10 monclient: init 2026-02-24T19:24:09.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:09.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 10 monclient(hunting): picked mon.noname-c con 0x7fc37015e2a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 10 monclient(hunting): picked mon.noname-b con 0x7fc370059e10 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 10 monclient(hunting): picked mon.noname-a con 0x7fc3701a5660 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc370162df0 con 0x7fc3701a5660 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3701630d0 con 0x7fc370059e10 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3701633b0 con 0x7fc37015e2a0 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc3786c6640 10 monclient(hunting): authenticate will time out at 4021.566428s 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc376c3c640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc3701a5660 0x7fc3701c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46008/0 (socket says 10.20.193.45:46008) 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.927+0000 7fc376c3c640 1 -- 10.20.193.45:0/3844439589 learned_addr learned my addr 10.20.193.45:0/3844439589 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.928+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4074857256 0 0) 0x7fc370162df0 con 0x7fc3701a5660 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): my global_id is 30699 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc358003610 con 0x7fc3701a5660 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485309206 0 0) 0x7fc3701633b0 con 0x7fc37015e2a0 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): my global_id is 26639 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc370162df0 con 0x7fc37015e2a0 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770196885 0 0) 0x7fc3701630d0 con 0x7fc370059e10 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 10 monclient(hunting): my global_id is 28165 2026-02-24T19:24:09.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.929+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3701633b0 con 0x7fc370059e10 2026-02-24T19:24:09.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3386292982 0 0) 0x7fc370162df0 con 0x7fc37015e2a0 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 >> v1:10.20.193.114:6789/0 conn(0x7fc370059e10 legacy=0x7fc37015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 >> v1:10.20.193.45:6789/0 conn(0x7fc3701a5660 legacy=0x7fc3701c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 1 monclient: found mon.noname-c 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc370163690 con 0x7fc37015e2a0 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc360002df0 con 0x7fc37015e2a0 2026-02-24T19:24:09.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc3786c6640 5 monclient: authenticate success, global_id 26639 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc3786c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc375439640 10 monclient: dump: 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.944 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.930+0000 7fc3786c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc360002fc0 con 0x7fc37015e2a0 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc375439640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc375439640 1 -- 10.20.193.45:0/3844439589 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc360003400 con 0x7fc37015e2a0 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc3786c6640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc375439640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc3786c6640 4 set_mon_vals no callback set 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc375439640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc375439640 10 monclient: dump: 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.945 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc3786c6640 10 monclient: shutdown 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc3786c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc3786c6640 1 -- 10.20.193.45:0/3844439589 >> v1:10.20.193.179:6789/0 conn(0x7fc37015e2a0 legacy=0x7fc37005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc3786c6640 1 -- 10.20.193.45:0/3844439589 shutdown_connections 2026-02-24T19:24:09.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc3786c6640 1 -- 10.20.193.45:0/3844439589 >> 10.20.193.45:0/3844439589 conn(0x7fc3700b2f60 msgr2=0x7fc3700b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc3786c6640 1 -- 10.20.193.45:0/3844439589 shutdown_connections 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.931+0000 7fc3786c6640 1 -- 10.20.193.45:0/3844439589 wait complete. 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 10 monclient: build_initial_monmap 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 10 monclient: monmap: 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:09.947 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 1 librados: starting msgr at 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 1 librados: starting objecter 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 1 Processor -- start 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 1 -- start start 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 1 librados: setting wanted keys 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 1 librados: calling monclient init 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 10 monclient: init 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.932+0000 7fc3786c6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc3786c6640 10 monclient(hunting): picked mon.noname-b con 0x7fc370059e10 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:09.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc3786c6640 10 monclient(hunting): picked mon.noname-c con 0x7fc37015e2a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc3786c6640 10 monclient(hunting): picked mon.noname-a con 0x7fc3701a5660 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc3786c6640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3700572a0 con 0x7fc3701a5660 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc3786c6640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc370160f80 con 0x7fc370059e10 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc3786c6640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc370161260 con 0x7fc37015e2a0 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc3786c6640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc3786c6640 10 monclient(hunting): authenticate will time out at 4021.572044s 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc376c3c640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc3701a5660 0x7fc3700b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46010/0 (socket says 10.20.193.45:46010) 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc376c3c640 1 -- 10.20.193.45:0/2755790249 learned_addr learned my addr 10.20.193.45:0/2755790249 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc356ffd640 10 client.?.objecter ms_handle_connect 0x7fc3701a5660 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc356ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc356ffd640 10 client.?.objecter ms_handle_connect 0x7fc37015e2a0 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc356ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc356ffd640 10 client.?.objecter ms_handle_connect 0x7fc370059e10 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.933+0000 7fc356ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816107410 0 0) 0x7fc370161260 con 0x7fc37015e2a0 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): my global_id is 26642 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc340003610 con 0x7fc37015e2a0 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232664371 0 0) 0x7fc358003610 con 0x7fc3701a5660 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): my global_id is 30702 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc370161260 con 0x7fc3701a5660 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730950604 0 0) 0x7fc370160f80 con 0x7fc370059e10 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 10 monclient(hunting): my global_id is 28168 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.934+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc358003610 con 0x7fc370059e10 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.936+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 311092939 0 0) 0x7fc340003610 con 0x7fc37015e2a0 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc370160f80 con 0x7fc37015e2a0 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc364002fb0 con 0x7fc37015e2a0 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:09.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3627412495 0 0) 0x7fc370161260 con 0x7fc3701a5660 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc340003610 con 0x7fc3701a5660 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc36c0033b0 con 0x7fc3701a5660 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.953 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3164527774 0 0) 0x7fc358003610 con 0x7fc370059e10 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc370161260 con 0x7fc370059e10 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc360003310 con 0x7fc370059e10 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.937+0000 7fc356ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.954 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3419699775 0 0) 0x7fc370160f80 con 0x7fc37015e2a0 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 >> v1:10.20.193.114:6789/0 conn(0x7fc370059e10 legacy=0x7fc370121fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 >> v1:10.20.193.45:6789/0 conn(0x7fc3701a5660 legacy=0x7fc3700b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 1 monclient: found mon.c 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc370161540 con 0x7fc37015e2a0 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc356ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc3786c6640 5 monclient: authenticate success, global_id 26642 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc3786c6640 10 monclient: _renew_subs 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc3786c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc370161820 con 0x7fc37015e2a0 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc3786c6640 10 client.26642.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc3786c6640 10 monclient: _renew_subs 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc3786c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc370160c30 con 0x7fc37015e2a0 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.938+0000 7fc3786c6640 1 librados: init done 2026-02-24T19:24:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.939+0000 7fc3786c6640 10 client.26642.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.939+0000 7fc3786c6640 15 client.26642.objecter _session_command_op_assign -1 1 2026-02-24T19:24:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.939+0000 7fc3786c6640 20 client.26642.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.939+0000 7fc3786c6640 10 client.26642.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.939+0000 7fc3786c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.939+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc37015f420 con 0x7fc37015e2a0 2026-02-24T19:24:09.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.946+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc37015f420 con 0x7fc37015e2a0 2026-02-24T19:24:09.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.946+0000 7fc356ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:09.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.946+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc364003700 con 0x7fc37015e2a0 2026-02-24T19:24:09.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.946+0000 7fc356ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:09.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.946+0000 7fc356ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:09.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.946+0000 7fc356ffd640 10 monclient: dump: 2026-02-24T19:24:09.959 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:09.959 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:09.959 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.946+0000 7fc374c38640 4 set_mon_vals no callback set 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.947+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fc36401c570 con 0x7fc37015e2a0 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.947+0000 7fc37643b640 10 monclient: get_auth_request con 0x7fc340077ea0 auth_method 0 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 10 client.26642.objecter ms_handle_connect 0x7fc340077ea0 2026-02-24T19:24:09.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fc364091d20 con 0x7fc37015e2a0 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 10 client.26642.objecter ms_dispatch2 0x7fc370000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 3 client.26642.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 3 client.26642.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 10 client.26642.objecter checking command 1 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 20 client.26642.objecter _get_session s=0x7fc3400a2170 osd=13 3 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 20 client.26642.objecter put_session s=0x7fc3400a2170 osd=13 3 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 15 client.26642.objecter _session_command_op_remove -1 1 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 20 client.26642.objecter _get_session s=0x7fc3400a2170 osd=13 3 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 20 client.26642.objecter get_session s=0x7fc3400a2170 osd=13 3 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 15 client.26642.objecter _session_command_op_assign 13 1 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 20 client.26642.objecter put_session s=0x7fc3400a2170 osd=13 4 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 10 client.26642.objecter _send_command 1 2026-02-24T19:24:09.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.114:6812/3533295890 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3400c4480 con 0x7fc3400a2820 2026-02-24T19:24:09.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 20 client.26642.objecter dump_active .. 0 homeless 2026-02-24T19:24:09.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fc36405be20 con 0x7fc37015e2a0 2026-02-24T19:24:09.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.948+0000 7fc356ffd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:09.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.949+0000 7fc376c3c640 10 monclient: get_auth_request con 0x7fc3400a2820 auth_method 0 2026-02-24T19:24:09.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.950+0000 7fc356ffd640 10 client.26642.objecter ms_handle_connect 0x7fc3400a2820 2026-02-24T19:24:09.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.959+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== osd.13 v1:10.20.193.114:6812/3533295890 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc3400c4480 con 0x7fc3400a2820 2026-02-24T19:24:09.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.959+0000 7fc356ffd640 10 client.26642.objecter ms_dispatch2 0x7fc370000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:09.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.959+0000 7fc356ffd640 10 client.26642.objecter _finish_command 1 = system:0 2026-02-24T19:24:09.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.959+0000 7fc356ffd640 20 client.26642.objecter put_session s=0x7fc3400a2170 osd=13 4 2026-02-24T19:24:09.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.959+0000 7fc356ffd640 15 client.26642.objecter _session_command_op_remove 13 1 2026-02-24T19:24:09.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 10 client.26642.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:09.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 15 client.26642.objecter _session_command_op_assign -1 2 2026-02-24T19:24:09.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 20 client.26642.objecter _get_session s=0x7fc3400a2170 osd=13 3 2026-02-24T19:24:09.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 20 client.26642.objecter put_session s=0x7fc3400a2170 osd=13 3 2026-02-24T19:24:09.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 20 client.26642.objecter _get_session s=0x7fc3400a2170 osd=13 3 2026-02-24T19:24:09.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 15 client.26642.objecter _session_command_op_remove -1 2 2026-02-24T19:24:09.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 20 client.26642.objecter get_session s=0x7fc3400a2170 osd=13 3 2026-02-24T19:24:09.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 15 client.26642.objecter _session_command_op_assign 13 2 2026-02-24T19:24:09.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 20 client.26642.objecter put_session s=0x7fc3400a2170 osd=13 4 2026-02-24T19:24:09.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 10 client.26642.objecter _send_command 2 2026-02-24T19:24:09.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.967+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 --> v1:10.20.193.114:6812/3533295890 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc370055980 con 0x7fc3400a2820 2026-02-24T19:24:09.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.974+0000 7fc356ffd640 1 -- 10.20.193.45:0/2755790249 <== osd.13 v1:10.20.193.114:6812/3533295890 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc370055980 con 0x7fc3400a2820 2026-02-24T19:24:09.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.974+0000 7fc356ffd640 10 client.26642.objecter ms_dispatch2 0x7fc370000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:09.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.974+0000 7fc356ffd640 10 client.26642.objecter _finish_command 2 = system:0 2026-02-24T19:24:09.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.974+0000 7fc356ffd640 20 client.26642.objecter put_session s=0x7fc3400a2170 osd=13 4 2026-02-24T19:24:09.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.974+0000 7fc356ffd640 15 client.26642.objecter _session_command_op_remove 13 2 2026-02-24T19:24:09.979 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:09.979 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:09.979 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:09.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 10 librados: watch_flush enter 2026-02-24T19:24:09.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 10 librados: watch_flush exit 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 10 client.26642.objecter close_session for osd.13 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 >> v1:10.20.193.114:6812/3533295890 conn(0x7fc3400a2820 legacy=0x7fc3400c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 20 client.26642.objecter put_session s=0x7fc3400a2170 osd=13 1 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 20 client.26642.objecter shutdown clearing up homeless session... 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 10 client.26642.objecter successfully canceled tick 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 >> v1:10.20.193.45:6800/1599977652 conn(0x7fc340077ea0 legacy=0x7fc340098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 10 monclient: shutdown 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 >> v1:10.20.193.179:6789/0 conn(0x7fc37015e2a0 legacy=0x7fc370055d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc376c3c640 1 -- 10.20.193.45:0/2755790249 reap_dead start 2026-02-24T19:24:09.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 shutdown_connections 2026-02-24T19:24:09.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 >> 10.20.193.45:0/2755790249 conn(0x7fc3700b2f60 msgr2=0x7fc37005da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:09.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 shutdown_connections 2026-02-24T19:24:09.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 1 -- 10.20.193.45:0/2755790249 wait complete. 2026-02-24T19:24:09.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:09.975+0000 7fc3786c6640 1 librados: shutdown 2026-02-24T19:24:09.986 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-24T19:24:10.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.051+0000 7ff9120e1640 10 monclient: get_monmap_and_config 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.051+0000 7ff9120e1640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.051+0000 7ff9120e1640 10 monclient: monmap: 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:10.052469+0000 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:10.052469+0000 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.055 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.056 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.056 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.051+0000 7ff9120e1640 1 Processor -- start 2026-02-24T19:24:10.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.051+0000 7ff9120e1640 1 -- start start 2026-02-24T19:24:10.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.051+0000 7ff9120e1640 10 monclient: init 2026-02-24T19:24:10.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:10.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 10 monclient(hunting): picked mon.noname-a con 0x7ff90c157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 10 monclient(hunting): picked mon.noname-b con 0x7ff90c157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 10 monclient(hunting): picked mon.noname-c con 0x7ff90c164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c05de70 con 0x7ff90c157780 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c055b20 con 0x7ff90c157b50 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c055e00 con 0x7ff90c164d00 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff9120e1640 10 monclient(hunting): authenticate will time out at 4021.691343s 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff90b7fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7ff90c157780 0x7ff90c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46022/0 (socket says 10.20.193.45:46022) 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.052+0000 7ff90b7fe640 1 -- 10.20.193.45:0/2428705144 learned_addr learned my addr 10.20.193.45:0/2428705144 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.053+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3717711697 0 0) 0x7ff90c05de70 con 0x7ff90c157780 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.053+0000 7ff90a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.053+0000 7ff90a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.053+0000 7ff90a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.053+0000 7ff90a7fc640 10 monclient(hunting): my global_id is 30705 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.053+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f0003610 con 0x7ff90c157780 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872183736 0 0) 0x7ff90c055b20 con 0x7ff90c157b50 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 10 monclient(hunting): my global_id is 28171 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff90c05de70 con 0x7ff90c157b50 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859101171 0 0) 0x7ff90c055e00 con 0x7ff90c164d00 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 10 monclient(hunting): my global_id is 26645 2026-02-24T19:24:10.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.054+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff90c055b20 con 0x7ff90c164d00 2026-02-24T19:24:10.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1427855878 0 0) 0x7ff8f0003610 con 0x7ff90c157780 2026-02-24T19:24:10.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 >> v1:10.20.193.179:6789/0 conn(0x7ff90c164d00 legacy=0x7ff90c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 >> v1:10.20.193.114:6789/0 conn(0x7ff90c157b50 legacy=0x7ff90c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 1 monclient: found mon.noname-a 2026-02-24T19:24:10.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c0560e0 con 0x7ff90c157780 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8f8002df0 con 0x7ff90c157780 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff9120e1640 5 monclient: authenticate success, global_id 30705 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff9120e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff90a7fc640 10 monclient: dump: 2026-02-24T19:24:10.067 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.055+0000 7ff9120e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8f8002fc0 con 0x7ff90c157780 2026-02-24T19:24:10.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff90a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff90a7fc640 1 -- 10.20.193.45:0/2428705144 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8f8003400 con 0x7ff90c157780 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff9120e1640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff9120e1640 4 set_mon_vals no callback set 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff90a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff90a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff90a7fc640 10 monclient: dump: 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.069 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff9120e1640 10 monclient: shutdown 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff9120e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff9120e1640 1 -- 10.20.193.45:0/2428705144 >> v1:10.20.193.45:6789/0 conn(0x7ff90c157780 legacy=0x7ff90c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff9120e1640 1 -- 10.20.193.45:0/2428705144 shutdown_connections 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff9120e1640 1 -- 10.20.193.45:0/2428705144 >> 10.20.193.45:0/2428705144 conn(0x7ff90c0b2ef0 msgr2=0x7ff90c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff9120e1640 1 -- 10.20.193.45:0/2428705144 shutdown_connections 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.056+0000 7ff9120e1640 1 -- 10.20.193.45:0/2428705144 wait complete. 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 10 monclient: monmap: 2026-02-24T19:24:10.070 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 1 librados: starting msgr at 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 1 librados: starting objecter 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:10.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 1 Processor -- start 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 1 -- start start 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 1 librados: setting wanted keys 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 1 librados: calling monclient init 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 10 monclient: init 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 10 monclient(hunting): picked mon.noname-b con 0x7ff90c157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 10 monclient(hunting): picked mon.noname-a con 0x7ff90c157b50 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.057+0000 7ff9120e1640 10 monclient(hunting): picked mon.noname-c con 0x7ff90c164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff9120e1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c146f00 con 0x7ff90c157b50 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff9120e1640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c136a40 con 0x7ff90c157780 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff9120e1640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff90c136d20 con 0x7ff90c164d00 2026-02-24T19:24:10.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff9120e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff9120e1640 10 monclient(hunting): authenticate will time out at 4021.697013s 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff90b7fe640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7ff90c157780 0x7ff90c149d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35160/0 (socket says 10.20.193.45:35160) 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff90b7fe640 1 -- 10.20.193.45:0/1201769043 learned_addr learned my addr 10.20.193.45:0/1201769043 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff8e7fff640 10 client.?.objecter ms_handle_connect 0x7ff90c157780 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff8e7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff8e7fff640 10 client.?.objecter ms_handle_connect 0x7ff90c164d00 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff8e7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff8e7fff640 10 client.?.objecter ms_handle_connect 0x7ff90c157b50 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.058+0000 7ff8e7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427453319 0 0) 0x7ff90c146f00 con 0x7ff90c157b50 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): my global_id is 30708 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8dc003610 con 0x7ff90c157b50 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4212229088 0 0) 0x7ff90c136a40 con 0x7ff90c157780 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): my global_id is 28174 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff90c146f00 con 0x7ff90c157780 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998990568 0 0) 0x7ff90c136d20 con 0x7ff90c164d00 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 10 monclient(hunting): my global_id is 26648 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.059+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff90c136a40 con 0x7ff90c164d00 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1682577125 0 0) 0x7ff90c146f00 con 0x7ff90c157780 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff90c136d20 con 0x7ff90c157780 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8f8003310 con 0x7ff90c157780 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): dump: 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.075 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1076965878 0 0) 0x7ff8dc003610 con 0x7ff90c157b50 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff90c146f00 con 0x7ff90c157b50 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8fc0030b0 con 0x7ff90c157b50 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:10.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): dump: 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2202469662 0 0) 0x7ff90c136a40 con 0x7ff90c164d00 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8dc003610 con 0x7ff90c164d00 2026-02-24T19:24:10.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff900003330 con 0x7ff90c164d00 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.062+0000 7ff8e7fff640 10 monclient(hunting): dump: 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.078 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2164656051 0 0) 0x7ff90c136d20 con 0x7ff90c157780 2026-02-24T19:24:10.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 >> v1:10.20.193.179:6789/0 conn(0x7ff90c164d00 legacy=0x7ff90c146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 >> v1:10.20.193.45:6789/0 conn(0x7ff90c157b50 legacy=0x7ff90c058c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 1 monclient: found mon.b 2026-02-24T19:24:10.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c137000 con 0x7ff90c157780 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff8e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff9120e1640 5 monclient: authenticate success, global_id 28174 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff9120e1640 10 monclient: _renew_subs 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff9120e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff90c1372e0 con 0x7ff90c157780 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff9120e1640 10 client.28174.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff9120e1640 10 monclient: _renew_subs 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff9120e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:10.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff90c14a420 con 0x7ff90c157780 2026-02-24T19:24:10.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.063+0000 7ff9120e1640 1 librados: init done 2026-02-24T19:24:10.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.064+0000 7ff9120e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.064+0000 7ff9120e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.064+0000 7ff9120e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:10.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.064+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff90c0531e0 con 0x7ff90c157780 2026-02-24T19:24:10.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.155+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8f80029a0 con 0x7ff90c157780 2026-02-24T19:24:10.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.155+0000 7ff8e7fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:10.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.155+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ff8f8004b80 con 0x7ff90c157780 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.155+0000 7ff8e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.155+0000 7ff8e7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.155+0000 7ff8e7fff640 10 monclient: dump: 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.159 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.160 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.155+0000 7ff909ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:10.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.155+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7ff8f8004d60 con 0x7ff90c157780 2026-02-24T19:24:10.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.156+0000 7ff90affd640 10 monclient: get_auth_request con 0x7ff8dc077ed0 auth_method 0 2026-02-24T19:24:10.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.156+0000 7ff8e7fff640 10 client.28174.objecter ms_handle_connect 0x7ff8dc077ed0 2026-02-24T19:24:10.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.157+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7ff8f8093190 con 0x7ff90c157780 2026-02-24T19:24:10.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.157+0000 7ff8e7fff640 10 client.28174.objecter ms_dispatch2 0x7ff90c000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:10.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.157+0000 7ff8e7fff640 3 client.28174.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:10.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.157+0000 7ff8e7fff640 3 client.28174.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:10.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.158+0000 7ff8e7fff640 20 client.28174.objecter dump_active .. 0 homeless 2026-02-24T19:24:10.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.159+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff90c0531e0 con 0x7ff90c157780 2026-02-24T19:24:10.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.159+0000 7ff8e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.159+0000 7ff8e7fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:10.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.263+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7ff90c0b5030 con 0x7ff8dc077ed0 2026-02-24T19:24:10.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.263+0000 7ff8e7fff640 1 -- 10.20.193.45:0/1201769043 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (unknown 1087616222 0 0) 0x7ff90c0b5030 con 0x7ff8dc077ed0 2026-02-24T19:24:10.267 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 13 to deep-scrub 2026-02-24T19:24:10.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 10 librados: watch_flush enter 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 10 librados: watch_flush exit 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 20 client.28174.objecter shutdown clearing up homeless session... 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 10 client.28174.objecter successfully canceled tick 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 >> v1:10.20.193.45:6800/1599977652 conn(0x7ff8dc077ed0 legacy=0x7ff8dc098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 10 monclient: shutdown 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 >> v1:10.20.193.114:6789/0 conn(0x7ff90c157780 legacy=0x7ff90c149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 shutdown_connections 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 >> 10.20.193.45:0/1201769043 conn(0x7ff90c0b2ef0 msgr2=0x7ff90c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 shutdown_connections 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.264+0000 7ff9120e1640 1 -- 10.20.193.45:0/1201769043 wait complete. 2026-02-24T19:24:10.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.265+0000 7ff9120e1640 1 librados: shutdown 2026-02-24T19:24:10.277 INFO:tasks.ceph:Scrubbing osd.2 2026-02-24T19:24:10.277 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:10.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.346+0000 7fca0e108640 10 monclient: get_monmap_and_config 2026-02-24T19:24:10.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.346+0000 7fca0e108640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.346+0000 7fca0e108640 10 monclient: monmap: 2026-02-24T19:24:10.349 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.349 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.350 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:10.347139+0000 2026-02-24T19:24:10.350 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:10.347139+0000 2026-02-24T19:24:10.350 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.350 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.350 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.350 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.350 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.350 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.346+0000 7fca0e108640 1 Processor -- start 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.346+0000 7fca0e108640 1 -- start start 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.346+0000 7fca0e108640 10 monclient: init 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 10 monclient(hunting): picked mon.noname-a con 0x7fca081599b0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 10 monclient(hunting): picked mon.noname-c con 0x7fca08159d80 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 10 monclient(hunting): picked mon.noname-b con 0x7fca08166f10 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca0805dc40 con 0x7fca081599b0 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca0805ab90 con 0x7fca08166f10 2026-02-24T19:24:10.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca08057970 con 0x7fca08159d80 2026-02-24T19:24:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca0e108640 10 monclient(hunting): authenticate will time out at 4021.986370s 2026-02-24T19:24:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca06ffd640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fca08159d80 0x7fca08166800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:42174/0 (socket says 10.20.193.45:42174) 2026-02-24T19:24:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.347+0000 7fca06ffd640 1 -- 10.20.193.45:0/452865062 learned_addr learned my addr 10.20.193.45:0/452865062 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.377+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414853308 0 0) 0x7fca0805dc40 con 0x7fca081599b0 2026-02-24T19:24:10.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.377+0000 7fca067fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.377+0000 7fca067fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.377+0000 7fca067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.377+0000 7fca067fc640 10 monclient(hunting): my global_id is 30711 2026-02-24T19:24:10.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.377+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9ec003610 con 0x7fca081599b0 2026-02-24T19:24:10.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.378+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201116732 0 0) 0x7fca0805ab90 con 0x7fca08166f10 2026-02-24T19:24:10.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.378+0000 7fca067fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.378+0000 7fca067fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.378+0000 7fca067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.378+0000 7fca067fc640 10 monclient(hunting): my global_id is 28177 2026-02-24T19:24:10.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.378+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca0805dc40 con 0x7fca08166f10 2026-02-24T19:24:10.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.379+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1276623344 0 0) 0x7fca08057970 con 0x7fca08159d80 2026-02-24T19:24:10.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.379+0000 7fca067fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.379+0000 7fca067fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.379+0000 7fca067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.379+0000 7fca067fc640 10 monclient(hunting): my global_id is 26651 2026-02-24T19:24:10.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.379+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca0805ab90 con 0x7fca08159d80 2026-02-24T19:24:10.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 348198587 0 0) 0x7fc9ec003610 con 0x7fca081599b0 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 >> v1:10.20.193.179:6789/0 conn(0x7fca08159d80 legacy=0x7fca08166800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 >> v1:10.20.193.114:6789/0 conn(0x7fca08166f10 legacy=0x7fca081c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 1 monclient: found mon.noname-a 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca08057c50 con 0x7fca081599b0 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc9f4002df0 con 0x7fca081599b0 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca067fc640 10 monclient: dump: 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.386 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.387 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.387 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca0e108640 5 monclient: authenticate success, global_id 30711 2026-02-24T19:24:10.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.380+0000 7fca0e108640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:10.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca067fc640 1 -- 10.20.193.45:0/452865062 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc9f4002fc0 con 0x7fca081599b0 2026-02-24T19:24:10.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca067fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:10.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca0e108640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:10.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca0e108640 4 set_mon_vals no callback set 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca0e108640 10 monclient: shutdown 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca0e108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca0e108640 1 -- 10.20.193.45:0/452865062 >> v1:10.20.193.45:6789/0 conn(0x7fca081599b0 legacy=0x7fca080b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca0e108640 1 -- 10.20.193.45:0/452865062 shutdown_connections 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca0e108640 1 -- 10.20.193.45:0/452865062 >> 10.20.193.45:0/452865062 conn(0x7fca080b5200 msgr2=0x7fca080b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca0e108640 1 -- 10.20.193.45:0/452865062 shutdown_connections 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.382+0000 7fca0e108640 1 -- 10.20.193.45:0/452865062 wait complete. 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient: monmap: 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:10.391 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 1 librados: starting msgr at 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 1 librados: starting objecter 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:10.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 1 Processor -- start 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 1 -- start start 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 1 librados: setting wanted keys 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 1 librados: calling monclient init 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient: init 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient(hunting): picked mon.noname-b con 0x7fca081599b0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient(hunting): picked mon.noname-c con 0x7fca08159d80 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient(hunting): picked mon.noname-a con 0x7fca08166f10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca081666d0 con 0x7fca08166f10 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca08164c60 con 0x7fca081599b0 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca08164f40 con 0x7fca08159d80 2026-02-24T19:24:10.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.383+0000 7fca0e108640 10 monclient(hunting): authenticate will time out at 4022.022982s 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.384+0000 7fca077fe640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fca081599b0 0x7fca08165fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35170/0 (socket says 10.20.193.45:35170) 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.384+0000 7fca077fe640 1 -- 10.20.193.45:0/3804750808 learned_addr learned my addr 10.20.193.45:0/3804750808 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.384+0000 7fc9e3fff640 10 client.?.objecter ms_handle_connect 0x7fca08166f10 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.384+0000 7fc9e3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.384+0000 7fc9e3fff640 10 client.?.objecter ms_handle_connect 0x7fca081599b0 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.384+0000 7fc9e3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.384+0000 7fc9e3fff640 10 client.?.objecter ms_handle_connect 0x7fca08159d80 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.384+0000 7fc9e3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 713643325 0 0) 0x7fca08164c60 con 0x7fca081599b0 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): my global_id is 28180 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9d8003610 con 0x7fca081599b0 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2640894191 0 0) 0x7fca081666d0 con 0x7fca08166f10 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): my global_id is 30714 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca08164c60 con 0x7fca08166f10 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987991949 0 0) 0x7fca08164f40 con 0x7fca08159d80 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 10 monclient(hunting): my global_id is 26654 2026-02-24T19:24:10.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.385+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca081666d0 con 0x7fca08159d80 2026-02-24T19:24:10.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2588597630 0 0) 0x7fca081666d0 con 0x7fca08159d80 2026-02-24T19:24:10.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca08164f40 con 0x7fca08159d80 2026-02-24T19:24:10.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc9f8003060 con 0x7fca08159d80 2026-02-24T19:24:10.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:10.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 10 monclient(hunting): dump: 2026-02-24T19:24:10.398 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.398 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.398 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 897626957 0 0) 0x7fca08164c60 con 0x7fca08166f10 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca081666d0 con 0x7fca08166f10 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc9fc003370 con 0x7fca08166f10 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.387+0000 7fc9e3fff640 10 monclient(hunting): dump: 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.388+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 432554277 0 0) 0x7fc9d8003610 con 0x7fca081599b0 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.388+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca08164c60 con 0x7fca081599b0 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.388+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc9f40034a0 con 0x7fca081599b0 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.388+0000 7fc9e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.388+0000 7fc9e3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.388+0000 7fc9e3fff640 10 monclient(hunting): dump: 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.401 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2143744702 0 0) 0x7fca08164f40 con 0x7fca08159d80 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 >> v1:10.20.193.114:6789/0 conn(0x7fca081599b0 legacy=0x7fca08165fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 >> v1:10.20.193.45:6789/0 conn(0x7fca08166f10 legacy=0x7fca0811be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 1 monclient: found mon.c 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca08165220 con 0x7fca08159d80 2026-02-24T19:24:10.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fc9e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fca0e108640 5 monclient: authenticate success, global_id 26654 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fca0e108640 10 monclient: _renew_subs 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fca0e108640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fca08165500 con 0x7fca08159d80 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fca0e108640 10 client.26654.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fca0e108640 10 monclient: _renew_subs 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fca0e108640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fca08165ac0 con 0x7fca08159d80 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.389+0000 7fca0e108640 1 librados: init done 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.390+0000 7fca0e108640 10 client.26654.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.390+0000 7fca0e108640 15 client.26654.objecter _session_command_op_assign -1 1 2026-02-24T19:24:10.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.390+0000 7fca0e108640 20 client.26654.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:10.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.390+0000 7fca0e108640 10 client.26654.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:10.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.390+0000 7fca0e108640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:10.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.390+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fca08056530 con 0x7fca08159d80 2026-02-24T19:24:10.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.397+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca08056530 con 0x7fca08159d80 2026-02-24T19:24:10.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.397+0000 7fc9e3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.397+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc9f8004a70 con 0x7fca08159d80 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.397+0000 7fc9e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.397+0000 7fc9e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.397+0000 7fc9e3fff640 10 monclient: dump: 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.406 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.397+0000 7fca05ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fc9f801d8e0 con 0x7fca08159d80 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fca077fe640 10 monclient: get_auth_request con 0x7fc9d8077e60 auth_method 0 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fc9f8092f60 con 0x7fca08159d80 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 10 client.26654.objecter ms_dispatch2 0x7fca08000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 3 client.26654.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 3 client.26654.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 10 client.26654.objecter checking command 1 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 20 client.26654.objecter _get_session s=0x7fc9d80a2190 osd=2 3 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 20 client.26654.objecter put_session s=0x7fc9d80a2190 osd=2 3 2026-02-24T19:24:10.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 15 client.26654.objecter _session_command_op_remove -1 1 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 20 client.26654.objecter _get_session s=0x7fc9d80a2190 osd=2 3 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 20 client.26654.objecter get_session s=0x7fc9d80a2190 osd=2 3 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 15 client.26654.objecter _session_command_op_assign 2 1 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 20 client.26654.objecter put_session s=0x7fc9d80a2190 osd=2 4 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 10 client.26654.objecter _send_command 1 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.179:6800/3913807646 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9d80c44a0 con 0x7fc9d80a2840 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 20 client.26654.objecter dump_active .. 0 homeless 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 10 client.26654.objecter ms_handle_connect 0x7fc9d8077e60 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fc9f805d060 con 0x7fca08159d80 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.398+0000 7fc9e3fff640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.399+0000 7fca07fff640 10 monclient: get_auth_request con 0x7fc9d80a2840 auth_method 0 2026-02-24T19:24:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.400+0000 7fc9e3fff640 10 client.26654.objecter ms_handle_connect 0x7fc9d80a2840 2026-02-24T19:24:10.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.410+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== osd.2 v1:10.20.193.179:6800/3913807646 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc9d80c44a0 con 0x7fc9d80a2840 2026-02-24T19:24:10.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.410+0000 7fc9e3fff640 10 client.26654.objecter ms_dispatch2 0x7fca08000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:10.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.410+0000 7fc9e3fff640 10 client.26654.objecter _finish_command 1 = system:0 2026-02-24T19:24:10.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.410+0000 7fc9e3fff640 20 client.26654.objecter put_session s=0x7fc9d80a2190 osd=2 4 2026-02-24T19:24:10.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.410+0000 7fc9e3fff640 15 client.26654.objecter _session_command_op_remove 2 1 2026-02-24T19:24:10.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 10 client.26654.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:10.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 15 client.26654.objecter _session_command_op_assign -1 2 2026-02-24T19:24:10.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 20 client.26654.objecter _get_session s=0x7fc9d80a2190 osd=2 3 2026-02-24T19:24:10.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 20 client.26654.objecter put_session s=0x7fc9d80a2190 osd=2 3 2026-02-24T19:24:10.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 20 client.26654.objecter _get_session s=0x7fc9d80a2190 osd=2 3 2026-02-24T19:24:10.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 15 client.26654.objecter _session_command_op_remove -1 2 2026-02-24T19:24:10.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 20 client.26654.objecter get_session s=0x7fc9d80a2190 osd=2 3 2026-02-24T19:24:10.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 15 client.26654.objecter _session_command_op_assign 2 2 2026-02-24T19:24:10.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 20 client.26654.objecter put_session s=0x7fc9d80a2190 osd=2 4 2026-02-24T19:24:10.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 10 client.26654.objecter _send_command 2 2026-02-24T19:24:10.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.417+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 --> v1:10.20.193.179:6800/3913807646 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fca0815d6b0 con 0x7fc9d80a2840 2026-02-24T19:24:10.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fc9e3fff640 1 -- 10.20.193.45:0/3804750808 <== osd.2 v1:10.20.193.179:6800/3913807646 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fca0815d6b0 con 0x7fc9d80a2840 2026-02-24T19:24:10.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fc9e3fff640 10 client.26654.objecter ms_dispatch2 0x7fca08000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:10.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fc9e3fff640 10 client.26654.objecter _finish_command 2 = system:0 2026-02-24T19:24:10.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fc9e3fff640 20 client.26654.objecter put_session s=0x7fc9d80a2190 osd=2 4 2026-02-24T19:24:10.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fc9e3fff640 15 client.26654.objecter _session_command_op_remove 2 2 2026-02-24T19:24:10.429 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:10.430 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:10.430 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:10.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 10 librados: watch_flush enter 2026-02-24T19:24:10.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 10 librados: watch_flush exit 2026-02-24T19:24:10.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 10 client.26654.objecter close_session for osd.2 2026-02-24T19:24:10.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 >> v1:10.20.193.179:6800/3913807646 conn(0x7fc9d80a2840 legacy=0x7fc9d80c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 20 client.26654.objecter put_session s=0x7fc9d80a2190 osd=2 1 2026-02-24T19:24:10.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 20 client.26654.objecter shutdown clearing up homeless session... 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 10 client.26654.objecter successfully canceled tick 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 >> v1:10.20.193.45:6800/1599977652 conn(0x7fc9d8077e60 legacy=0x7fc9d8098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 10 monclient: shutdown 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 >> v1:10.20.193.179:6789/0 conn(0x7fca08159d80 legacy=0x7fca08136250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca07fff640 1 -- 10.20.193.45:0/3804750808 reap_dead start 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 shutdown_connections 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 >> 10.20.193.45:0/3804750808 conn(0x7fca080b5200 msgr2=0x7fca080b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 shutdown_connections 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.425+0000 7fca0e108640 1 -- 10.20.193.45:0/3804750808 wait complete. 2026-02-24T19:24:10.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.426+0000 7fca0e108640 1 librados: shutdown 2026-02-24T19:24:10.437 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-24T19:24:10.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.502+0000 7f99451cf640 10 monclient: get_monmap_and_config 2026-02-24T19:24:10.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.502+0000 7f99451cf640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.502+0000 7f99451cf640 10 monclient: monmap: 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:10.503375+0000 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:10.503375+0000 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.506 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.507 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.502+0000 7f99451cf640 1 Processor -- start 2026-02-24T19:24:10.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.502+0000 7f99451cf640 1 -- start start 2026-02-24T19:24:10.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.502+0000 7f99451cf640 10 monclient: init 2026-02-24T19:24:10.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:10.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 10 monclient(hunting): picked mon.noname-a con 0x7f9940157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 10 monclient(hunting): picked mon.noname-b con 0x7f9940157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 10 monclient(hunting): picked mon.noname-c con 0x7f9940164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994005de70 con 0x7f9940157780 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9940055b20 con 0x7f9940157b50 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9940055e00 con 0x7f9940164d00 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f99451cf640 10 monclient(hunting): authenticate will time out at 4022.142257s 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f993ed76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9940157780 0x7f9940056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46060/0 (socket says 10.20.193.45:46060) 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.503+0000 7f993ed76640 1 -- 10.20.193.45:0/4171337152 learned_addr learned my addr 10.20.193.45:0/4171337152 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415542345 0 0) 0x7f994005de70 con 0x7f9940157780 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 10 monclient(hunting): my global_id is 30717 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f992c003610 con 0x7f9940157780 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544482828 0 0) 0x7f9940055e00 con 0x7f9940164d00 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 10 monclient(hunting): my global_id is 26657 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.504+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f994005de70 con 0x7f9940164d00 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.505+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544055742 0 0) 0x7f9940055b20 con 0x7f9940157b50 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.505+0000 7f993dd74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.505+0000 7f993dd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.505+0000 7f993dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.505+0000 7f993dd74640 10 monclient(hunting): my global_id is 28183 2026-02-24T19:24:10.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.505+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9940055e00 con 0x7f9940157b50 2026-02-24T19:24:10.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3489945267 0 0) 0x7f994005de70 con 0x7f9940164d00 2026-02-24T19:24:10.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 >> v1:10.20.193.114:6789/0 conn(0x7f9940157b50 legacy=0x7f99401645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 >> v1:10.20.193.45:6789/0 conn(0x7f9940157780 legacy=0x7f9940056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 1 monclient: found mon.noname-c 2026-02-24T19:24:10.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:10.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99400560e0 con 0x7f9940164d00 2026-02-24T19:24:10.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9930003170 con 0x7f9940164d00 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f99451cf640 5 monclient: authenticate success, global_id 26657 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f993dd74640 10 monclient: dump: 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.520 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.506+0000 7f99451cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9930003340 con 0x7f9940164d00 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f993dd74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f993dd74640 1 -- 10.20.193.45:0/4171337152 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9930003780 con 0x7f9940164d00 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f99451cf640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f99451cf640 4 set_mon_vals no callback set 2026-02-24T19:24:10.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f993dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f993dd74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f993dd74640 10 monclient: dump: 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f99451cf640 10 monclient: shutdown 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f99451cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f99451cf640 1 -- 10.20.193.45:0/4171337152 >> v1:10.20.193.179:6789/0 conn(0x7f9940164d00 legacy=0x7f99401c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f99451cf640 1 -- 10.20.193.45:0/4171337152 shutdown_connections 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f99451cf640 1 -- 10.20.193.45:0/4171337152 >> 10.20.193.45:0/4171337152 conn(0x7f99400b2ef0 msgr2=0x7f99400b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f99451cf640 1 -- 10.20.193.45:0/4171337152 shutdown_connections 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.507+0000 7f99451cf640 1 -- 10.20.193.45:0/4171337152 wait complete. 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient: monmap: 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:10.523 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 1 librados: starting msgr at 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 1 librados: starting objecter 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 1 Processor -- start 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 1 -- start start 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 1 librados: setting wanted keys 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 1 librados: calling monclient init 2026-02-24T19:24:10.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient: init 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient(hunting): picked mon.noname-c con 0x7f9940157780 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient(hunting): picked mon.noname-a con 0x7f9940157b50 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient(hunting): picked mon.noname-b con 0x7f9940164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9940146a70 con 0x7f9940157b50 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9940135980 con 0x7f9940164d00 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9940135c60 con 0x7f9940157780 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.508+0000 7f99451cf640 10 monclient(hunting): authenticate will time out at 4022.147947s 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.509+0000 7f993e575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9940157b50 0x7f994009ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46068/0 (socket says 10.20.193.45:46068) 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.509+0000 7f993e575640 1 -- 10.20.193.45:0/927358681 learned_addr learned my addr 10.20.193.45:0/927358681 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.509+0000 7f991f7fe640 10 client.?.objecter ms_handle_connect 0x7f9940157b50 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.509+0000 7f991f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.509+0000 7f991f7fe640 10 client.?.objecter ms_handle_connect 0x7f9940164d00 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.509+0000 7f991f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.509+0000 7f991f7fe640 10 client.?.objecter ms_handle_connect 0x7f9940157780 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.509+0000 7f991f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791105501 0 0) 0x7f9940146a70 con 0x7f9940157b50 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): my global_id is 30720 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f990c003610 con 0x7f9940157b50 2026-02-24T19:24:10.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3945070335 0 0) 0x7f9940135980 con 0x7f9940164d00 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): my global_id is 28186 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9940146a70 con 0x7f9940164d00 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575980445 0 0) 0x7f9940135c60 con 0x7f9940157780 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 10 monclient(hunting): my global_id is 26660 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.510+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9940135980 con 0x7f9940157780 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.512+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2633180626 0 0) 0x7f990c003610 con 0x7f9940157b50 2026-02-24T19:24:10.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.512+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9940135c60 con 0x7f9940157b50 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.512+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9928003170 con 0x7f9940157b50 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.512+0000 7f991f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.512+0000 7f991f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.512+0000 7f991f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.528 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.512+0000 7f991f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2033176741 0 0) 0x7f9940146a70 con 0x7f9940164d00 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f990c003610 con 0x7f9940164d00 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 797498081 0 0) 0x7f9940135980 con 0x7f9940157780 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9940146a70 con 0x7f9940157780 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f99340030b0 con 0x7f9940157780 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.529 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9930003690 con 0x7f9940164d00 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.513+0000 7f991f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:10.530 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1576860296 0 0) 0x7f9940135c60 con 0x7f9940157b50 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 >> v1:10.20.193.179:6789/0 conn(0x7f9940157780 legacy=0x7f9940058bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 >> v1:10.20.193.114:6789/0 conn(0x7f9940164d00 legacy=0x7f9940156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 1 monclient: found mon.a 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9940135f40 con 0x7f9940157b50 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f991f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f99451cf640 5 monclient: authenticate success, global_id 30720 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f99451cf640 10 monclient: _renew_subs 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f99451cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9940136220 con 0x7f9940157b50 2026-02-24T19:24:10.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f99451cf640 10 client.30720.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:10.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f99451cf640 10 monclient: _renew_subs 2026-02-24T19:24:10.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f99451cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f994009f730 con 0x7f9940157b50 2026-02-24T19:24:10.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.514+0000 7f99451cf640 1 librados: init done 2026-02-24T19:24:10.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.515+0000 7f99451cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.515+0000 7f99451cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.515+0000 7f99451cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.515+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9940161ea0 con 0x7f9940157b50 2026-02-24T19:24:10.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.525+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99280039b0 con 0x7f9940157b50 2026-02-24T19:24:10.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.525+0000 7f991f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:10.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.525+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9928003d40 con 0x7f9940157b50 2026-02-24T19:24:10.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.525+0000 7f991f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.525+0000 7f991f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.525+0000 7f993d573640 4 set_mon_vals no callback set 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.525+0000 7f991f7fe640 10 monclient: dump: 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.535 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.526+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f9928003f20 con 0x7f9940157b50 2026-02-24T19:24:10.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.526+0000 7f993ed76640 10 monclient: get_auth_request con 0x7f990c077e80 auth_method 0 2026-02-24T19:24:10.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.526+0000 7f991f7fe640 10 client.30720.objecter ms_handle_connect 0x7f990c077e80 2026-02-24T19:24:10.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.650+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f9928093250 con 0x7f9940157b50 2026-02-24T19:24:10.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.650+0000 7f991f7fe640 10 client.30720.objecter ms_dispatch2 0x7f9940000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:10.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.650+0000 7f991f7fe640 3 client.30720.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:10.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.650+0000 7f991f7fe640 3 client.30720.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:10.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.650+0000 7f991f7fe640 20 client.30720.objecter dump_active .. 0 homeless 2026-02-24T19:24:10.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.653+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f992805dc80 con 0x7f9940157b50 2026-02-24T19:24:10.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.653+0000 7f991f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.653+0000 7f991f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:10.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.760+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f99400b4d80 con 0x7f990c077e80 2026-02-24T19:24:10.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.760+0000 7f991f7fe640 1 -- 10.20.193.45:0/927358681 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f99400b4d80 con 0x7f990c077e80 2026-02-24T19:24:10.764 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 2 to deep-scrub 2026-02-24T19:24:10.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 10 librados: watch_flush enter 2026-02-24T19:24:10.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 10 librados: watch_flush exit 2026-02-24T19:24:10.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 20 client.30720.objecter shutdown clearing up homeless session... 2026-02-24T19:24:10.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 10 client.30720.objecter successfully canceled tick 2026-02-24T19:24:10.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 >> v1:10.20.193.45:6800/1599977652 conn(0x7f990c077e80 legacy=0x7f990c098330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 10 monclient: shutdown 2026-02-24T19:24:10.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:10.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 >> v1:10.20.193.45:6789/0 conn(0x7f9940157b50 legacy=0x7f994009ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 shutdown_connections 2026-02-24T19:24:10.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 >> 10.20.193.45:0/927358681 conn(0x7f99400b2ef0 msgr2=0x7f99400b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:10.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 shutdown_connections 2026-02-24T19:24:10.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 1 -- 10.20.193.45:0/927358681 wait complete. 2026-02-24T19:24:10.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.761+0000 7f99451cf640 1 librados: shutdown 2026-02-24T19:24:10.774 INFO:tasks.ceph:Scrubbing osd.6 2026-02-24T19:24:10.774 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:10.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.840+0000 7fe203f0a640 10 monclient: get_monmap_and_config 2026-02-24T19:24:10.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.840+0000 7fe203f0a640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.840+0000 7fe203f0a640 10 monclient: monmap: 2026-02-24T19:24:10.844 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.844 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.844 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:10.841661+0000 2026-02-24T19:24:10.844 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:10.841661+0000 2026-02-24T19:24:10.844 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.844 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.845 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.845 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.845 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.845 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 1 Processor -- start 2026-02-24T19:24:10.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 1 -- start start 2026-02-24T19:24:10.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 10 monclient: init 2026-02-24T19:24:10.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 10 monclient(hunting): picked mon.noname-b con 0x7fe1fc15e2a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 10 monclient(hunting): picked mon.noname-c con 0x7fe1fc059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 10 monclient(hunting): picked mon.noname-a con 0x7fe1fc1a5660 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc162df0 con 0x7fe1fc1a5660 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc1630d0 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc1633b0 con 0x7fe1fc059e10 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.841+0000 7fe203f0a640 10 monclient(hunting): authenticate will time out at 4022.480687s 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.842+0000 7fe201c7f640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7fe1fc15e2a0 0x7fe1fc05da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:35198/0 (socket says 10.20.193.45:35198) 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.842+0000 7fe201c7f640 1 -- 10.20.193.45:0/4020794746 learned_addr learned my addr 10.20.193.45:0/4020794746 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602073326 0 0) 0x7fe1fc1633b0 con 0x7fe1fc059e10 2026-02-24T19:24:10.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): my global_id is 26663 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1e4003610 con 0x7fe1fc059e10 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432050990 0 0) 0x7fe1fc1630d0 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): my global_id is 28189 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1fc1633b0 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031676500 0 0) 0x7fe1fc162df0 con 0x7fe1fc1a5660 2026-02-24T19:24:10.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 10 monclient(hunting): my global_id is 30723 2026-02-24T19:24:10.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.843+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1fc1630d0 con 0x7fe1fc1a5660 2026-02-24T19:24:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3925924245 0 0) 0x7fe1e4003610 con 0x7fe1fc059e10 2026-02-24T19:24:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 >> v1:10.20.193.114:6789/0 conn(0x7fe1fc15e2a0 legacy=0x7fe1fc05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 >> v1:10.20.193.45:6789/0 conn(0x7fe1fc1a5660 legacy=0x7fe1fc1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 1 monclient: found mon.noname-c 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc163690 con 0x7fe1fc059e10 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe1f0002df0 con 0x7fe1fc059e10 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe200c7d640 10 monclient: dump: 2026-02-24T19:24:10.856 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe203f0a640 5 monclient: authenticate success, global_id 26663 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.845+0000 7fe203f0a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:10.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1f0002fc0 con 0x7fe1fc059e10 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe200c7d640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe200c7d640 1 -- 10.20.193.45:0/4020794746 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe1f0003400 con 0x7fe1fc059e10 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe200c7d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe200c7d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe200c7d640 10 monclient: dump: 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.858 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 4 set_mon_vals no callback set 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 10 monclient: shutdown 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 1 -- 10.20.193.45:0/4020794746 >> v1:10.20.193.179:6789/0 conn(0x7fe1fc059e10 legacy=0x7fe1fc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 1 -- 10.20.193.45:0/4020794746 shutdown_connections 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 1 -- 10.20.193.45:0/4020794746 >> 10.20.193.45:0/4020794746 conn(0x7fe1fc0b2f60 msgr2=0x7fe1fc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 1 -- 10.20.193.45:0/4020794746 shutdown_connections 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 1 -- 10.20.193.45:0/4020794746 wait complete. 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.846+0000 7fe203f0a640 10 monclient: monmap: 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 1 librados: starting msgr at 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 1 librados: starting objecter 2026-02-24T19:24:10.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 1 Processor -- start 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 1 -- start start 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 1 librados: setting wanted keys 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 1 librados: calling monclient init 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 10 monclient: init 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 10 monclient(hunting): picked mon.noname-b con 0x7fe1fc059e10 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 10 monclient(hunting): picked mon.noname-a con 0x7fe1fc15e2a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 10 monclient(hunting): picked mon.noname-c con 0x7fe1fc1a5660 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc0aff00 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc12e430 con 0x7fe1fc059e10 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1fc0a8d40 con 0x7fe1fc1a5660 2026-02-24T19:24:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe203f0a640 10 monclient(hunting): authenticate will time out at 4022.486559s 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe20147e640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe1fc15e2a0 0x7fe1fc12dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46084/0 (socket says 10.20.193.45:46084) 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe20147e640 1 -- 10.20.193.45:0/2667581722 learned_addr learned my addr 10.20.193.45:0/2667581722 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe1ea7fc640 10 client.?.objecter ms_handle_connect 0x7fe1fc15e2a0 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.847+0000 7fe1ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 10 client.?.objecter ms_handle_connect 0x7fe1fc059e10 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 10 client.?.objecter ms_handle_connect 0x7fe1fc1a5660 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574509681 0 0) 0x7fe1fc0aff00 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 10 monclient(hunting): my global_id is 30726 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.848+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1cc003610 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3691267002 0 0) 0x7fe1fc12e430 con 0x7fe1fc059e10 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 10 monclient(hunting): my global_id is 28192 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1fc0aff00 con 0x7fe1fc059e10 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424180361 0 0) 0x7fe1fc0a8d40 con 0x7fe1fc1a5660 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 10 monclient(hunting): my global_id is 26666 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.849+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1fc12e430 con 0x7fe1fc1a5660 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 373481566 0 0) 0x7fe1cc003610 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1fc0a8d40 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe1f0003310 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.864 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1699815964 0 0) 0x7fe1fc0aff00 con 0x7fe1fc059e10 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1cc003610 con 0x7fe1fc059e10 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe1ec0030b0 con 0x7fe1fc059e10 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:10.865 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1577322348 0 0) 0x7fe1fc12e430 con 0x7fe1fc1a5660 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1fc0aff00 con 0x7fe1fc1a5660 2026-02-24T19:24:10.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe1f8003390 con 0x7fe1fc1a5660 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.851+0000 7fe1ea7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.867 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3304672493 0 0) 0x7fe1fc0a8d40 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 >> v1:10.20.193.179:6789/0 conn(0x7fe1fc1a5660 legacy=0x7fe1fc0a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 >> v1:10.20.193.114:6789/0 conn(0x7fe1fc059e10 legacy=0x7fe1fc0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 1 monclient: found mon.a 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc0a9020 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe1ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 5 monclient: authenticate success, global_id 30726 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 10 monclient: _renew_subs 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1fc190430 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 10 client.30726.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 10 monclient: _renew_subs 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe1fc0ae250 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 1 librados: init done 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 10 client.30726.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 15 client.30726.objecter _session_command_op_assign -1 1 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 20 client.30726.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:10.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 10 client.30726.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.853+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe1fc1929b0 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.862+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1fc1929b0 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.862+0000 7fe1ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.862+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fe1f0003910 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.862+0000 7fe1ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.862+0000 7fe1ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.862+0000 7fe1ea7fc640 10 monclient: dump: 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.873 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.862+0000 7fe1ebfff640 4 set_mon_vals no callback set 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.863+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fe1f0003b20 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.863+0000 7fe201c7f640 10 monclient: get_auth_request con 0x7fe1cc077e20 auth_method 0 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.863+0000 7fe1ea7fc640 10 client.30726.objecter ms_handle_connect 0x7fe1cc077e20 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.864+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fe1f0092ef0 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.864+0000 7fe1ea7fc640 10 client.30726.objecter ms_dispatch2 0x7fe1fc000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:10.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.864+0000 7fe1ea7fc640 3 client.30726.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.864+0000 7fe1ea7fc640 3 client.30726.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 10 client.30726.objecter checking command 1 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 20 client.30726.objecter _get_session s=0x7fe1cc0a2150 osd=6 3 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 20 client.30726.objecter put_session s=0x7fe1cc0a2150 osd=6 3 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 15 client.30726.objecter _session_command_op_remove -1 1 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 20 client.30726.objecter _get_session s=0x7fe1cc0a2150 osd=6 3 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 20 client.30726.objecter get_session s=0x7fe1cc0a2150 osd=6 3 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 15 client.30726.objecter _session_command_op_assign 6 1 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 20 client.30726.objecter put_session s=0x7fe1cc0a2150 osd=6 4 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 10 client.30726.objecter _send_command 1 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.179:6804/1928709825 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1f00034b0 con 0x7fe1cc0a2800 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 20 client.30726.objecter dump_active .. 0 homeless 2026-02-24T19:24:10.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fe1f005cff0 con 0x7fe1fc15e2a0 2026-02-24T19:24:10.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe1ea7fc640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:10.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.865+0000 7fe202480640 10 monclient: get_auth_request con 0x7fe1cc0a2800 auth_method 0 2026-02-24T19:24:10.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.866+0000 7fe1ea7fc640 10 client.30726.objecter ms_handle_connect 0x7fe1cc0a2800 2026-02-24T19:24:10.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.875+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== osd.6 v1:10.20.193.179:6804/1928709825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe1f00034b0 con 0x7fe1cc0a2800 2026-02-24T19:24:10.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.875+0000 7fe1ea7fc640 10 client.30726.objecter ms_dispatch2 0x7fe1fc000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:10.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.875+0000 7fe1ea7fc640 10 client.30726.objecter _finish_command 1 = system:0 2026-02-24T19:24:10.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.875+0000 7fe1ea7fc640 20 client.30726.objecter put_session s=0x7fe1cc0a2150 osd=6 4 2026-02-24T19:24:10.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.875+0000 7fe1ea7fc640 15 client.30726.objecter _session_command_op_remove 6 1 2026-02-24T19:24:10.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 10 client.30726.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:10.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 15 client.30726.objecter _session_command_op_assign -1 2 2026-02-24T19:24:10.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 20 client.30726.objecter _get_session s=0x7fe1cc0a2150 osd=6 3 2026-02-24T19:24:10.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 20 client.30726.objecter put_session s=0x7fe1cc0a2150 osd=6 3 2026-02-24T19:24:10.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 20 client.30726.objecter _get_session s=0x7fe1cc0a2150 osd=6 3 2026-02-24T19:24:10.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 15 client.30726.objecter _session_command_op_remove -1 2 2026-02-24T19:24:10.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 20 client.30726.objecter get_session s=0x7fe1cc0a2150 osd=6 3 2026-02-24T19:24:10.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 15 client.30726.objecter _session_command_op_assign 6 2 2026-02-24T19:24:10.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 20 client.30726.objecter put_session s=0x7fe1cc0a2150 osd=6 4 2026-02-24T19:24:10.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 10 client.30726.objecter _send_command 2 2026-02-24T19:24:10.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.882+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 --> v1:10.20.193.179:6804/1928709825 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe1fc1926d0 con 0x7fe1cc0a2800 2026-02-24T19:24:10.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe1ea7fc640 1 -- 10.20.193.45:0/2667581722 <== osd.6 v1:10.20.193.179:6804/1928709825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe1fc1926d0 con 0x7fe1cc0a2800 2026-02-24T19:24:10.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe1ea7fc640 10 client.30726.objecter ms_dispatch2 0x7fe1fc000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:10.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe1ea7fc640 10 client.30726.objecter _finish_command 2 = system:0 2026-02-24T19:24:10.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe1ea7fc640 20 client.30726.objecter put_session s=0x7fe1cc0a2150 osd=6 4 2026-02-24T19:24:10.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe1ea7fc640 15 client.30726.objecter _session_command_op_remove 6 2 2026-02-24T19:24:10.894 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:10.894 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:10.895 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:10.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 10 librados: watch_flush enter 2026-02-24T19:24:10.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 10 librados: watch_flush exit 2026-02-24T19:24:10.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 10 client.30726.objecter close_session for osd.6 2026-02-24T19:24:10.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 >> v1:10.20.193.179:6804/1928709825 conn(0x7fe1cc0a2800 legacy=0x7fe1cc0c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 20 client.30726.objecter put_session s=0x7fe1cc0a2150 osd=6 1 2026-02-24T19:24:10.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 20 client.30726.objecter shutdown clearing up homeless session... 2026-02-24T19:24:10.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 10 client.30726.objecter successfully canceled tick 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 >> v1:10.20.193.45:6800/1599977652 conn(0x7fe1cc077e20 legacy=0x7fe1cc0982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 10 monclient: shutdown 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 >> v1:10.20.193.45:6789/0 conn(0x7fe1fc15e2a0 legacy=0x7fe1fc12dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe202480640 1 -- 10.20.193.45:0/2667581722 reap_dead start 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 shutdown_connections 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 >> 10.20.193.45:0/2667581722 conn(0x7fe1fc0b2f60 msgr2=0x7fe1fc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 shutdown_connections 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 1 -- 10.20.193.45:0/2667581722 wait complete. 2026-02-24T19:24:10.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.890+0000 7fe203f0a640 1 librados: shutdown 2026-02-24T19:24:10.902 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-24T19:24:10.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.966+0000 7f6489dc8640 10 monclient: get_monmap_and_config 2026-02-24T19:24:10.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.966+0000 7f6489dc8640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.966+0000 7f6489dc8640 10 monclient: monmap: 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:10.967192+0000 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:10.967192+0000 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.970 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.966+0000 7f6489dc8640 1 Processor -- start 2026-02-24T19:24:10.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.966+0000 7f6489dc8640 1 -- start start 2026-02-24T19:24:10.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.966+0000 7f6489dc8640 10 monclient: init 2026-02-24T19:24:10.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:10.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 10 monclient(hunting): picked mon.noname-c con 0x7f648415d210 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 10 monclient(hunting): picked mon.noname-b con 0x7f6484058880 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 10 monclient(hunting): picked mon.noname-a con 0x7f64840b5e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648415d5e0 con 0x7f64840b5e10 2026-02-24T19:24:10.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64840b8000 con 0x7f6484058880 2026-02-24T19:24:10.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64840b82e0 con 0x7f648415d210 2026-02-24T19:24:10.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6489dc8640 10 monclient(hunting): authenticate will time out at 4022.606490s 2026-02-24T19:24:10.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6483fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f64840b5e10 0x7f648405a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46096/0 (socket says 10.20.193.45:46096) 2026-02-24T19:24:10.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.967+0000 7f6483fff640 1 -- 10.20.193.45:0/800596082 learned_addr learned my addr 10.20.193.45:0/800596082 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129459868 0 0) 0x7f64840b82e0 con 0x7f648415d210 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): my global_id is 26669 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6468003610 con 0x7f648415d210 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779667630 0 0) 0x7f648415d5e0 con 0x7f64840b5e10 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): my global_id is 30729 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64840b82e0 con 0x7f64840b5e10 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444887538 0 0) 0x7f64840b8000 con 0x7f6484058880 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 10 monclient(hunting): my global_id is 28195 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.969+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f648415d5e0 con 0x7f6484058880 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3566173347 0 0) 0x7f6468003610 con 0x7f648415d210 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 >> v1:10.20.193.114:6789/0 conn(0x7f6484058880 legacy=0x7f6484059d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 >> v1:10.20.193.45:6789/0 conn(0x7f64840b5e10 legacy=0x7f648405a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 1 monclient: found mon.noname-c 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64840b85c0 con 0x7f648415d210 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6470002df0 con 0x7f648415d210 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: dump: 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.980 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f6489dc8640 5 monclient: authenticate success, global_id 26669 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f6489dc8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6470002fc0 con 0x7f648415d210 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:10.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 1 -- 10.20.193.45:0/800596082 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6470003400 con 0x7f648415d210 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f64827fc640 10 monclient: dump: 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.982 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f6489dc8640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.971+0000 7f6489dc8640 4 set_mon_vals no callback set 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.972+0000 7f6489dc8640 10 monclient: shutdown 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.972+0000 7f6489dc8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.972+0000 7f6489dc8640 1 -- 10.20.193.45:0/800596082 >> v1:10.20.193.179:6789/0 conn(0x7f648415d210 legacy=0x7f6484058170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.972+0000 7f6489dc8640 1 -- 10.20.193.45:0/800596082 shutdown_connections 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.972+0000 7f6489dc8640 1 -- 10.20.193.45:0/800596082 >> 10.20.193.45:0/800596082 conn(0x7f64840b5300 msgr2=0x7f64840b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.972+0000 7f6489dc8640 1 -- 10.20.193.45:0/800596082 shutdown_connections 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.972+0000 7f6489dc8640 1 -- 10.20.193.45:0/800596082 wait complete. 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.972+0000 7f6489dc8640 10 monclient: build_initial_monmap 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.972+0000 7f6489dc8640 10 monclient: monmap: 2026-02-24T19:24:10.983 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 1 librados: starting msgr at 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 1 librados: starting objecter 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:10.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 1 Processor -- start 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 1 -- start start 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 1 librados: setting wanted keys 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 1 librados: calling monclient init 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 10 monclient: init 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 10 monclient(hunting): picked mon.noname-b con 0x7f6484058880 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 10 monclient(hunting): picked mon.noname-a con 0x7f64840b5e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 10 monclient(hunting): picked mon.noname-c con 0x7f648415d210 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6484161540 con 0x7f64840b5e10 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6484161820 con 0x7f6484058880 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6484161b00 con 0x7f648415d210 2026-02-24T19:24:10.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:10.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6489dc8640 10 monclient(hunting): authenticate will time out at 4022.612644s 2026-02-24T19:24:10.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6482ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f64840b5e10 0x7f6484134090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46108/0 (socket says 10.20.193.45:46108) 2026-02-24T19:24:10.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f6482ffd640 1 -- 10.20.193.45:0/2096976120 learned_addr learned my addr 10.20.193.45:0/2096976120 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:10.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.973+0000 7f645ffff640 10 client.?.objecter ms_handle_connect 0x7f64840b5e10 2026-02-24T19:24:10.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.974+0000 7f645ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.974+0000 7f645ffff640 10 client.?.objecter ms_handle_connect 0x7f648415d210 2026-02-24T19:24:10.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.974+0000 7f645ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.974+0000 7f645ffff640 10 client.?.objecter ms_handle_connect 0x7f6484058880 2026-02-24T19:24:10.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.974+0000 7f645ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:10.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4139172268 0 0) 0x7f6484161540 con 0x7f64840b5e10 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): my global_id is 30732 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6454003610 con 0x7f64840b5e10 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373476956 0 0) 0x7f6484161b00 con 0x7f648415d210 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): my global_id is 26672 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6484161540 con 0x7f648415d210 2026-02-24T19:24:10.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564952320 0 0) 0x7f6484161820 con 0x7f6484058880 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 10 monclient(hunting): my global_id is 28198 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.975+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6484161b00 con 0x7f6484058880 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1625429920 0 0) 0x7f6454003610 con 0x7f64840b5e10 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6484161820 con 0x7f64840b5e10 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f64740030c0 con 0x7f64840b5e10 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 10 monclient(hunting): dump: 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.991 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2485496432 0 0) 0x7f6484161540 con 0x7f648415d210 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6454003610 con 0x7f648415d210 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f64780033b0 con 0x7f648415d210 2026-02-24T19:24:10.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.977+0000 7f645ffff640 10 monclient(hunting): dump: 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.978+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2369009565 0 0) 0x7f6484161b00 con 0x7f6484058880 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.978+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6484161540 con 0x7f6484058880 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.978+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6470003310 con 0x7f6484058880 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.978+0000 7f645ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.978+0000 7f645ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.978+0000 7f645ffff640 10 monclient(hunting): dump: 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:10.994 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1675287270 0 0) 0x7f6484161820 con 0x7f64840b5e10 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 >> v1:10.20.193.179:6789/0 conn(0x7f648415d210 legacy=0x7f64841440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 >> v1:10.20.193.114:6789/0 conn(0x7f6484058880 legacy=0x7f6484160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 1 monclient: found mon.a 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6484161de0 con 0x7f64840b5e10 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 10 monclient: _finish_auth 0 2026-02-24T19:24:10.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f645ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 5 monclient: authenticate success, global_id 30732 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 10 monclient: _renew_subs 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f64841620c0 con 0x7f64840b5e10 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 10 client.30732.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 10 monclient: _renew_subs 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f64841449e0 con 0x7f64840b5e10 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 1 librados: init done 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:10.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:10.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:10.979+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6484163240 con 0x7f64840b5e10 2026-02-24T19:24:11.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.107+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6474003260 con 0x7f64840b5e10 2026-02-24T19:24:11.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.107+0000 7f645ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:11.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.107+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6474003960 con 0x7f64840b5e10 2026-02-24T19:24:11.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.107+0000 7f645ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.107+0000 7f645ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:11.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.107+0000 7f6481ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:11.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.107+0000 7f645ffff640 10 monclient: dump: 2026-02-24T19:24:11.111 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.112 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.112 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.112 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.112 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.112 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.112 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.112 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.112 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.112 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.108+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f6474003b40 con 0x7f64840b5e10 2026-02-24T19:24:11.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.108+0000 7f64837fe640 10 monclient: get_auth_request con 0x7f6454077e70 auth_method 0 2026-02-24T19:24:11.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.108+0000 7f645ffff640 10 client.30732.objecter ms_handle_connect 0x7f6454077e70 2026-02-24T19:24:11.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.111+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f64740931a0 con 0x7f64840b5e10 2026-02-24T19:24:11.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.111+0000 7f645ffff640 10 client.30732.objecter ms_dispatch2 0x7f6484000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:11.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.111+0000 7f645ffff640 3 client.30732.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:11.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.111+0000 7f645ffff640 3 client.30732.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:11.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.111+0000 7f645ffff640 20 client.30732.objecter dump_active .. 0 homeless 2026-02-24T19:24:11.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.111+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f647405dbd0 con 0x7f64840b5e10 2026-02-24T19:24:11.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.111+0000 7f645ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:11.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.111+0000 7f645ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:11.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.215+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f64840b2cb0 con 0x7f6454077e70 2026-02-24T19:24:11.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.215+0000 7f645ffff640 1 -- 10.20.193.45:0/2096976120 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (unknown 778718403 0 0) 0x7f64840b2cb0 con 0x7f6454077e70 2026-02-24T19:24:11.219 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 6 to deep-scrub 2026-02-24T19:24:11.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 10 librados: watch_flush enter 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 10 librados: watch_flush exit 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 20 client.30732.objecter shutdown clearing up homeless session... 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 10 client.30732.objecter successfully canceled tick 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6454077e70 legacy=0x7f6454098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 10 monclient: shutdown 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 >> v1:10.20.193.45:6789/0 conn(0x7f64840b5e10 legacy=0x7f6484134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 shutdown_connections 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 >> 10.20.193.45:0/2096976120 conn(0x7f64840b5300 msgr2=0x7f64840594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 shutdown_connections 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 1 -- 10.20.193.45:0/2096976120 wait complete. 2026-02-24T19:24:11.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.216+0000 7f6489dc8640 1 librados: shutdown 2026-02-24T19:24:11.228 INFO:tasks.ceph:Scrubbing osd.10 2026-02-24T19:24:11.228 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:11.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.295+0000 7fb0d4f33640 10 monclient: get_monmap_and_config 2026-02-24T19:24:11.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.295+0000 7fb0d4f33640 10 monclient: build_initial_monmap 2026-02-24T19:24:11.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.295+0000 7fb0d4f33640 10 monclient: monmap: 2026-02-24T19:24:11.298 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:11.299 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.299 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:11.296176+0000 2026-02-24T19:24:11.299 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:11.296176+0000 2026-02-24T19:24:11.299 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:11.299 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.299 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:11.299 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:11.299 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:11.299 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.295+0000 7fb0d4f33640 1 Processor -- start 2026-02-24T19:24:11.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.295+0000 7fb0d4f33640 1 -- start start 2026-02-24T19:24:11.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.295+0000 7fb0d4f33640 10 monclient: init 2026-02-24T19:24:11.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 10 monclient(hunting): picked mon.noname-a con 0x7fb0d00b9f80 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 10 monclient(hunting): picked mon.noname-c con 0x7fb0d00ba350 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 10 monclient(hunting): picked mon.noname-b con 0x7fb0d00585e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d0163930 con 0x7fb0d00b9f80 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d0163bb0 con 0x7fb0d00585e0 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d0163e90 con 0x7fb0d00ba350 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0d4f33640 10 monclient(hunting): authenticate will time out at 4022.935424s 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0ce575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fb0d00b9f80 0x7fb0d0163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41282/0 (socket says 10.20.193.45:41282) 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.296+0000 7fb0ce575640 1 -- 10.20.193.45:0/461477764 learned_addr learned my addr 10.20.193.45:0/461477764 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:11.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2483314934 0 0) 0x7fb0c4002910 con 0x7fb0d00b9f80 2026-02-24T19:24:11.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): my global_id is 30735 2026-02-24T19:24:11.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0bc003610 con 0x7fb0d00b9f80 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1030284836 0 0) 0x7fb0d0163bb0 con 0x7fb0d00585e0 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): my global_id is 28201 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c4002910 con 0x7fb0d00585e0 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1454468378 0 0) 0x7fb0d0163e90 con 0x7fb0d00ba350 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 10 monclient(hunting): my global_id is 26675 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.298+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d0163bb0 con 0x7fb0d00ba350 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 625450418 0 0) 0x7fb0bc003610 con 0x7fb0d00b9f80 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 >> v1:10.20.193.179:6789/0 conn(0x7fb0d00ba350 legacy=0x7fb0d0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 >> v1:10.20.193.114:6789/0 conn(0x7fb0d00585e0 legacy=0x7fb0d0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 1 monclient: found mon.noname-a 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d00573f0 con 0x7fb0d00b9f80 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 10 monclient: _finish_auth 0 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:11.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb0c4002fc0 con 0x7fb0d00b9f80 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0cd573640 10 monclient: dump: 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.310 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0d4f33640 5 monclient: authenticate success, global_id 30735 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.299+0000 7fb0d4f33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.300+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0c4003190 con 0x7fb0d00b9f80 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.300+0000 7fb0cd573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.300+0000 7fb0cd573640 1 -- 10.20.193.45:0/461477764 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb0c4004990 con 0x7fb0d00b9f80 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.300+0000 7fb0cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.300+0000 7fb0cd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.300+0000 7fb0cd573640 10 monclient: dump: 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.311 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.300+0000 7fb0d4f33640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.300+0000 7fb0d4f33640 4 set_mon_vals no callback set 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 10 monclient: shutdown 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 1 -- 10.20.193.45:0/461477764 >> v1:10.20.193.45:6789/0 conn(0x7fb0d00b9f80 legacy=0x7fb0d0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 1 -- 10.20.193.45:0/461477764 shutdown_connections 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 1 -- 10.20.193.45:0/461477764 >> 10.20.193.45:0/461477764 conn(0x7fb0d00b7990 msgr2=0x7fb0d00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 1 -- 10.20.193.45:0/461477764 shutdown_connections 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 1 -- 10.20.193.45:0/461477764 wait complete. 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 10 monclient: build_initial_monmap 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 10 monclient: monmap: 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:11.313 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 1 librados: starting msgr at 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.301+0000 7fb0d4f33640 1 librados: starting objecter 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 1 Processor -- start 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 1 -- start start 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 1 librados: setting wanted keys 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 1 librados: calling monclient init 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 10 monclient: init 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:11.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 10 monclient(hunting): picked mon.noname-c con 0x7fb0d00585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 10 monclient(hunting): picked mon.noname-b con 0x7fb0d00b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 10 monclient(hunting): picked mon.noname-a con 0x7fb0d00ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d0156c80 con 0x7fb0d00ba350 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d01fb4b0 con 0x7fb0d00b9f80 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d01fb790 con 0x7fb0d00585e0 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0d4f33640 10 monclient(hunting): authenticate will time out at 4022.941539s 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0ce575640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fb0d00585e0 0x7fb0d0156570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:53124/0 (socket says 10.20.193.45:53124) 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.302+0000 7fb0ce575640 1 -- 10.20.193.45:0/1554894856 learned_addr learned my addr 10.20.193.45:0/1554894856 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.303+0000 7fb0b6ffd640 10 client.?.objecter ms_handle_connect 0x7fb0d00b9f80 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.303+0000 7fb0b6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.303+0000 7fb0b6ffd640 10 client.?.objecter ms_handle_connect 0x7fb0d00585e0 2026-02-24T19:24:11.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.303+0000 7fb0b6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 client.?.objecter ms_handle_connect 0x7fb0d00ba350 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3068052852 0 0) 0x7fb0d01fb4b0 con 0x7fb0d00b9f80 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): my global_id is 28204 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb09c003610 con 0x7fb0d00b9f80 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286452697 0 0) 0x7fb0d01fb790 con 0x7fb0d00585e0 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): my global_id is 26678 2026-02-24T19:24:11.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d01fb4b0 con 0x7fb0d00585e0 2026-02-24T19:24:11.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909189757 0 0) 0x7fb0d0156c80 con 0x7fb0d00ba350 2026-02-24T19:24:11.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.304+0000 7fb0b6ffd640 10 monclient(hunting): my global_id is 30738 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.305+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d01fb790 con 0x7fb0d00ba350 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1441649523 0 0) 0x7fb09c003610 con 0x7fb0d00b9f80 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0d0156c80 con 0x7fb0d00b9f80 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb0b8002fb0 con 0x7fb0d00b9f80 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.320 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1391658367 0 0) 0x7fb0d01fb4b0 con 0x7fb0d00585e0 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb09c003610 con 0x7fb0d00585e0 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb0c4002d30 con 0x7fb0d00585e0 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.306+0000 7fb0b6ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.307+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2334751718 0 0) 0x7fb0d01fb790 con 0x7fb0d00ba350 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.307+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0d01fb4b0 con 0x7fb0d00ba350 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.307+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb0c00033c0 con 0x7fb0d00ba350 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.307+0000 7fb0b6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.307+0000 7fb0b6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.307+0000 7fb0b6ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.323 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 840248580 0 0) 0x7fb0d0156c80 con 0x7fb0d00b9f80 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 >> v1:10.20.193.179:6789/0 conn(0x7fb0d00585e0 legacy=0x7fb0d0156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 >> v1:10.20.193.45:6789/0 conn(0x7fb0d00ba350 legacy=0x7fb0d0158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 1 monclient: found mon.b 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d01fba70 con 0x7fb0d00b9f80 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:11.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0d4f33640 5 monclient: authenticate success, global_id 28204 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0d4f33640 10 monclient: _renew_subs 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0d4f33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d01fbd50 con 0x7fb0d00b9f80 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0d4f33640 10 client.28204.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0d4f33640 10 monclient: _renew_subs 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0d4f33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb0d01fb130 con 0x7fb0d00b9f80 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.308+0000 7fb0d4f33640 1 librados: init done 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.309+0000 7fb0d4f33640 10 client.28204.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.309+0000 7fb0d4f33640 15 client.28204.objecter _session_command_op_assign -1 1 2026-02-24T19:24:11.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.309+0000 7fb0d4f33640 20 client.28204.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:11.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.309+0000 7fb0d4f33640 10 client.28204.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:11.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.309+0000 7fb0d4f33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:11.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.309+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb0d01fbf90 con 0x7fb0d00b9f80 2026-02-24T19:24:11.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.317+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0d01fbf90 con 0x7fb0d00b9f80 2026-02-24T19:24:11.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.317+0000 7fb0b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:11.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.317+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fb0b8003700 con 0x7fb0d00b9f80 2026-02-24T19:24:11.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.317+0000 7fb0b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.317+0000 7fb0b6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:11.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.317+0000 7fb0b6ffd640 10 monclient: dump: 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.317+0000 7fb0ccd72640 4 set_mon_vals no callback set 2026-02-24T19:24:11.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.317+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fb0b801c570 con 0x7fb0d00b9f80 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.318+0000 7fb0ce575640 10 monclient: get_auth_request con 0x7fb09c077ee0 auth_method 0 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.318+0000 7fb0b6ffd640 10 client.28204.objecter ms_handle_connect 0x7fb09c077ee0 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fb0b8091d50 con 0x7fb0d00b9f80 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 10 client.28204.objecter ms_dispatch2 0x7fb0d0000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 3 client.28204.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 3 client.28204.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 10 client.28204.objecter checking command 1 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 20 client.28204.objecter _get_session s=0x7fb09c0a21b0 osd=10 3 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 20 client.28204.objecter put_session s=0x7fb09c0a21b0 osd=10 3 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 15 client.28204.objecter _session_command_op_remove -1 1 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 20 client.28204.objecter _get_session s=0x7fb09c0a21b0 osd=10 3 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 20 client.28204.objecter get_session s=0x7fb09c0a21b0 osd=10 3 2026-02-24T19:24:11.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 15 client.28204.objecter _session_command_op_assign 10 1 2026-02-24T19:24:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 20 client.28204.objecter put_session s=0x7fb09c0a21b0 osd=10 4 2026-02-24T19:24:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 10 client.28204.objecter _send_command 1 2026-02-24T19:24:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.179:6808/2982984950 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb09c0c44c0 con 0x7fb09c0a2860 2026-02-24T19:24:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 20 client.28204.objecter dump_active .. 0 homeless 2026-02-24T19:24:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fb0b80583f0 con 0x7fb0d00b9f80 2026-02-24T19:24:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.319+0000 7fb0b6ffd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.320+0000 7fb0ced76640 10 monclient: get_auth_request con 0x7fb09c0a2860 auth_method 0 2026-02-24T19:24:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.321+0000 7fb0b6ffd640 10 client.28204.objecter ms_handle_connect 0x7fb09c0a2860 2026-02-24T19:24:11.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.330+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== osd.10 v1:10.20.193.179:6808/2982984950 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fb09c0c44c0 con 0x7fb09c0a2860 2026-02-24T19:24:11.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.330+0000 7fb0b6ffd640 10 client.28204.objecter ms_dispatch2 0x7fb0d0000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:11.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.330+0000 7fb0b6ffd640 10 client.28204.objecter _finish_command 1 = system:0 2026-02-24T19:24:11.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.330+0000 7fb0b6ffd640 20 client.28204.objecter put_session s=0x7fb09c0a21b0 osd=10 4 2026-02-24T19:24:11.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.330+0000 7fb0b6ffd640 15 client.28204.objecter _session_command_op_remove 10 1 2026-02-24T19:24:11.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 10 client.28204.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:11.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 15 client.28204.objecter _session_command_op_assign -1 2 2026-02-24T19:24:11.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 20 client.28204.objecter _get_session s=0x7fb09c0a21b0 osd=10 3 2026-02-24T19:24:11.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 20 client.28204.objecter put_session s=0x7fb09c0a21b0 osd=10 3 2026-02-24T19:24:11.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 20 client.28204.objecter _get_session s=0x7fb09c0a21b0 osd=10 3 2026-02-24T19:24:11.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 15 client.28204.objecter _session_command_op_remove -1 2 2026-02-24T19:24:11.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 20 client.28204.objecter get_session s=0x7fb09c0a21b0 osd=10 3 2026-02-24T19:24:11.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 15 client.28204.objecter _session_command_op_assign 10 2 2026-02-24T19:24:11.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 20 client.28204.objecter put_session s=0x7fb09c0a21b0 osd=10 4 2026-02-24T19:24:11.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 10 client.28204.objecter _send_command 2 2026-02-24T19:24:11.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.337+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 --> v1:10.20.193.179:6808/2982984950 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb0d0159260 con 0x7fb09c0a2860 2026-02-24T19:24:11.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0b6ffd640 1 -- 10.20.193.45:0/1554894856 <== osd.10 v1:10.20.193.179:6808/2982984950 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fb0d0159260 con 0x7fb09c0a2860 2026-02-24T19:24:11.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0b6ffd640 10 client.28204.objecter ms_dispatch2 0x7fb0d0000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:11.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0b6ffd640 10 client.28204.objecter _finish_command 2 = system:0 2026-02-24T19:24:11.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0b6ffd640 20 client.28204.objecter put_session s=0x7fb09c0a21b0 osd=10 4 2026-02-24T19:24:11.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0b6ffd640 15 client.28204.objecter _session_command_op_remove 10 2 2026-02-24T19:24:11.349 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:11.349 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:11.349 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:11.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 10 librados: watch_flush enter 2026-02-24T19:24:11.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 10 librados: watch_flush exit 2026-02-24T19:24:11.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 10 client.28204.objecter close_session for osd.10 2026-02-24T19:24:11.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 >> v1:10.20.193.179:6808/2982984950 conn(0x7fb09c0a2860 legacy=0x7fb09c0c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 20 client.28204.objecter put_session s=0x7fb09c0a21b0 osd=10 1 2026-02-24T19:24:11.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 20 client.28204.objecter shutdown clearing up homeless session... 2026-02-24T19:24:11.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 10 client.28204.objecter successfully canceled tick 2026-02-24T19:24:11.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 >> v1:10.20.193.45:6800/1599977652 conn(0x7fb09c077ee0 legacy=0x7fb09c098390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 10 monclient: shutdown 2026-02-24T19:24:11.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:11.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 >> v1:10.20.193.114:6789/0 conn(0x7fb0d00b9f80 legacy=0x7fb0d00b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0ced76640 1 -- 10.20.193.45:0/1554894856 reap_dead start 2026-02-24T19:24:11.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 shutdown_connections 2026-02-24T19:24:11.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 >> 10.20.193.45:0/1554894856 conn(0x7fb0d00b7990 msgr2=0x7fb0d00b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:11.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 shutdown_connections 2026-02-24T19:24:11.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 1 -- 10.20.193.45:0/1554894856 wait complete. 2026-02-24T19:24:11.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.345+0000 7fb0d4f33640 1 librados: shutdown 2026-02-24T19:24:11.357 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-24T19:24:11.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.423+0000 7ffa1c283640 10 monclient: get_monmap_and_config 2026-02-24T19:24:11.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.423+0000 7ffa1c283640 10 monclient: build_initial_monmap 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.423+0000 7ffa1c283640 10 monclient: monmap: 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:11.424223+0000 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:11.424223+0000 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:11.427 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:11.428 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.423+0000 7ffa1c283640 1 Processor -- start 2026-02-24T19:24:11.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.423+0000 7ffa1c283640 1 -- start start 2026-02-24T19:24:11.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.423+0000 7ffa1c283640 10 monclient: init 2026-02-24T19:24:11.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:11.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:11.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 10 monclient(hunting): picked mon.noname-a con 0x7ffa14157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:11.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 10 monclient(hunting): picked mon.noname-b con 0x7ffa14157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:11.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 10 monclient(hunting): picked mon.noname-c con 0x7ffa14164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:11.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1405de70 con 0x7ffa14157780 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa14055b20 con 0x7ffa14157b50 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa14055e00 con 0x7ffa14164d00 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa1c283640 10 monclient(hunting): authenticate will time out at 4023.063208s 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa19ff8640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7ffa14157780 0x7ffa14056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41300/0 (socket says 10.20.193.45:41300) 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.424+0000 7ffa19ff8640 1 -- 10.20.193.45:0/448314595 learned_addr learned my addr 10.20.193.45:0/448314595 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.425+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703725589 0 0) 0x7ffa1405de70 con 0x7ffa14157780 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.425+0000 7ffa18ff6640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.425+0000 7ffa18ff6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.425+0000 7ffa18ff6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.425+0000 7ffa18ff6640 10 monclient(hunting): my global_id is 30741 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.425+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9fc003610 con 0x7ffa14157780 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466475274 0 0) 0x7ffa14055b20 con 0x7ffa14157b50 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 10 monclient(hunting): my global_id is 28207 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa1405de70 con 0x7ffa14157b50 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211334642 0 0) 0x7ffa14055e00 con 0x7ffa14164d00 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 10 monclient(hunting): my global_id is 26681 2026-02-24T19:24:11.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.426+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa14055b20 con 0x7ffa14164d00 2026-02-24T19:24:11.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 839911388 0 0) 0x7ff9fc003610 con 0x7ffa14157780 2026-02-24T19:24:11.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 >> v1:10.20.193.179:6789/0 conn(0x7ffa14164d00 legacy=0x7ffa141c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 >> v1:10.20.193.114:6789/0 conn(0x7ffa14157b50 legacy=0x7ffa141645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 10 monclient: _finish_hunting 0 2026-02-24T19:24:11.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 1 monclient: found mon.noname-a 2026-02-24T19:24:11.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa140560e0 con 0x7ffa14157780 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 10 monclient: _finish_auth 0 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 10 monclient: _check_auth_tickets 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffa04002df0 con 0x7ffa14157780 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa18ff6640 10 monclient: dump: 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.440 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa1c283640 5 monclient: authenticate success, global_id 30741 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.427+0000 7ffa1c283640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa04002fc0 con 0x7ffa14157780 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa18ff6640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa18ff6640 1 -- 10.20.193.45:0/448314595 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffa04003400 con 0x7ffa14157780 2026-02-24T19:24:11.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa18ff6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa18ff6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa18ff6640 10 monclient: dump: 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.442 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa1c283640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa1c283640 4 set_mon_vals no callback set 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa1c283640 10 monclient: shutdown 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa1c283640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa1c283640 1 -- 10.20.193.45:0/448314595 >> v1:10.20.193.45:6789/0 conn(0x7ffa14157780 legacy=0x7ffa14056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa1c283640 1 -- 10.20.193.45:0/448314595 shutdown_connections 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa1c283640 1 -- 10.20.193.45:0/448314595 >> 10.20.193.45:0/448314595 conn(0x7ffa140b2ef0 msgr2=0x7ffa140b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa1c283640 1 -- 10.20.193.45:0/448314595 shutdown_connections 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.428+0000 7ffa1c283640 1 -- 10.20.193.45:0/448314595 wait complete. 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient: build_initial_monmap 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient: monmap: 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:11.443 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 1 librados: starting msgr at 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 1 librados: starting objecter 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 1 Processor -- start 2026-02-24T19:24:11.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 1 -- start start 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 1 librados: setting wanted keys 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 1 librados: calling monclient init 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient: init 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient(hunting): picked mon.noname-a con 0x7ffa14157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient(hunting): picked mon.noname-b con 0x7ffa14157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient(hunting): picked mon.noname-c con 0x7ffa14164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa14147e40 con 0x7ffa14157780 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa14148120 con 0x7ffa14157b50 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa14148400 con 0x7ffa14164d00 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa1c283640 10 monclient(hunting): authenticate will time out at 4023.068755s 2026-02-24T19:24:11.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa19ff8640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7ffa14157780 0x7ffa14143c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41316/0 (socket says 10.20.193.45:41316) 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.429+0000 7ffa19ff8640 1 -- 10.20.193.45:0/524212600 learned_addr learned my addr 10.20.193.45:0/524212600 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.430+0000 7ffa027fc640 10 client.?.objecter ms_handle_connect 0x7ffa14157780 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.430+0000 7ffa027fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.430+0000 7ffa027fc640 10 client.?.objecter ms_handle_connect 0x7ffa14164d00 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.430+0000 7ffa027fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.430+0000 7ffa027fc640 10 client.?.objecter ms_handle_connect 0x7ffa14157b50 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.430+0000 7ffa027fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077625235 0 0) 0x7ffa14147e40 con 0x7ffa14157780 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 10 monclient(hunting): my global_id is 30744 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e4003610 con 0x7ffa14157780 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893039373 0 0) 0x7ffa14148400 con 0x7ffa14164d00 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 10 monclient(hunting): my global_id is 26684 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.431+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa14147e40 con 0x7ffa14164d00 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.432+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3945701514 0 0) 0x7ffa14148120 con 0x7ffa14157b50 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.432+0000 7ffa027fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.432+0000 7ffa027fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.432+0000 7ffa027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.432+0000 7ffa027fc640 10 monclient(hunting): my global_id is 28210 2026-02-24T19:24:11.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.432+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa14148400 con 0x7ffa14157b50 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3413521171 0 0) 0x7ff9e4003610 con 0x7ffa14157780 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa14148120 con 0x7ffa14157780 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffa04003310 con 0x7ffa14157780 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 10 monclient(hunting): dump: 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.448 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2619024487 0 0) 0x7ffa14147e40 con 0x7ffa14164d00 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9e4003610 con 0x7ffa14164d00 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffa10003330 con 0x7ffa14164d00 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.433+0000 7ffa027fc640 10 monclient(hunting): dump: 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.449 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.434+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2558617206 0 0) 0x7ffa14148400 con 0x7ffa14157b50 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.434+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa14147e40 con 0x7ffa14157b50 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.434+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffa08003070 con 0x7ffa14157b50 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.434+0000 7ffa027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.434+0000 7ffa027fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:11.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.434+0000 7ffa027fc640 10 monclient(hunting): dump: 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2226246601 0 0) 0x7ffa14148120 con 0x7ffa14157780 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 >> v1:10.20.193.179:6789/0 conn(0x7ffa14164d00 legacy=0x7ffa141471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 >> v1:10.20.193.114:6789/0 conn(0x7ffa14157b50 legacy=0x7ffa14138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 1 monclient: found mon.a 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa141486e0 con 0x7ffa14157780 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 5 monclient: authenticate success, global_id 30744 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 10 monclient: _renew_subs 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffa141489c0 con 0x7ffa14157780 2026-02-24T19:24:11.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 10 client.30744.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:11.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 10 monclient: _renew_subs 2026-02-24T19:24:11.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffa140a60f0 con 0x7ffa14157780 2026-02-24T19:24:11.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 1 librados: init done 2026-02-24T19:24:11.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:11.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:11.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.435+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa1415b3f0 con 0x7ffa14157780 2026-02-24T19:24:11.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.566+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa040029a0 con 0x7ffa14157780 2026-02-24T19:24:11.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.566+0000 7ffa027fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:11.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.566+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7ffa04004b80 con 0x7ffa14157780 2026-02-24T19:24:11.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.566+0000 7ffa027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.566+0000 7ffa027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:11.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.566+0000 7ffa03fff640 4 set_mon_vals no callback set 2026-02-24T19:24:11.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.566+0000 7ffa027fc640 10 monclient: dump: 2026-02-24T19:24:11.570 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.570 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.571 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.571 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.571 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.571 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.571 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.571 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.571 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.571 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.567+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7ffa04004d60 con 0x7ffa14157780 2026-02-24T19:24:11.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.567+0000 7ffa197f7640 10 monclient: get_auth_request con 0x7ff9e4077ed0 auth_method 0 2026-02-24T19:24:11.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.568+0000 7ffa027fc640 10 client.30744.objecter ms_handle_connect 0x7ff9e4077ed0 2026-02-24T19:24:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.571+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7ffa04093160 con 0x7ffa14157780 2026-02-24T19:24:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.571+0000 7ffa027fc640 10 client.30744.objecter ms_dispatch2 0x7ffa14000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.571+0000 7ffa027fc640 3 client.30744.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.571+0000 7ffa027fc640 3 client.30744.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.572+0000 7ffa027fc640 20 client.30744.objecter dump_active .. 0 homeless 2026-02-24T19:24:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.572+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ffa04004b80 con 0x7ffa14157780 2026-02-24T19:24:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.572+0000 7ffa027fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.572+0000 7ffa027fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:11.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.679+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7ffa1405c7b0 con 0x7ff9e4077ed0 2026-02-24T19:24:11.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.679+0000 7ffa027fc640 1 -- 10.20.193.45:0/524212600 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (unknown 3896554461 0 0) 0x7ffa1405c7b0 con 0x7ff9e4077ed0 2026-02-24T19:24:11.683 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 10 to deep-scrub 2026-02-24T19:24:11.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 10 librados: watch_flush enter 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 10 librados: watch_flush exit 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 20 client.30744.objecter shutdown clearing up homeless session... 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 10 client.30744.objecter successfully canceled tick 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 >> v1:10.20.193.45:6800/1599977652 conn(0x7ff9e4077ed0 legacy=0x7ff9e4098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 10 monclient: shutdown 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 >> v1:10.20.193.45:6789/0 conn(0x7ffa14157780 legacy=0x7ffa14143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 shutdown_connections 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.681+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 >> 10.20.193.45:0/524212600 conn(0x7ffa140b2ef0 msgr2=0x7ffa1405b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.682+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 shutdown_connections 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.682+0000 7ffa1c283640 1 -- 10.20.193.45:0/524212600 wait complete. 2026-02-24T19:24:11.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.682+0000 7ffa1c283640 1 librados: shutdown 2026-02-24T19:24:11.694 INFO:tasks.ceph:Scrubbing osd.14 2026-02-24T19:24:11.694 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:11.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.759+0000 7fbe07583640 10 monclient: get_monmap_and_config 2026-02-24T19:24:11.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.759+0000 7fbe07583640 10 monclient: build_initial_monmap 2026-02-24T19:24:11.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.759+0000 7fbe07583640 10 monclient: monmap: 2026-02-24T19:24:11.763 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:11.763 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.763 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:11.760928+0000 2026-02-24T19:24:11.764 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:11.760928+0000 2026-02-24T19:24:11.764 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:11.764 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.764 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:11.764 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:11.764 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:11.764 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 1 Processor -- start 2026-02-24T19:24:11.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 1 -- start start 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 10 monclient: init 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 10 monclient(hunting): picked mon.noname-a con 0x7fbe0015e2a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 10 monclient(hunting): picked mon.noname-c con 0x7fbe00059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 10 monclient(hunting): picked mon.noname-b con 0x7fbe001a5660 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe00162df0 con 0x7fbe0015e2a0 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe001630d0 con 0x7fbe001a5660 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe001633b0 con 0x7fbe00059e10 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.760+0000 7fbe07583640 10 monclient(hunting): authenticate will time out at 4023.399884s 2026-02-24T19:24:11.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.761+0000 7fbe052f8640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fbe0015e2a0 0x7fbe0005da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41318/0 (socket says 10.20.193.45:41318) 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.761+0000 7fbe052f8640 1 -- 10.20.193.45:0/3638517220 learned_addr learned my addr 10.20.193.45:0/3638517220 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476508095 0 0) 0x7fbe00162df0 con 0x7fbe0015e2a0 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): my global_id is 30747 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbde8003610 con 0x7fbe0015e2a0 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893267944 0 0) 0x7fbe001633b0 con 0x7fbe00059e10 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): my global_id is 26687 2026-02-24T19:24:11.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe00162df0 con 0x7fbe00059e10 2026-02-24T19:24:11.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223470229 0 0) 0x7fbe001630d0 con 0x7fbe001a5660 2026-02-24T19:24:11.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 10 monclient(hunting): my global_id is 28213 2026-02-24T19:24:11.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.762+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe001633b0 con 0x7fbe001a5660 2026-02-24T19:24:11.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1875033439 0 0) 0x7fbde8003610 con 0x7fbe0015e2a0 2026-02-24T19:24:11.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 >> v1:10.20.193.179:6789/0 conn(0x7fbe00059e10 legacy=0x7fbe0015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 >> v1:10.20.193.114:6789/0 conn(0x7fbe001a5660 legacy=0x7fbe001c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:11.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 1 monclient: found mon.noname-a 2026-02-24T19:24:11.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:11.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe00163690 con 0x7fbe0015e2a0 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 10 monclient: _finish_auth 0 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbdf0002df0 con 0x7fbe0015e2a0 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbdeffff640 10 monclient: dump: 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.776 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbe07583640 5 monclient: authenticate success, global_id 30747 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.764+0000 7fbe07583640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbdf0002fc0 con 0x7fbe0015e2a0 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbdeffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbdeffff640 1 -- 10.20.193.45:0/3638517220 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbdf0003400 con 0x7fbe0015e2a0 2026-02-24T19:24:11.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbdeffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbdeffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbdeffff640 10 monclient: dump: 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.778 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbe07583640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbe07583640 4 set_mon_vals no callback set 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbe07583640 10 monclient: shutdown 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbe07583640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbe07583640 1 -- 10.20.193.45:0/3638517220 >> v1:10.20.193.45:6789/0 conn(0x7fbe0015e2a0 legacy=0x7fbe0005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbe07583640 1 -- 10.20.193.45:0/3638517220 shutdown_connections 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbe07583640 1 -- 10.20.193.45:0/3638517220 >> 10.20.193.45:0/3638517220 conn(0x7fbe000b2f60 msgr2=0x7fbe000b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbe07583640 1 -- 10.20.193.45:0/3638517220 shutdown_connections 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.765+0000 7fbe07583640 1 -- 10.20.193.45:0/3638517220 wait complete. 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient: build_initial_monmap 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient: monmap: 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:11.779 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 1 librados: starting msgr at 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 1 librados: starting objecter 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 1 Processor -- start 2026-02-24T19:24:11.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 1 -- start start 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 1 librados: setting wanted keys 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 1 librados: calling monclient init 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient: init 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient(hunting): picked mon.noname-c con 0x7fbe00059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient(hunting): picked mon.noname-b con 0x7fbe0015e2a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient(hunting): picked mon.noname-a con 0x7fbe001a5660 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe00161cb0 con 0x7fbe001a5660 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe00057410 con 0x7fbe0015e2a0 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe00160dc0 con 0x7fbe00059e10 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:11.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.766+0000 7fbe07583640 10 monclient(hunting): authenticate will time out at 4023.405833s 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.767+0000 7fbe05af9640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fbe001a5660 0x7fbe000afd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41328/0 (socket says 10.20.193.45:41328) 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.767+0000 7fbe05af9640 1 -- 10.20.193.45:0/3684150662 learned_addr learned my addr 10.20.193.45:0/3684150662 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.767+0000 7fbdedffb640 10 client.?.objecter ms_handle_connect 0x7fbe001a5660 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.767+0000 7fbdedffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.767+0000 7fbdedffb640 10 client.?.objecter ms_handle_connect 0x7fbe0015e2a0 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.767+0000 7fbdedffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.767+0000 7fbdedffb640 10 client.?.objecter ms_handle_connect 0x7fbe00059e10 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.767+0000 7fbdedffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926994137 0 0) 0x7fbe00161cb0 con 0x7fbe001a5660 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): my global_id is 30750 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdd0003610 con 0x7fbe001a5660 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754542588 0 0) 0x7fbe00057410 con 0x7fbe0015e2a0 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): my global_id is 28216 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe00161cb0 con 0x7fbe0015e2a0 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246155051 0 0) 0x7fbe00160dc0 con 0x7fbe00059e10 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 10 monclient(hunting): my global_id is 26690 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.768+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe00057410 con 0x7fbe00059e10 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.770+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 521987572 0 0) 0x7fbdd0003610 con 0x7fbe001a5660 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.770+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe00160dc0 con 0x7fbe001a5660 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.770+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbdfc003470 con 0x7fbe001a5660 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.770+0000 7fbdedffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.770+0000 7fbdedffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.770+0000 7fbdedffb640 10 monclient(hunting): dump: 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.784 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.770+0000 7fbdedffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 61896832 0 0) 0x7fbe00057410 con 0x7fbe00059e10 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbdd0003610 con 0x7fbe00059e10 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 840004944 0 0) 0x7fbe00161cb0 con 0x7fbe0015e2a0 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe00057410 con 0x7fbe0015e2a0 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbdf4002ff0 con 0x7fbe0015e2a0 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 10 monclient(hunting): dump: 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbdf0003310 con 0x7fbe00059e10 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.771+0000 7fbdedffb640 10 monclient(hunting): dump: 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.787 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3457384242 0 0) 0x7fbe00160dc0 con 0x7fbe001a5660 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 >> v1:10.20.193.179:6789/0 conn(0x7fbe00059e10 legacy=0x7fbe001605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 >> v1:10.20.193.114:6789/0 conn(0x7fbe0015e2a0 legacy=0x7fbe00056d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 1 monclient: found mon.a 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe001610a0 con 0x7fbe001a5660 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:11.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbdedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 5 monclient: authenticate success, global_id 30750 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 10 monclient: _renew_subs 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbe00161380 con 0x7fbe001a5660 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 10 client.30750.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 10 monclient: _renew_subs 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbe00161940 con 0x7fbe001a5660 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 1 librados: init done 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 10 client.30750.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 15 client.30750.objecter _session_command_op_assign -1 1 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 20 client.30750.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:11.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 10 client.30750.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.772+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fbe001925b0 con 0x7fbe001a5660 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.781+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe001925b0 con 0x7fbe001a5660 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.781+0000 7fbdedffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.781+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fbdfc003d30 con 0x7fbe001a5660 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.781+0000 7fbdedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.781+0000 7fbdef7fe640 4 set_mon_vals no callback set 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.781+0000 7fbdedffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.781+0000 7fbdedffb640 10 monclient: dump: 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.793 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.782+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fbdfc003f10 con 0x7fbe001a5660 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.782+0000 7fbe052f8640 10 monclient: get_auth_request con 0x7fbdd0077ed0 auth_method 0 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.782+0000 7fbdedffb640 10 client.30750.objecter ms_handle_connect 0x7fbdd0077ed0 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fbdfc093360 con 0x7fbe001a5660 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 10 client.30750.objecter ms_dispatch2 0x7fbe00000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:11.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 3 client.30750.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 3 client.30750.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 10 client.30750.objecter checking command 1 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 20 client.30750.objecter _get_session s=0x7fbdd00a21a0 osd=14 3 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 20 client.30750.objecter put_session s=0x7fbdd00a21a0 osd=14 3 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 15 client.30750.objecter _session_command_op_remove -1 1 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 20 client.30750.objecter _get_session s=0x7fbdd00a21a0 osd=14 3 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 20 client.30750.objecter get_session s=0x7fbdd00a21a0 osd=14 3 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 15 client.30750.objecter _session_command_op_assign 14 1 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 20 client.30750.objecter put_session s=0x7fbdd00a21a0 osd=14 4 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 10 client.30750.objecter _send_command 1 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.179:6812/1196591242 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbdd00c44b0 con 0x7fbdd00a2850 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 20 client.30750.objecter dump_active .. 0 homeless 2026-02-24T19:24:11.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fbdfc059a00 con 0x7fbe001a5660 2026-02-24T19:24:11.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.783+0000 7fbdedffb640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:11.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.784+0000 7fbe04af7640 10 monclient: get_auth_request con 0x7fbdd00a2850 auth_method 0 2026-02-24T19:24:11.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.785+0000 7fbdedffb640 10 client.30750.objecter ms_handle_connect 0x7fbdd00a2850 2026-02-24T19:24:11.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.794+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== osd.14 v1:10.20.193.179:6812/1196591242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fbdd00c44b0 con 0x7fbdd00a2850 2026-02-24T19:24:11.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.794+0000 7fbdedffb640 10 client.30750.objecter ms_dispatch2 0x7fbe00000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:11.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.794+0000 7fbdedffb640 10 client.30750.objecter _finish_command 1 = system:0 2026-02-24T19:24:11.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.794+0000 7fbdedffb640 20 client.30750.objecter put_session s=0x7fbdd00a21a0 osd=14 4 2026-02-24T19:24:11.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.794+0000 7fbdedffb640 15 client.30750.objecter _session_command_op_remove 14 1 2026-02-24T19:24:11.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 10 client.30750.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:11.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 15 client.30750.objecter _session_command_op_assign -1 2 2026-02-24T19:24:11.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 20 client.30750.objecter _get_session s=0x7fbdd00a21a0 osd=14 3 2026-02-24T19:24:11.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 20 client.30750.objecter put_session s=0x7fbdd00a21a0 osd=14 3 2026-02-24T19:24:11.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 20 client.30750.objecter _get_session s=0x7fbdd00a21a0 osd=14 3 2026-02-24T19:24:11.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 15 client.30750.objecter _session_command_op_remove -1 2 2026-02-24T19:24:11.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 20 client.30750.objecter get_session s=0x7fbdd00a21a0 osd=14 3 2026-02-24T19:24:11.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 15 client.30750.objecter _session_command_op_assign 14 2 2026-02-24T19:24:11.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 20 client.30750.objecter put_session s=0x7fbdd00a21a0 osd=14 4 2026-02-24T19:24:11.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 10 client.30750.objecter _send_command 2 2026-02-24T19:24:11.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.801+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 --> v1:10.20.193.179:6812/1196591242 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe001922d0 con 0x7fbdd00a2850 2026-02-24T19:24:11.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbdedffb640 1 -- 10.20.193.45:0/3684150662 <== osd.14 v1:10.20.193.179:6812/1196591242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fbe001922d0 con 0x7fbdd00a2850 2026-02-24T19:24:11.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbdedffb640 10 client.30750.objecter ms_dispatch2 0x7fbe00000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:11.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbdedffb640 10 client.30750.objecter _finish_command 2 = system:0 2026-02-24T19:24:11.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbdedffb640 20 client.30750.objecter put_session s=0x7fbdd00a21a0 osd=14 4 2026-02-24T19:24:11.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbdedffb640 15 client.30750.objecter _session_command_op_remove 14 2 2026-02-24T19:24:11.813 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:11.813 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:11.814 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:11.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 10 librados: watch_flush enter 2026-02-24T19:24:11.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 10 librados: watch_flush exit 2026-02-24T19:24:11.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 10 client.30750.objecter close_session for osd.14 2026-02-24T19:24:11.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 >> v1:10.20.193.179:6812/1196591242 conn(0x7fbdd00a2850 legacy=0x7fbdd00c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 20 client.30750.objecter put_session s=0x7fbdd00a21a0 osd=14 1 2026-02-24T19:24:11.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 20 client.30750.objecter shutdown clearing up homeless session... 2026-02-24T19:24:11.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 10 client.30750.objecter successfully canceled tick 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 >> v1:10.20.193.45:6800/1599977652 conn(0x7fbdd0077ed0 legacy=0x7fbdd0098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 10 monclient: shutdown 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 >> v1:10.20.193.45:6789/0 conn(0x7fbe001a5660 legacy=0x7fbe000afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe05af9640 1 -- 10.20.193.45:0/3684150662 reap_dead start 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 shutdown_connections 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 >> 10.20.193.45:0/3684150662 conn(0x7fbe000b2f60 msgr2=0x7fbe0015d490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 shutdown_connections 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 1 -- 10.20.193.45:0/3684150662 wait complete. 2026-02-24T19:24:11.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.809+0000 7fbe07583640 1 librados: shutdown 2026-02-24T19:24:11.821 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-24T19:24:11.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.886+0000 7f73c2398640 10 monclient: get_monmap_and_config 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.886+0000 7f73c2398640 10 monclient: build_initial_monmap 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.886+0000 7f73c2398640 10 monclient: monmap: 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:11.887523+0000 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:11.887523+0000 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:11.890 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:11.891 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:11.891 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.886+0000 7f73c2398640 1 Processor -- start 2026-02-24T19:24:11.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.886+0000 7f73c2398640 1 -- start start 2026-02-24T19:24:11.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.886+0000 7f73c2398640 10 monclient: init 2026-02-24T19:24:11.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:11.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 10 monclient(hunting): picked mon.noname-c con 0x7f73bc157780 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 10 monclient(hunting): picked mon.noname-b con 0x7f73bc157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 10 monclient(hunting): picked mon.noname-a con 0x7f73bc164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc05de70 con 0x7f73bc164d00 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc055b20 con 0x7f73bc157b50 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc055e00 con 0x7f73bc157780 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c2398640 10 monclient(hunting): authenticate will time out at 4023.526508s 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c090e640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f73bc164d00 0x7f73bc1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41330/0 (socket says 10.20.193.45:41330) 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.887+0000 7f73c090e640 1 -- 10.20.193.45:0/271430140 learned_addr learned my addr 10.20.193.45:0/271430140 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:11.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789230383 0 0) 0x7f73bc05de70 con 0x7f73bc164d00 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): my global_id is 30753 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73a0003610 con 0x7f73bc164d00 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822841252 0 0) 0x7f73bc055b20 con 0x7f73bc157b50 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): my global_id is 28219 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73bc05de70 con 0x7f73bc157b50 2026-02-24T19:24:11.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576857597 0 0) 0x7f73bc055e00 con 0x7f73bc157780 2026-02-24T19:24:11.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 10 monclient(hunting): my global_id is 26693 2026-02-24T19:24:11.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.889+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73bc055b20 con 0x7f73bc157780 2026-02-24T19:24:11.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3240437756 0 0) 0x7f73bc05de70 con 0x7f73bc157b50 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 >> v1:10.20.193.179:6789/0 conn(0x7f73bc157780 legacy=0x7f73bc056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 >> v1:10.20.193.45:6789/0 conn(0x7f73bc164d00 legacy=0x7f73bc1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 1 monclient: found mon.noname-b 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc0560e0 con 0x7f73bc157b50 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:11.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f73ac002df0 con 0x7f73bc157b50 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 10 monclient: dump: 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.903 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73c2398640 5 monclient: authenticate success, global_id 28219 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73c2398640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.891+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f73ac002fc0 con 0x7f73bc157b50 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73baffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 4 set_mon_vals no callback set 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73baffd640 1 -- 10.20.193.45:0/271430140 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f73ac003400 con 0x7f73bc157b50 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73baffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73baffd640 10 monclient: dump: 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.904 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 10 monclient: shutdown 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 1 -- 10.20.193.45:0/271430140 >> v1:10.20.193.114:6789/0 conn(0x7f73bc157b50 legacy=0x7f73bc1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 1 -- 10.20.193.45:0/271430140 shutdown_connections 2026-02-24T19:24:11.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 1 -- 10.20.193.45:0/271430140 >> 10.20.193.45:0/271430140 conn(0x7f73bc0b2ef0 msgr2=0x7f73bc0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 1 -- 10.20.193.45:0/271430140 shutdown_connections 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 1 -- 10.20.193.45:0/271430140 wait complete. 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 10 monclient: build_initial_monmap 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 10 monclient: monmap: 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:11.906 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 1 librados: starting msgr at 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 1 librados: starting objecter 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.892+0000 7f73c2398640 1 Processor -- start 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 1 -- start start 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 1 librados: setting wanted keys 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 1 librados: calling monclient init 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 10 monclient: init 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:11.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 10 monclient(hunting): picked mon.noname-c con 0x7f73bc157780 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 10 monclient(hunting): picked mon.noname-b con 0x7f73bc157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 10 monclient(hunting): picked mon.noname-a con 0x7f73bc164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc15c270 con 0x7f73bc164d00 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc13bbc0 con 0x7f73bc157b50 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73bc13bea0 con 0x7f73bc157780 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c2398640 10 monclient(hunting): authenticate will time out at 4023.532392s 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c090e640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f73bc164d00 0x7f73bc13af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41334/0 (socket says 10.20.193.45:41334) 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73c090e640 1 -- 10.20.193.45:0/1738749791 learned_addr learned my addr 10.20.193.45:0/1738749791 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73b8ff9640 10 client.?.objecter ms_handle_connect 0x7f73bc164d00 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73b8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73b8ff9640 10 client.?.objecter ms_handle_connect 0x7f73bc157b50 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73b8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73b8ff9640 10 client.?.objecter ms_handle_connect 0x7f73bc157780 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.893+0000 7f73b8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54408219 0 0) 0x7f73bc15c270 con 0x7f73bc164d00 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): my global_id is 30756 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f738c003610 con 0x7f73bc164d00 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471381322 0 0) 0x7f73bc13bbc0 con 0x7f73bc157b50 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): my global_id is 28222 2026-02-24T19:24:11.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73bc15c270 con 0x7f73bc157b50 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564562133 0 0) 0x7f73bc13bea0 con 0x7f73bc157780 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 10 monclient(hunting): my global_id is 26696 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.894+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73bc13bbc0 con 0x7f73bc157780 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1908456738 0 0) 0x7f73bc15c270 con 0x7f73bc157b50 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73bc13bea0 con 0x7f73bc157b50 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f73ac003310 con 0x7f73bc157b50 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:11.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4219796191 0 0) 0x7f73bc13bbc0 con 0x7f73bc157780 2026-02-24T19:24:11.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73bc15c270 con 0x7f73bc157780 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2143717729 0 0) 0x7f738c003610 con 0x7f73bc164d00 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73bc13bbc0 con 0x7f73bc164d00 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f73b0003290 con 0x7f73bc164d00 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.912 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f73a8003180 con 0x7f73bc157780 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.897+0000 7f73b8ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.913 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.914 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.914 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.914 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.914 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.914 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.898+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 818911206 0 0) 0x7f73bc13bea0 con 0x7f73bc157b50 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 >> v1:10.20.193.179:6789/0 conn(0x7f73bc157780 legacy=0x7f73bc15bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 >> v1:10.20.193.45:6789/0 conn(0x7f73bc164d00 legacy=0x7f73bc13af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 1 monclient: found mon.b 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc13c180 con 0x7f73bc157b50 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 10 monclient: _finish_auth 0 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73b8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 5 monclient: authenticate success, global_id 28222 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 10 monclient: _renew_subs 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f73bc13c460 con 0x7f73bc157b50 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 10 client.28222.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 10 monclient: _renew_subs 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f73bc138d00 con 0x7f73bc157b50 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 1 librados: init done 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.899+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73bc138f90 con 0x7f73bc157b50 2026-02-24T19:24:11.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.903+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f73ac002f70 con 0x7f73bc157b50 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.903+0000 7f73b8ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.903+0000 7f73ba7fc640 4 set_mon_vals no callback set 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.907+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f73ac003b00 con 0x7f73bc157b50 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.907+0000 7f73b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.907+0000 7f73b8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.907+0000 7f73b8ff9640 10 monclient: dump: 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:11.919 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.907+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f73ac003d20 con 0x7f73bc157b50 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.908+0000 7f73bbfff640 10 monclient: get_auth_request con 0x7f738c077dd0 auth_method 0 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.908+0000 7f73b8ff9640 10 client.28222.objecter ms_handle_connect 0x7f738c077dd0 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.909+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f73ac058220 con 0x7f73bc157b50 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.909+0000 7f73b8ff9640 10 client.28222.objecter ms_dispatch2 0x7f73bc000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.909+0000 7f73b8ff9640 3 client.28222.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.909+0000 7f73b8ff9640 3 client.28222.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:11.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.909+0000 7f73b8ff9640 20 client.28222.objecter dump_active .. 0 homeless 2026-02-24T19:24:11.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.993+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f73ac05c990 con 0x7f73bc157b50 2026-02-24T19:24:11.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.993+0000 7f73b8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:11.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:11.993+0000 7f73b8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:12.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.099+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7f73bc0b38c0 con 0x7f738c077dd0 2026-02-24T19:24:12.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.099+0000 7f73b8ff9640 1 -- 10.20.193.45:0/1738749791 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (unknown 1939288360 0 0) 0x7f73bc0b38c0 con 0x7f738c077dd0 2026-02-24T19:24:12.103 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 14 to deep-scrub 2026-02-24T19:24:12.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 10 librados: watch_flush enter 2026-02-24T19:24:12.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 10 librados: watch_flush exit 2026-02-24T19:24:12.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 20 client.28222.objecter shutdown clearing up homeless session... 2026-02-24T19:24:12.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 10 client.28222.objecter successfully canceled tick 2026-02-24T19:24:12.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 >> v1:10.20.193.45:6800/1599977652 conn(0x7f738c077dd0 legacy=0x7f738c098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 10 monclient: shutdown 2026-02-24T19:24:12.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:12.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 >> v1:10.20.193.114:6789/0 conn(0x7f73bc157b50 legacy=0x7f73bc1385f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 shutdown_connections 2026-02-24T19:24:12.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 >> 10.20.193.45:0/1738749791 conn(0x7f73bc0b2ef0 msgr2=0x7f73bc13db00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:12.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 shutdown_connections 2026-02-24T19:24:12.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 1 -- 10.20.193.45:0/1738749791 wait complete. 2026-02-24T19:24:12.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.100+0000 7f73c2398640 1 librados: shutdown 2026-02-24T19:24:12.112 INFO:tasks.ceph:Scrubbing osd.3 2026-02-24T19:24:12.113 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.177+0000 7fef1a046640 10 monclient: get_monmap_and_config 2026-02-24T19:24:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.177+0000 7fef1a046640 10 monclient: build_initial_monmap 2026-02-24T19:24:12.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.177+0000 7fef1a046640 10 monclient: monmap: 2026-02-24T19:24:12.181 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:12.181 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.181 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:12.178772+0000 2026-02-24T19:24:12.181 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:12.178772+0000 2026-02-24T19:24:12.181 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:12.182 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.182 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:12.182 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:12.182 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:12.182 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 1 Processor -- start 2026-02-24T19:24:12.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 1 -- start start 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 10 monclient: init 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 10 monclient(hunting): picked mon.noname-b con 0x7fef1415e2a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 10 monclient(hunting): picked mon.noname-c con 0x7fef14059e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 10 monclient(hunting): picked mon.noname-a con 0x7fef141a5660 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef14162df0 con 0x7fef141a5660 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef141630d0 con 0x7fef1415e2a0 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef141633b0 con 0x7fef14059e10 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:12.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef1a046640 10 monclient(hunting): authenticate will time out at 4023.817706s 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.178+0000 7fef13fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fef141a5660 0x7fef141c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41338/0 (socket says 10.20.193.45:41338) 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.179+0000 7fef13fff640 1 -- 10.20.193.45:0/59471453 learned_addr learned my addr 10.20.193.45:0/59471453 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156414204 0 0) 0x7fef14162df0 con 0x7fef141a5660 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): my global_id is 30759 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feef8003610 con 0x7fef141a5660 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1759951005 0 0) 0x7fef141630d0 con 0x7fef1415e2a0 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): my global_id is 28225 2026-02-24T19:24:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef14162df0 con 0x7fef1415e2a0 2026-02-24T19:24:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702446079 0 0) 0x7fef141633b0 con 0x7fef14059e10 2026-02-24T19:24:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 10 monclient(hunting): my global_id is 26699 2026-02-24T19:24:12.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.180+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef141630d0 con 0x7fef14059e10 2026-02-24T19:24:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2304978853 0 0) 0x7feef8003610 con 0x7fef141a5660 2026-02-24T19:24:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 >> v1:10.20.193.179:6789/0 conn(0x7fef14059e10 legacy=0x7fef1415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 >> v1:10.20.193.114:6789/0 conn(0x7fef1415e2a0 legacy=0x7fef1405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:12.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 1 monclient: found mon.noname-a 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef14163690 con 0x7fef141a5660 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef08003170 con 0x7fef141a5660 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef127fc640 10 monclient: dump: 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.195 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef1a046640 5 monclient: authenticate success, global_id 30759 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.182+0000 7fef1a046640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef08003340 con 0x7fef141a5660 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef127fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:12.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef127fc640 1 -- 10.20.193.45:0/59471453 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef08003780 con 0x7fef141a5660 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef127fc640 10 monclient: dump: 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.197 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 4 set_mon_vals no callback set 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 10 monclient: shutdown 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 1 -- 10.20.193.45:0/59471453 >> v1:10.20.193.45:6789/0 conn(0x7fef141a5660 legacy=0x7fef141c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 1 -- 10.20.193.45:0/59471453 shutdown_connections 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 1 -- 10.20.193.45:0/59471453 >> 10.20.193.45:0/59471453 conn(0x7fef140b2f60 msgr2=0x7fef140b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 1 -- 10.20.193.45:0/59471453 shutdown_connections 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 1 -- 10.20.193.45:0/59471453 wait complete. 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 10 monclient: build_initial_monmap 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.183+0000 7fef1a046640 10 monclient: monmap: 2026-02-24T19:24:12.198 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 1 librados: starting msgr at 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 1 librados: starting objecter 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:12.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 1 Processor -- start 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 1 -- start start 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 1 librados: setting wanted keys 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 1 librados: calling monclient init 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 10 monclient: init 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 10 monclient(hunting): picked mon.noname-a con 0x7fef14059e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 10 monclient(hunting): picked mon.noname-b con 0x7fef1415e2a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 10 monclient(hunting): picked mon.noname-c con 0x7fef141a5660 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef14196000 con 0x7fef14059e10 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef141962e0 con 0x7fef1415e2a0 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef14055980 con 0x7fef141a5660 2026-02-24T19:24:12.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef1a046640 10 monclient(hunting): authenticate will time out at 4023.823611s 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef137fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fef14059e10 0x7fef1411ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41344/0 (socket says 10.20.193.45:41344) 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7fef137fe640 1 -- 10.20.193.45:0/1872261810 learned_addr learned my addr 10.20.193.45:0/1872261810 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7feeeffff640 10 client.?.objecter ms_handle_connect 0x7fef14059e10 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.184+0000 7feeeffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 10 client.?.objecter ms_handle_connect 0x7fef1415e2a0 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 10 client.?.objecter ms_handle_connect 0x7fef141a5660 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180029240 0 0) 0x7fef14196000 con 0x7fef14059e10 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 10 monclient(hunting): my global_id is 30762 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.185+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feee4003610 con 0x7fef14059e10 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604157137 0 0) 0x7fef141962e0 con 0x7fef1415e2a0 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 10 monclient(hunting): my global_id is 28228 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef14196000 con 0x7fef1415e2a0 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951148433 0 0) 0x7fef14055980 con 0x7fef141a5660 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 10 monclient(hunting): my global_id is 26702 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.186+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef141962e0 con 0x7fef141a5660 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2546832136 0 0) 0x7feee4003610 con 0x7fef14059e10 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef14055980 con 0x7fef14059e10 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef00003190 con 0x7fef14059e10 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 10 monclient(hunting): dump: 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.203 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3730138629 0 0) 0x7fef141962e0 con 0x7fef141a5660 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feee4003610 con 0x7fef141a5660 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef080034f0 con 0x7fef141a5660 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.188+0000 7feeeffff640 10 monclient(hunting): dump: 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1258919559 0 0) 0x7fef14196000 con 0x7fef1415e2a0 2026-02-24T19:24:12.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef141962e0 con 0x7fef1415e2a0 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef04002fb0 con 0x7fef1415e2a0 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 10 monclient(hunting): dump: 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.206 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3415620344 0 0) 0x7fef14055980 con 0x7fef14059e10 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 >> v1:10.20.193.179:6789/0 conn(0x7fef141a5660 legacy=0x7fef1415f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 >> v1:10.20.193.114:6789/0 conn(0x7fef1415e2a0 legacy=0x7fef14056740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 1 monclient: found mon.a 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef14055c60 con 0x7fef14059e10 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 10 monclient: _finish_auth 0 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7feeeffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:12.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7fef1a046640 5 monclient: authenticate success, global_id 30762 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7fef1a046640 10 monclient: _renew_subs 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7fef1a046640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fef14055f40 con 0x7fef14059e10 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7fef1a046640 10 client.30762.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7fef1a046640 10 monclient: _renew_subs 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7fef1a046640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fef14056e50 con 0x7fef14059e10 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.189+0000 7fef1a046640 1 librados: init done 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.190+0000 7fef1a046640 10 client.30762.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.190+0000 7fef1a046640 15 client.30762.objecter _session_command_op_assign -1 1 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.190+0000 7fef1a046640 20 client.30762.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.190+0000 7fef1a046640 10 client.30762.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:12.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.190+0000 7fef1a046640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.190+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.45:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fef14056460 con 0x7fef14059e10 2026-02-24T19:24:12.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.198+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef00003520 con 0x7fef14059e10 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.198+0000 7feeeffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.198+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fef00003b50 con 0x7fef14059e10 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.198+0000 7feeeffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.198+0000 7feeeffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.198+0000 7feeeffff640 10 monclient: dump: 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.211 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.198+0000 7fef11ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.199+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fef00003d60 con 0x7fef14059e10 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7fef12ffd640 10 monclient: get_auth_request con 0x7feee4077ed0 auth_method 0 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 10 client.30762.objecter ms_handle_connect 0x7feee4077ed0 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fef000932c0 con 0x7fef14059e10 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 10 client.30762.objecter ms_dispatch2 0x7fef14000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 3 client.30762.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:12.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 3 client.30762.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 10 client.30762.objecter checking command 1 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 20 client.30762.objecter _get_session s=0x7feee40a21a0 osd=3 3 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 20 client.30762.objecter put_session s=0x7feee40a21a0 osd=3 3 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 15 client.30762.objecter _session_command_op_remove -1 1 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 20 client.30762.objecter _get_session s=0x7feee40a21a0 osd=3 3 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 20 client.30762.objecter get_session s=0x7feee40a21a0 osd=3 3 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 15 client.30762.objecter _session_command_op_assign 3 1 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 20 client.30762.objecter put_session s=0x7feee40a21a0 osd=3 4 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 10 client.30762.objecter _send_command 1 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.194:6804/3920278128 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feee40c4550 con 0x7feee40a2850 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 20 client.30762.objecter dump_active .. 0 homeless 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fef0005d3c0 con 0x7fef14059e10 2026-02-24T19:24:12.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.200+0000 7feeeffff640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:12.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.201+0000 7fef13fff640 10 monclient: get_auth_request con 0x7feee40a2850 auth_method 0 2026-02-24T19:24:12.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.202+0000 7feeeffff640 10 client.30762.objecter ms_handle_connect 0x7feee40a2850 2026-02-24T19:24:12.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.211+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== osd.3 v1:10.20.193.194:6804/3920278128 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7feee40c4550 con 0x7feee40a2850 2026-02-24T19:24:12.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.211+0000 7feeeffff640 10 client.30762.objecter ms_dispatch2 0x7fef14000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:12.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.211+0000 7feeeffff640 10 client.30762.objecter _finish_command 1 = system:0 2026-02-24T19:24:12.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.211+0000 7feeeffff640 20 client.30762.objecter put_session s=0x7feee40a21a0 osd=3 4 2026-02-24T19:24:12.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.211+0000 7feeeffff640 15 client.30762.objecter _session_command_op_remove 3 1 2026-02-24T19:24:12.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 10 client.30762.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 15 client.30762.objecter _session_command_op_assign -1 2 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 20 client.30762.objecter _get_session s=0x7feee40a21a0 osd=3 3 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 20 client.30762.objecter put_session s=0x7feee40a21a0 osd=3 3 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 20 client.30762.objecter _get_session s=0x7feee40a21a0 osd=3 3 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 15 client.30762.objecter _session_command_op_remove -1 2 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 20 client.30762.objecter get_session s=0x7feee40a21a0 osd=3 3 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 15 client.30762.objecter _session_command_op_assign 3 2 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 20 client.30762.objecter put_session s=0x7feee40a21a0 osd=3 4 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 10 client.30762.objecter _send_command 2 2026-02-24T19:24:12.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.218+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 --> v1:10.20.193.194:6804/3920278128 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fef140570e0 con 0x7feee40a2850 2026-02-24T19:24:12.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7feeeffff640 1 -- 10.20.193.45:0/1872261810 <== osd.3 v1:10.20.193.194:6804/3920278128 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fef140570e0 con 0x7feee40a2850 2026-02-24T19:24:12.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7feeeffff640 10 client.30762.objecter ms_dispatch2 0x7fef14000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:12.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7feeeffff640 10 client.30762.objecter _finish_command 2 = system:0 2026-02-24T19:24:12.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7feeeffff640 20 client.30762.objecter put_session s=0x7feee40a21a0 osd=3 4 2026-02-24T19:24:12.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7feeeffff640 15 client.30762.objecter _session_command_op_remove 3 2 2026-02-24T19:24:12.230 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:12.230 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:12.230 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:12.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7fef1a046640 10 librados: watch_flush enter 2026-02-24T19:24:12.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7fef1a046640 10 librados: watch_flush exit 2026-02-24T19:24:12.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7fef1a046640 10 client.30762.objecter close_session for osd.3 2026-02-24T19:24:12.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 >> v1:10.20.193.194:6804/3920278128 conn(0x7feee40a2850 legacy=0x7feee40c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7fef1a046640 20 client.30762.objecter put_session s=0x7feee40a21a0 osd=3 1 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7fef1a046640 20 client.30762.objecter shutdown clearing up homeless session... 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.225+0000 7fef1a046640 10 client.30762.objecter successfully canceled tick 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 >> v1:10.20.193.45:6800/1599977652 conn(0x7feee4077ed0 legacy=0x7feee4098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef1a046640 10 monclient: shutdown 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef1a046640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 >> v1:10.20.193.45:6789/0 conn(0x7fef14059e10 legacy=0x7fef1411ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef13fff640 1 -- 10.20.193.45:0/1872261810 reap_dead start 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 shutdown_connections 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 >> 10.20.193.45:0/1872261810 conn(0x7fef140b2f60 msgr2=0x7fef14161f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:12.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 shutdown_connections 2026-02-24T19:24:12.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef1a046640 1 -- 10.20.193.45:0/1872261810 wait complete. 2026-02-24T19:24:12.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.226+0000 7fef1a046640 1 librados: shutdown 2026-02-24T19:24:12.237 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-24T19:24:12.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.302+0000 7f6a826a6640 10 monclient: get_monmap_and_config 2026-02-24T19:24:12.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.302+0000 7f6a826a6640 10 monclient: build_initial_monmap 2026-02-24T19:24:12.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.302+0000 7f6a826a6640 10 monclient: monmap: 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:12.303259+0000 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:12.303259+0000 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:12.306 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.302+0000 7f6a826a6640 1 Processor -- start 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.302+0000 7f6a826a6640 1 -- start start 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.302+0000 7f6a826a6640 10 monclient: init 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 10 monclient(hunting): picked mon.noname-a con 0x7f6a7c157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 10 monclient(hunting): picked mon.noname-b con 0x7f6a7c157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 10 monclient(hunting): picked mon.noname-c con 0x7f6a7c164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7c05de70 con 0x7f6a7c157780 2026-02-24T19:24:12.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7c055b20 con 0x7f6a7c157b50 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7c055e00 con 0x7f6a7c164d00 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a826a6640 10 monclient(hunting): authenticate will time out at 4023.942250s 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a7bfff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6a7c157780 0x7f6a7c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41352/0 (socket says 10.20.193.45:41352) 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.303+0000 7f6a7bfff640 1 -- 10.20.193.45:0/2171268531 learned_addr learned my addr 10.20.193.45:0/2171268531 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.304+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425788340 0 0) 0x7f6a7c05de70 con 0x7f6a7c157780 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.304+0000 7f6a7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.304+0000 7f6a7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.304+0000 7f6a7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.304+0000 7f6a7affd640 10 monclient(hunting): my global_id is 30765 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.304+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a60003610 con 0x7f6a7c157780 2026-02-24T19:24:12.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547086661 0 0) 0x7f6a7c055e00 con 0x7f6a7c164d00 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 10 monclient(hunting): my global_id is 26705 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a7c05de70 con 0x7f6a7c164d00 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293869282 0 0) 0x7f6a7c055b20 con 0x7f6a7c157b50 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 10 monclient(hunting): my global_id is 28231 2026-02-24T19:24:12.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.305+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a7c055e00 con 0x7f6a7c157b50 2026-02-24T19:24:12.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 278913657 0 0) 0x7f6a7c05de70 con 0x7f6a7c164d00 2026-02-24T19:24:12.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 >> v1:10.20.193.114:6789/0 conn(0x7f6a7c157b50 legacy=0x7f6a7c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 >> v1:10.20.193.45:6789/0 conn(0x7f6a7c157780 legacy=0x7f6a7c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:12.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 1 monclient: found mon.noname-c 2026-02-24T19:24:12.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:12.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c0560e0 con 0x7f6a7c164d00 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 10 monclient: _finish_auth 0 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6a70003170 con 0x7f6a7c164d00 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a7affd640 10 monclient: dump: 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.317 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a826a6640 5 monclient: authenticate success, global_id 26705 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.307+0000 7f6a826a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a70003340 con 0x7f6a7c164d00 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a7affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a7affd640 1 -- 10.20.193.45:0/2171268531 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6a70003780 con 0x7f6a7c164d00 2026-02-24T19:24:12.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 4 set_mon_vals no callback set 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a7affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a7affd640 10 monclient: dump: 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.319 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 10 monclient: shutdown 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 1 -- 10.20.193.45:0/2171268531 >> v1:10.20.193.179:6789/0 conn(0x7f6a7c164d00 legacy=0x7f6a7c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 1 -- 10.20.193.45:0/2171268531 shutdown_connections 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 1 -- 10.20.193.45:0/2171268531 >> 10.20.193.45:0/2171268531 conn(0x7f6a7c0b2ef0 msgr2=0x7f6a7c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 1 -- 10.20.193.45:0/2171268531 shutdown_connections 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 1 -- 10.20.193.45:0/2171268531 wait complete. 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 10 monclient: build_initial_monmap 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.308+0000 7f6a826a6640 10 monclient: monmap: 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:12.320 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 1 librados: starting msgr at 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 1 librados: starting objecter 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 1 Processor -- start 2026-02-24T19:24:12.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 1 -- start start 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 1 librados: setting wanted keys 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 1 librados: calling monclient init 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 10 monclient: init 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 10 monclient(hunting): picked mon.noname-c con 0x7f6a7c157780 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 10 monclient(hunting): picked mon.noname-a con 0x7f6a7c157b50 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 10 monclient(hunting): picked mon.noname-b con 0x7f6a7c164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7c1466b0 con 0x7f6a7c157b50 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7c146990 con 0x7f6a7c164d00 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7c1358f0 con 0x7f6a7c157780 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a826a6640 10 monclient(hunting): authenticate will time out at 4023.948665s 2026-02-24T19:24:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a80c1c640 1 --1- >> v1:10.20.193.114:6789/0 conn(0x7f6a7c164d00 0x7f6a7c139f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.114:6789/0 says I am v1:10.20.193.45:52566/0 (socket says 10.20.193.45:52566) 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.309+0000 7f6a80c1c640 1 -- 10.20.193.45:0/1393618609 learned_addr learned my addr 10.20.193.45:0/1393618609 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.310+0000 7f6a78ff9640 10 client.?.objecter ms_handle_connect 0x7f6a7c164d00 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.310+0000 7f6a78ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.310+0000 7f6a78ff9640 10 client.?.objecter ms_handle_connect 0x7f6a7c157780 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.310+0000 7f6a78ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.310+0000 7f6a78ff9640 10 client.?.objecter ms_handle_connect 0x7f6a7c157b50 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.310+0000 7f6a78ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919055929 0 0) 0x7f6a7c146990 con 0x7f6a7c164d00 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 10 monclient(hunting): my global_id is 28234 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a4c003610 con 0x7f6a7c164d00 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42106743 0 0) 0x7f6a7c1358f0 con 0x7f6a7c157780 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 10 monclient(hunting): my global_id is 26708 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.311+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a7c146990 con 0x7f6a7c157780 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.312+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062938403 0 0) 0x7f6a7c1466b0 con 0x7f6a7c157b50 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.312+0000 7f6a78ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.312+0000 7f6a78ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.312+0000 7f6a78ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.312+0000 7f6a78ff9640 10 monclient(hunting): my global_id is 30768 2026-02-24T19:24:12.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.312+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a7c1358f0 con 0x7f6a7c157b50 2026-02-24T19:24:12.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.313+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3881309246 0 0) 0x7f6a4c003610 con 0x7f6a7c164d00 2026-02-24T19:24:12.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.313+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a7c1466b0 con 0x7f6a7c164d00 2026-02-24T19:24:12.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.313+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6a70003690 con 0x7f6a7c164d00 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.313+0000 7f6a78ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.313+0000 7f6a78ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.313+0000 7f6a78ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.328 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.313+0000 7f6a78ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.314+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3957099268 0 0) 0x7f6a7c146990 con 0x7f6a7c157780 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.314+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a4c003610 con 0x7f6a7c157780 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.314+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6a680030b0 con 0x7f6a7c157780 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.314+0000 7f6a78ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.314+0000 7f6a78ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.314+0000 7f6a78ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.329 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1714549761 0 0) 0x7f6a7c1358f0 con 0x7f6a7c157b50 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a7c146990 con 0x7f6a7c157b50 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6a6c003060 con 0x7f6a7c157b50 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:12.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3005287827 0 0) 0x7f6a7c1466b0 con 0x7f6a7c164d00 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 >> v1:10.20.193.179:6789/0 conn(0x7f6a7c157780 legacy=0x7f6a7c145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 >> v1:10.20.193.45:6789/0 conn(0x7f6a7c157b50 legacy=0x7f6a7c1363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 1 monclient: found mon.b 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c135bd0 con 0x7f6a7c164d00 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 10 monclient: _finish_auth 0 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a78ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a826a6640 5 monclient: authenticate success, global_id 28234 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a826a6640 10 monclient: _renew_subs 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a826a6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7c135eb0 con 0x7f6a7c164d00 2026-02-24T19:24:12.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a826a6640 10 client.28234.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a826a6640 10 monclient: _renew_subs 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a826a6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6a7c058010 con 0x7f6a7c164d00 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.315+0000 7f6a826a6640 1 librados: init done 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.316+0000 7f6a826a6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.316+0000 7f6a826a6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.316+0000 7f6a826a6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.316+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7c161ea0 con 0x7f6a7c164d00 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.324+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a700032f0 con 0x7f6a7c164d00 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.324+0000 7f6a78ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.324+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f6a70003e70 con 0x7f6a7c164d00 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.324+0000 7f6a78ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.324+0000 7f6a78ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:12.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.324+0000 7f6a78ff9640 10 monclient: dump: 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.324+0000 7f6a7a7fc640 4 set_mon_vals no callback set 2026-02-24T19:24:12.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.324+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f6a70004050 con 0x7f6a7c164d00 2026-02-24T19:24:12.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.325+0000 7f6a7bfff640 10 monclient: get_auth_request con 0x7f6a4c077dd0 auth_method 0 2026-02-24T19:24:12.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.325+0000 7f6a78ff9640 10 client.28234.objecter ms_handle_connect 0x7f6a4c077dd0 2026-02-24T19:24:12.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.325+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f6a70093400 con 0x7f6a7c164d00 2026-02-24T19:24:12.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.325+0000 7f6a78ff9640 10 client.28234.objecter ms_dispatch2 0x7f6a7c000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:12.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.325+0000 7f6a78ff9640 3 client.28234.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:12.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.325+0000 7f6a78ff9640 3 client.28234.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:12.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.325+0000 7f6a78ff9640 20 client.28234.objecter dump_active .. 0 homeless 2026-02-24T19:24:12.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.410+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6a7005de30 con 0x7f6a7c164d00 2026-02-24T19:24:12.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.410+0000 7f6a78ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:12.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.410+0000 7f6a78ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:12.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.518+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6a7c0b4d80 con 0x7f6a4c077dd0 2026-02-24T19:24:12.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.518+0000 7f6a78ff9640 1 -- 10.20.193.45:0/1393618609 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f6a7c0b4d80 con 0x7f6a4c077dd0 2026-02-24T19:24:12.522 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 3 to deep-scrub 2026-02-24T19:24:12.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 10 librados: watch_flush enter 2026-02-24T19:24:12.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 10 librados: watch_flush exit 2026-02-24T19:24:12.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 20 client.28234.objecter shutdown clearing up homeless session... 2026-02-24T19:24:12.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 10 client.28234.objecter successfully canceled tick 2026-02-24T19:24:12.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 >> v1:10.20.193.45:6800/1599977652 conn(0x7f6a4c077dd0 legacy=0x7f6a4c098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 10 monclient: shutdown 2026-02-24T19:24:12.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:12.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 >> v1:10.20.193.114:6789/0 conn(0x7f6a7c164d00 legacy=0x7f6a7c139f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 shutdown_connections 2026-02-24T19:24:12.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 >> 10.20.193.45:0/1393618609 conn(0x7f6a7c0b2ef0 msgr2=0x7f6a7c13b900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:12.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 shutdown_connections 2026-02-24T19:24:12.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 1 -- 10.20.193.45:0/1393618609 wait complete. 2026-02-24T19:24:12.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.520+0000 7f6a826a6640 1 librados: shutdown 2026-02-24T19:24:12.532 INFO:tasks.ceph:Scrubbing osd.7 2026-02-24T19:24:12.532 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:12.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.599+0000 7fc970b02640 10 monclient: get_monmap_and_config 2026-02-24T19:24:12.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.599+0000 7fc970b02640 10 monclient: build_initial_monmap 2026-02-24T19:24:12.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.599+0000 7fc970b02640 10 monclient: monmap: 2026-02-24T19:24:12.603 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:12.603 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.603 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:12.600614+0000 2026-02-24T19:24:12.603 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:12.600614+0000 2026-02-24T19:24:12.603 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:12.603 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.603 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:12.604 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:12.604 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:12.604 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.600+0000 7fc970b02640 1 Processor -- start 2026-02-24T19:24:12.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.600+0000 7fc970b02640 1 -- start start 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.600+0000 7fc970b02640 10 monclient: init 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 10 monclient(hunting): picked mon.noname-c con 0x7fc96c159e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 10 monclient(hunting): picked mon.noname-b con 0x7fc96c15a1e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 10 monclient(hunting): picked mon.noname-a con 0x7fc96c161ac0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96c055ab0 con 0x7fc96c161ac0 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96c055d50 con 0x7fc96c15a1e0 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96c056030 con 0x7fc96c159e10 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:12.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc970b02640 10 monclient(hunting): authenticate will time out at 4024.240132s 2026-02-24T19:24:12.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc96ad76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc96c161ac0 0x7fc96c15fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41370/0 (socket says 10.20.193.45:41370) 2026-02-24T19:24:12.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.601+0000 7fc96ad76640 1 -- 10.20.193.45:0/993300657 learned_addr learned my addr 10.20.193.45:0/993300657 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:12.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.602+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972806690 0 0) 0x7fc96c055ab0 con 0x7fc96c161ac0 2026-02-24T19:24:12.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.602+0000 7fc969573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.602+0000 7fc969573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.602+0000 7fc969573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.602+0000 7fc969573640 10 monclient(hunting): my global_id is 30771 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.602+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc958003610 con 0x7fc96c161ac0 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598742955 0 0) 0x7fc96c056030 con 0x7fc96c159e10 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 10 monclient(hunting): my global_id is 26711 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc96c055ab0 con 0x7fc96c159e10 2026-02-24T19:24:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903434090 0 0) 0x7fc96c055d50 con 0x7fc96c15a1e0 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 10 monclient(hunting): my global_id is 28237 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.603+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc96c056030 con 0x7fc96c15a1e0 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3743623476 0 0) 0x7fc958003610 con 0x7fc96c161ac0 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 >> v1:10.20.193.179:6789/0 conn(0x7fc96c159e10 legacy=0x7fc96c059c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 >> v1:10.20.193.114:6789/0 conn(0x7fc96c15a1e0 legacy=0x7fc96c1613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 1 monclient: found mon.noname-a 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96c056310 con 0x7fc96c161ac0 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 10 monclient: _finish_auth 0 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc95c003170 con 0x7fc96c161ac0 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc970b02640 5 monclient: authenticate success, global_id 30771 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc970b02640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc969573640 10 monclient: dump: 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.611 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.612 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.612 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.612 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.612 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.612 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.612 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.612 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.612 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.604+0000 7fc970b02640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:12.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.605+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc95c003340 con 0x7fc96c161ac0 2026-02-24T19:24:12.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.605+0000 7fc969573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:12.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.605+0000 7fc969573640 1 -- 10.20.193.45:0/993300657 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc95c003780 con 0x7fc96c161ac0 2026-02-24T19:24:12.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.605+0000 7fc969573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.605+0000 7fc969573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:12.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.605+0000 7fc969573640 10 monclient: dump: 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.605+0000 7fc970b02640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:12.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.605+0000 7fc970b02640 4 set_mon_vals no callback set 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 10 monclient: shutdown 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 -- 10.20.193.45:0/993300657 >> v1:10.20.193.45:6789/0 conn(0x7fc96c161ac0 legacy=0x7fc96c15fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 -- 10.20.193.45:0/993300657 shutdown_connections 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 -- 10.20.193.45:0/993300657 >> 10.20.193.45:0/993300657 conn(0x7fc96c0b2f60 msgr2=0x7fc96c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 -- 10.20.193.45:0/993300657 shutdown_connections 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 -- 10.20.193.45:0/993300657 wait complete. 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 10 monclient: build_initial_monmap 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 10 monclient: monmap: 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:12.620 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 librados: starting msgr at 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 librados: starting objecter 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 Processor -- start 2026-02-24T19:24:12.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 -- start start 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 librados: setting wanted keys 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 1 librados: calling monclient init 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.606+0000 7fc970b02640 10 monclient: init 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 10 monclient(hunting): picked mon.noname-c con 0x7fc96c159e10 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 10 monclient(hunting): picked mon.noname-b con 0x7fc96c15a1e0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 10 monclient(hunting): picked mon.noname-a con 0x7fc96c161ac0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96c163ee0 con 0x7fc96c161ac0 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96c0af340 con 0x7fc96c15a1e0 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96c0af620 con 0x7fc96c159e10 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:12.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc970b02640 10 monclient(hunting): authenticate will time out at 4024.246380s 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc96ad76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc96c161ac0 0x7fc96c158330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41378/0 (socket says 10.20.193.45:41378) 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc96ad76640 1 -- 10.20.193.45:0/2986180556 learned_addr learned my addr 10.20.193.45:0/2986180556 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc952ffd640 10 client.?.objecter ms_handle_connect 0x7fc96c161ac0 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.607+0000 7fc952ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 10 client.?.objecter ms_handle_connect 0x7fc96c15a1e0 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 10 client.?.objecter ms_handle_connect 0x7fc96c159e10 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085626895 0 0) 0x7fc96c163ee0 con 0x7fc96c161ac0 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 10 monclient(hunting): my global_id is 30774 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc938003610 con 0x7fc96c161ac0 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.608+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4055243200 0 0) 0x7fc96c0af620 con 0x7fc96c159e10 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 10 monclient(hunting): my global_id is 26714 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc96c163ee0 con 0x7fc96c159e10 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499211470 0 0) 0x7fc96c0af340 con 0x7fc96c15a1e0 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 10 monclient(hunting): my global_id is 28240 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.609+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc96c0af620 con 0x7fc96c15a1e0 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1639906711 0 0) 0x7fc938003610 con 0x7fc96c161ac0 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc96c0af340 con 0x7fc96c161ac0 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc95c003690 con 0x7fc96c161ac0 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.625 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1780270405 0 0) 0x7fc96c163ee0 con 0x7fc96c159e10 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc938003610 con 0x7fc96c159e10 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc960003040 con 0x7fc96c159e10 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:12.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 949087740 0 0) 0x7fc96c0af620 con 0x7fc96c15a1e0 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc96c163ee0 con 0x7fc96c15a1e0 2026-02-24T19:24:12.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc954003090 con 0x7fc96c15a1e0 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.611+0000 7fc952ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.628 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2746815667 0 0) 0x7fc938003610 con 0x7fc96c159e10 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 >> v1:10.20.193.114:6789/0 conn(0x7fc96c15a1e0 legacy=0x7fc96c0a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 >> v1:10.20.193.45:6789/0 conn(0x7fc96c161ac0 legacy=0x7fc96c158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 1 monclient: found mon.c 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96c0af900 con 0x7fc96c159e10 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc952ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 5 monclient: authenticate success, global_id 26714 2026-02-24T19:24:12.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 10 monclient: _renew_subs 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc96c0afbe0 con 0x7fc96c159e10 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 10 client.26714.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 10 monclient: _renew_subs 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc96c0b01a0 con 0x7fc96c159e10 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 1 librados: init done 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 10 client.26714.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 15 client.26714.objecter _session_command_op_assign -1 1 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 20 client.26714.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 10 client.26714.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:12.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.613+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc96c138e30 con 0x7fc96c159e10 2026-02-24T19:24:12.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.620+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc96c138e30 con 0x7fc96c159e10 2026-02-24T19:24:12.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.620+0000 7fc952ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:12.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.620+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc960003770 con 0x7fc96c159e10 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.620+0000 7fc952ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.620+0000 7fc952ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.620+0000 7fc952ffd640 10 monclient: dump: 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.633 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.620+0000 7fc968d72640 4 set_mon_vals no callback set 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.621+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fc96001c5e0 con 0x7fc96c159e10 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.621+0000 7fc969d74640 10 monclient: get_auth_request con 0x7fc938077eb0 auth_method 0 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 10 client.26714.objecter ms_handle_connect 0x7fc938077eb0 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fc960091cd0 con 0x7fc96c159e10 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 10 client.26714.objecter ms_dispatch2 0x7fc96c000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 3 client.26714.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 3 client.26714.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 10 client.26714.objecter checking command 1 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 20 client.26714.objecter _get_session s=0x7fc9380a2180 osd=7 3 2026-02-24T19:24:12.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 20 client.26714.objecter put_session s=0x7fc9380a2180 osd=7 3 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 15 client.26714.objecter _session_command_op_remove -1 1 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 20 client.26714.objecter _get_session s=0x7fc9380a2180 osd=7 3 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 20 client.26714.objecter get_session s=0x7fc9380a2180 osd=7 3 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 15 client.26714.objecter _session_command_op_assign 7 1 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 20 client.26714.objecter put_session s=0x7fc9380a2180 osd=7 4 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 10 client.26714.objecter _send_command 1 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.194:6800/598300563 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9380c4490 con 0x7fc9380a2830 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 20 client.26714.objecter dump_active .. 0 homeless 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fc960058370 con 0x7fc96c159e10 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.622+0000 7fc952ffd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.623+0000 7fc96ad76640 10 monclient: get_auth_request con 0x7fc9380a2830 auth_method 0 2026-02-24T19:24:12.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.624+0000 7fc952ffd640 10 client.26714.objecter ms_handle_connect 0x7fc9380a2830 2026-02-24T19:24:12.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.633+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== osd.7 v1:10.20.193.194:6800/598300563 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc9380c4490 con 0x7fc9380a2830 2026-02-24T19:24:12.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.633+0000 7fc952ffd640 10 client.26714.objecter ms_dispatch2 0x7fc96c000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:12.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.633+0000 7fc952ffd640 10 client.26714.objecter _finish_command 1 = system:0 2026-02-24T19:24:12.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.633+0000 7fc952ffd640 20 client.26714.objecter put_session s=0x7fc9380a2180 osd=7 4 2026-02-24T19:24:12.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.633+0000 7fc952ffd640 15 client.26714.objecter _session_command_op_remove 7 1 2026-02-24T19:24:12.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 10 client.26714.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 15 client.26714.objecter _session_command_op_assign -1 2 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 20 client.26714.objecter _get_session s=0x7fc9380a2180 osd=7 3 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 20 client.26714.objecter put_session s=0x7fc9380a2180 osd=7 3 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 20 client.26714.objecter _get_session s=0x7fc9380a2180 osd=7 3 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 15 client.26714.objecter _session_command_op_remove -1 2 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 20 client.26714.objecter get_session s=0x7fc9380a2180 osd=7 3 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 15 client.26714.objecter _session_command_op_assign 7 2 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 20 client.26714.objecter put_session s=0x7fc9380a2180 osd=7 4 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 10 client.26714.objecter _send_command 2 2026-02-24T19:24:12.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.640+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 --> v1:10.20.193.194:6800/598300563 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc96c056c80 con 0x7fc9380a2830 2026-02-24T19:24:12.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc952ffd640 1 -- 10.20.193.45:0/2986180556 <== osd.7 v1:10.20.193.194:6800/598300563 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc96c056c80 con 0x7fc9380a2830 2026-02-24T19:24:12.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc952ffd640 10 client.26714.objecter ms_dispatch2 0x7fc96c000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:12.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc952ffd640 10 client.26714.objecter _finish_command 2 = system:0 2026-02-24T19:24:12.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc952ffd640 20 client.26714.objecter put_session s=0x7fc9380a2180 osd=7 4 2026-02-24T19:24:12.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc952ffd640 15 client.26714.objecter _session_command_op_remove 7 2 2026-02-24T19:24:12.651 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:12.652 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:12.652 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:12.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 10 librados: watch_flush enter 2026-02-24T19:24:12.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 10 librados: watch_flush exit 2026-02-24T19:24:12.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 10 client.26714.objecter close_session for osd.7 2026-02-24T19:24:12.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 >> v1:10.20.193.194:6800/598300563 conn(0x7fc9380a2830 legacy=0x7fc9380c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 20 client.26714.objecter put_session s=0x7fc9380a2180 osd=7 1 2026-02-24T19:24:12.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 20 client.26714.objecter shutdown clearing up homeless session... 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 10 client.26714.objecter successfully canceled tick 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 >> v1:10.20.193.45:6800/1599977652 conn(0x7fc938077eb0 legacy=0x7fc938098360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 10 monclient: shutdown 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 >> v1:10.20.193.179:6789/0 conn(0x7fc96c159e10 legacy=0x7fc96c1637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc96ad76640 1 -- 10.20.193.45:0/2986180556 reap_dead start 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 shutdown_connections 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 >> 10.20.193.45:0/2986180556 conn(0x7fc96c0b2f60 msgr2=0x7fc96c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 shutdown_connections 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.647+0000 7fc970b02640 1 -- 10.20.193.45:0/2986180556 wait complete. 2026-02-24T19:24:12.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.648+0000 7fc970b02640 1 librados: shutdown 2026-02-24T19:24:12.659 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-24T19:24:12.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.722+0000 7fd670a8b640 10 monclient: get_monmap_and_config 2026-02-24T19:24:12.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.722+0000 7fd670a8b640 10 monclient: build_initial_monmap 2026-02-24T19:24:12.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.722+0000 7fd670a8b640 10 monclient: monmap: 2026-02-24T19:24:12.726 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:12.726 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.726 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:12.723852+0000 2026-02-24T19:24:12.726 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:12.723852+0000 2026-02-24T19:24:12.727 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:12.727 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.727 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:12.727 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:12.727 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 1 Processor -- start 2026-02-24T19:24:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 1 -- start start 2026-02-24T19:24:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 10 monclient: init 2026-02-24T19:24:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 10 monclient(hunting): picked mon.noname-b con 0x7fd66c157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 10 monclient(hunting): picked mon.noname-c con 0x7fd66c157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 10 monclient(hunting): picked mon.noname-a con 0x7fd66c164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c05de70 con 0x7fd66c164d00 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c055b20 con 0x7fd66c157780 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c055e00 con 0x7fd66c157b50 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.723+0000 7fd670a8b640 10 monclient(hunting): authenticate will time out at 4024.362851s 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.724+0000 7fd66ad76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fd66c164d00 0x7fd66c1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41386/0 (socket says 10.20.193.45:41386) 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.724+0000 7fd66ad76640 1 -- 10.20.193.45:0/308047651 learned_addr learned my addr 10.20.193.45:0/308047651 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383998268 0 0) 0x7fd66c055e00 con 0x7fd66c157b50 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): my global_id is 26717 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd658003610 con 0x7fd66c157b50 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1246526141 0 0) 0x7fd66c055b20 con 0x7fd66c157780 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): my global_id is 28243 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c055e00 con 0x7fd66c157780 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144909652 0 0) 0x7fd66c05de70 con 0x7fd66c164d00 2026-02-24T19:24:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 10 monclient(hunting): my global_id is 30777 2026-02-24T19:24:12.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.725+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c055b20 con 0x7fd66c164d00 2026-02-24T19:24:12.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 570867436 0 0) 0x7fd658003610 con 0x7fd66c157b50 2026-02-24T19:24:12.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 >> v1:10.20.193.114:6789/0 conn(0x7fd66c157780 legacy=0x7fd66c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 >> v1:10.20.193.45:6789/0 conn(0x7fd66c164d00 legacy=0x7fd66c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:12.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 1 monclient: found mon.noname-c 2026-02-24T19:24:12.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:12.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:12.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c0560e0 con 0x7fd66c157b50 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: _finish_auth 0 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd654002df0 con 0x7fd66c157b50 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: dump: 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.738 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd670a8b640 5 monclient: authenticate success, global_id 26717 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd670a8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd654003000 con 0x7fd66c157b50 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 1 -- 10.20.193.45:0/308047651 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd654003400 con 0x7fd66c157b50 2026-02-24T19:24:12.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd669573640 10 monclient: dump: 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd670a8b640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.727+0000 7fd670a8b640 4 set_mon_vals no callback set 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 10 monclient: shutdown 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 1 -- 10.20.193.45:0/308047651 >> v1:10.20.193.179:6789/0 conn(0x7fd66c157b50 legacy=0x7fd66c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 1 -- 10.20.193.45:0/308047651 shutdown_connections 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 1 -- 10.20.193.45:0/308047651 >> 10.20.193.45:0/308047651 conn(0x7fd66c0b2ef0 msgr2=0x7fd66c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 1 -- 10.20.193.45:0/308047651 shutdown_connections 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 1 -- 10.20.193.45:0/308047651 wait complete. 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 10 monclient: build_initial_monmap 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 10 monclient: monmap: 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:12.741 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 1 librados: starting msgr at 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 1 librados: starting objecter 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.728+0000 7fd670a8b640 1 Processor -- start 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 1 -- start start 2026-02-24T19:24:12.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 1 librados: setting wanted keys 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 1 librados: calling monclient init 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 10 monclient: init 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 10 monclient(hunting): picked mon.noname-a con 0x7fd66c157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 10 monclient(hunting): picked mon.noname-b con 0x7fd66c157b50 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 10 monclient(hunting): picked mon.noname-c con 0x7fd66c164d00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c1497d0 con 0x7fd66c157780 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c149ab0 con 0x7fd66c157b50 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c149d90 con 0x7fd66c164d00 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd670a8b640 10 monclient(hunting): authenticate will time out at 4024.368442s 2026-02-24T19:24:12.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd66a575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fd66c157780 0x7fd66c146490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41392/0 (socket says 10.20.193.45:41392) 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd66a575640 1 -- 10.20.193.45:0/110909410 learned_addr learned my addr 10.20.193.45:0/110909410 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd652ffd640 10 client.?.objecter ms_handle_connect 0x7fd66c157780 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd652ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd652ffd640 10 client.?.objecter ms_handle_connect 0x7fd66c157b50 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.729+0000 7fd652ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 client.?.objecter ms_handle_connect 0x7fd66c164d00 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209255005 0 0) 0x7fd66c149ab0 con 0x7fd66c157b50 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 monclient(hunting): my global_id is 28246 2026-02-24T19:24:12.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd638003610 con 0x7fd66c157b50 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233266960 0 0) 0x7fd66c1497d0 con 0x7fd66c157780 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 10 monclient(hunting): my global_id is 30780 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.730+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c149ab0 con 0x7fd66c157780 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.731+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547672310 0 0) 0x7fd66c149d90 con 0x7fd66c164d00 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.731+0000 7fd652ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.731+0000 7fd652ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.731+0000 7fd652ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.731+0000 7fd652ffd640 10 monclient(hunting): my global_id is 26720 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.731+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd66c1497d0 con 0x7fd66c164d00 2026-02-24T19:24:12.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2831501604 0 0) 0x7fd66c149ab0 con 0x7fd66c157780 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd66c149d90 con 0x7fd66c157780 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd660003190 con 0x7fd66c157780 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.746 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2679576534 0 0) 0x7fd638003610 con 0x7fd66c157b50 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd66c149ab0 con 0x7fd66c157b50 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd654002d00 con 0x7fd66c157b50 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.733+0000 7fd652ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.747 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.748 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.748 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.748 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.748 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.748 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.748 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.734+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3416808425 0 0) 0x7fd66c1497d0 con 0x7fd66c164d00 2026-02-24T19:24:12.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.734+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd638003610 con 0x7fd66c164d00 2026-02-24T19:24:12.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.734+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd65c003330 con 0x7fd66c164d00 2026-02-24T19:24:12.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.734+0000 7fd652ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:12.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.734+0000 7fd652ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:12.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.734+0000 7fd652ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:12.750 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1433546636 0 0) 0x7fd66c149d90 con 0x7fd66c157780 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 >> v1:10.20.193.179:6789/0 conn(0x7fd66c164d00 legacy=0x7fd66c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 >> v1:10.20.193.114:6789/0 conn(0x7fd66c157b50 legacy=0x7fd66c160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 1 monclient: found mon.a 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c14a070 con 0x7fd66c157780 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd652ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 5 monclient: authenticate success, global_id 30780 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 10 monclient: _renew_subs 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd66c14a350 con 0x7fd66c157780 2026-02-24T19:24:12.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 10 client.30780.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:12.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 10 monclient: _renew_subs 2026-02-24T19:24:12.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd66c146d80 con 0x7fd66c157780 2026-02-24T19:24:12.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 1 librados: init done 2026-02-24T19:24:12.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:12.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:12.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:12.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.735+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd66c14a570 con 0x7fd66c157780 2026-02-24T19:24:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.862+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6600034e0 con 0x7fd66c157780 2026-02-24T19:24:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.862+0000 7fd652ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.862+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fd660003b50 con 0x7fd66c157780 2026-02-24T19:24:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.862+0000 7fd652ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.862+0000 7fd652ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.862+0000 7fd652ffd640 10 monclient: dump: 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:12.867 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.862+0000 7fd668d72640 4 set_mon_vals no callback set 2026-02-24T19:24:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.863+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fd660003d30 con 0x7fd66c157780 2026-02-24T19:24:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.864+0000 7fd669d74640 10 monclient: get_auth_request con 0x7fd638077e70 auth_method 0 2026-02-24T19:24:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.864+0000 7fd652ffd640 10 client.30780.objecter ms_handle_connect 0x7fd638077e70 2026-02-24T19:24:12.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.866+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fd6600932a0 con 0x7fd66c157780 2026-02-24T19:24:12.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.866+0000 7fd652ffd640 10 client.30780.objecter ms_dispatch2 0x7fd66c000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:12.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.866+0000 7fd652ffd640 3 client.30780.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:12.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.866+0000 7fd652ffd640 3 client.30780.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:12.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.866+0000 7fd652ffd640 20 client.30780.objecter dump_active .. 0 homeless 2026-02-24T19:24:12.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.866+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd66005dcd0 con 0x7fd66c157780 2026-02-24T19:24:12.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.866+0000 7fd652ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.866+0000 7fd652ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.970+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fd66c1460b0 con 0x7fd638077e70 2026-02-24T19:24:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd652ffd640 1 -- 10.20.193.45:0/110909410 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (unknown 1239724482 0 0) 0x7fd66c1460b0 con 0x7fd638077e70 2026-02-24T19:24:12.974 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 7 to deep-scrub 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 10 librados: watch_flush enter 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 10 librados: watch_flush exit 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 20 client.30780.objecter shutdown clearing up homeless session... 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 10 client.30780.objecter successfully canceled tick 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 >> v1:10.20.193.45:6800/1599977652 conn(0x7fd638077e70 legacy=0x7fd638098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 10 monclient: shutdown 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 >> v1:10.20.193.45:6789/0 conn(0x7fd66c157780 legacy=0x7fd66c146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 shutdown_connections 2026-02-24T19:24:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.971+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 >> 10.20.193.45:0/110909410 conn(0x7fd66c0b2ef0 msgr2=0x7fd66c138620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.972+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 shutdown_connections 2026-02-24T19:24:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.972+0000 7fd670a8b640 1 -- 10.20.193.45:0/110909410 wait complete. 2026-02-24T19:24:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:12.972+0000 7fd670a8b640 1 librados: shutdown 2026-02-24T19:24:12.984 INFO:tasks.ceph:Scrubbing osd.11 2026-02-24T19:24:12.984 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.050+0000 7f4c4fd67640 10 monclient: get_monmap_and_config 2026-02-24T19:24:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.050+0000 7f4c4fd67640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.050+0000 7f4c4fd67640 10 monclient: monmap: 2026-02-24T19:24:13.054 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.054 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.054 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:13.051492+0000 2026-02-24T19:24:13.054 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:13.051492+0000 2026-02-24T19:24:13.054 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.054 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.054 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.055 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.055 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.050+0000 7f4c4fd67640 1 Processor -- start 2026-02-24T19:24:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.050+0000 7f4c4fd67640 1 -- start start 2026-02-24T19:24:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.050+0000 7f4c4fd67640 10 monclient: init 2026-02-24T19:24:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 10 monclient(hunting): picked mon.noname-c con 0x7f4c4815e2a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 10 monclient(hunting): picked mon.noname-a con 0x7f4c48059e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 10 monclient(hunting): picked mon.noname-b con 0x7f4c481a5660 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c48162df0 con 0x7f4c48059e10 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c481630d0 con 0x7f4c481a5660 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c481633b0 con 0x7f4c4815e2a0 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4fd67640 10 monclient(hunting): authenticate will time out at 4024.690494s 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4d2db640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f4c48059e10 0x7f4c4815ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41398/0 (socket says 10.20.193.45:41398) 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.051+0000 7f4c4d2db640 1 -- 10.20.193.45:0/2325420770 learned_addr learned my addr 10.20.193.45:0/2325420770 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899396341 0 0) 0x7f4c481633b0 con 0x7f4c4815e2a0 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): my global_id is 26723 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c30003610 con 0x7f4c4815e2a0 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891225429 0 0) 0x7f4c48162df0 con 0x7f4c48059e10 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): my global_id is 30783 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c481633b0 con 0x7f4c48059e10 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604470978 0 0) 0x7f4c481630d0 con 0x7f4c481a5660 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 10 monclient(hunting): my global_id is 28249 2026-02-24T19:24:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.053+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c48162df0 con 0x7f4c481a5660 2026-02-24T19:24:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1940762897 0 0) 0x7f4c30003610 con 0x7f4c4815e2a0 2026-02-24T19:24:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 >> v1:10.20.193.114:6789/0 conn(0x7f4c481a5660 legacy=0x7f4c481c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 >> v1:10.20.193.45:6789/0 conn(0x7f4c48059e10 legacy=0x7f4c4815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 1 monclient: found mon.noname-c 2026-02-24T19:24:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c48163690 con 0x7f4c4815e2a0 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4cada640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4fd67640 5 monclient: authenticate success, global_id 26723 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.054+0000 7f4c4fd67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4c38002df0 con 0x7f4c4815e2a0 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 10 monclient: dump: 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.066 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4fd67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c38003040 con 0x7f4c4815e2a0 2026-02-24T19:24:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 1 -- 10.20.193.45:0/2325420770 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4c38003440 con 0x7f4c4815e2a0 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4fd67640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4fd67640 4 set_mon_vals no callback set 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.055+0000 7f4c4cada640 10 monclient: dump: 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.068 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 10 monclient: shutdown 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 -- 10.20.193.45:0/2325420770 >> v1:10.20.193.179:6789/0 conn(0x7f4c4815e2a0 legacy=0x7f4c4805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 -- 10.20.193.45:0/2325420770 shutdown_connections 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 -- 10.20.193.45:0/2325420770 >> 10.20.193.45:0/2325420770 conn(0x7f4c480b2f60 msgr2=0x7f4c480b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 -- 10.20.193.45:0/2325420770 shutdown_connections 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 -- 10.20.193.45:0/2325420770 wait complete. 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 10 monclient: monmap: 2026-02-24T19:24:13.069 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 librados: starting msgr at 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 librados: starting objecter 2026-02-24T19:24:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 Processor -- start 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 -- start start 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 librados: setting wanted keys 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 1 librados: calling monclient init 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.056+0000 7f4c4fd67640 10 monclient: init 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 10 monclient(hunting): picked mon.noname-a con 0x7f4c48059e10 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 10 monclient(hunting): picked mon.noname-b con 0x7f4c4815e2a0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 10 monclient(hunting): picked mon.noname-c con 0x7f4c481a5660 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c4812c190 con 0x7f4c48059e10 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c48196090 con 0x7f4c4815e2a0 2026-02-24T19:24:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c48055d90 con 0x7f4c481a5660 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4fd67640 10 monclient(hunting): authenticate will time out at 4024.696389s 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4dadc640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f4c48059e10 0x7f4c481a4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41406/0 (socket says 10.20.193.45:41406) 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c4dadc640 1 -- 10.20.193.45:0/1237804746 learned_addr learned my addr 10.20.193.45:0/1237804746 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c367fc640 10 client.?.objecter ms_handle_connect 0x7f4c48059e10 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c367fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c367fc640 10 client.?.objecter ms_handle_connect 0x7f4c481a5660 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.057+0000 7f4c367fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637451389 0 0) 0x7f4c4812c190 con 0x7f4c48059e10 2026-02-24T19:24:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 monclient(hunting): my global_id is 30786 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c18003610 con 0x7f4c48059e10 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708885931 0 0) 0x7f4c48055d90 con 0x7f4c481a5660 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 monclient(hunting): my global_id is 26726 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c4812c190 con 0x7f4c481a5660 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 client.?.objecter ms_handle_connect 0x7f4c4815e2a0 2026-02-24T19:24:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.058+0000 7f4c367fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.059+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296666688 0 0) 0x7f4c48196090 con 0x7f4c4815e2a0 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.059+0000 7f4c367fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.059+0000 7f4c367fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.059+0000 7f4c367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.059+0000 7f4c367fc640 10 monclient(hunting): my global_id is 28252 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.059+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c48055d90 con 0x7f4c4815e2a0 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4030632526 0 0) 0x7f4c4812c190 con 0x7f4c481a5660 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c48196090 con 0x7f4c481a5660 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4c44003410 con 0x7f4c481a5660 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 10 monclient(hunting): dump: 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:13.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3731046543 0 0) 0x7f4c18003610 con 0x7f4c48059e10 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c4812c190 con 0x7f4c48059e10 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4c380033d0 con 0x7f4c48059e10 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.061+0000 7f4c367fc640 10 monclient(hunting): dump: 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.076 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.077 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.077 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.077 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4056253308 0 0) 0x7f4c48055d90 con 0x7f4c4815e2a0 2026-02-24T19:24:13.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c18003610 con 0x7f4c4815e2a0 2026-02-24T19:24:13.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4c3c002f30 con 0x7f4c4815e2a0 2026-02-24T19:24:13.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 10 monclient(hunting): dump: 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.081 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 252637323 0 0) 0x7f4c48196090 con 0x7f4c481a5660 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 >> v1:10.20.193.114:6789/0 conn(0x7f4c4815e2a0 legacy=0x7f4c48056b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 >> v1:10.20.193.45:6789/0 conn(0x7f4c48059e10 legacy=0x7f4c481a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 1 monclient: found mon.c 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c48056070 con 0x7f4c481a5660 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c4fd67640 5 monclient: authenticate success, global_id 26726 2026-02-24T19:24:13.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c4fd67640 10 monclient: _renew_subs 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c4fd67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c48056350 con 0x7f4c481a5660 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c4fd67640 10 client.26726.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c4fd67640 10 monclient: _renew_subs 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c4fd67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c481a53c0 con 0x7f4c481a5660 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.062+0000 7f4c4fd67640 1 librados: init done 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.063+0000 7f4c4fd67640 10 client.26726.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.063+0000 7f4c4fd67640 15 client.26726.objecter _session_command_op_assign -1 1 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.063+0000 7f4c4fd67640 20 client.26726.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.063+0000 7f4c4fd67640 10 client.26726.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.063+0000 7f4c4fd67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.063+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.179:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4c48196370 con 0x7f4c481a5660 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.071+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c48196370 con 0x7f4c481a5660 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.071+0000 7f4c367fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.071+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f4c44003c20 con 0x7f4c481a5660 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.071+0000 7f4c367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.071+0000 7f4c367fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.071+0000 7f4c367fc640 10 monclient: dump: 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.084 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.071+0000 7f4c37fff640 4 set_mon_vals no callback set 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.071+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f4c4401ca90 con 0x7f4c481a5660 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.072+0000 7f4c4dadc640 10 monclient: get_auth_request con 0x7f4c18077e00 auth_method 0 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.072+0000 7f4c367fc640 10 client.26726.objecter ms_handle_connect 0x7f4c18077e00 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.072+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f4c44092190 con 0x7f4c481a5660 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.072+0000 7f4c367fc640 10 client.26726.objecter ms_dispatch2 0x7f4c48000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.072+0000 7f4c367fc640 3 client.26726.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.072+0000 7f4c367fc640 3 client.26726.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:13.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.072+0000 7f4c367fc640 10 client.26726.objecter checking command 1 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 20 client.26726.objecter _get_session s=0x7f4c180a20b0 osd=11 3 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 20 client.26726.objecter put_session s=0x7f4c180a20b0 osd=11 3 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 15 client.26726.objecter _session_command_op_remove -1 1 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 20 client.26726.objecter _get_session s=0x7f4c180a20b0 osd=11 3 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 20 client.26726.objecter get_session s=0x7f4c180a20b0 osd=11 3 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 15 client.26726.objecter _session_command_op_assign 11 1 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 20 client.26726.objecter put_session s=0x7f4c180a20b0 osd=11 4 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 10 client.26726.objecter _send_command 1 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.194:6812/1154629099 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c180c4460 con 0x7f4c180a2760 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 20 client.26726.objecter dump_active .. 0 homeless 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f4c44058830 con 0x7f4c481a5660 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c367fc640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:13.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.073+0000 7f4c4d2db640 10 monclient: get_auth_request con 0x7f4c180a2760 auth_method 0 2026-02-24T19:24:13.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.074+0000 7f4c367fc640 10 client.26726.objecter ms_handle_connect 0x7f4c180a2760 2026-02-24T19:24:13.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.084+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== osd.11 v1:10.20.193.194:6812/1154629099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f4c180c4460 con 0x7f4c180a2760 2026-02-24T19:24:13.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.084+0000 7f4c367fc640 10 client.26726.objecter ms_dispatch2 0x7f4c48000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:13.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.084+0000 7f4c367fc640 10 client.26726.objecter _finish_command 1 = system:0 2026-02-24T19:24:13.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.084+0000 7f4c367fc640 20 client.26726.objecter put_session s=0x7f4c180a20b0 osd=11 4 2026-02-24T19:24:13.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.084+0000 7f4c367fc640 15 client.26726.objecter _session_command_op_remove 11 1 2026-02-24T19:24:13.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 10 client.26726.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:13.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 15 client.26726.objecter _session_command_op_assign -1 2 2026-02-24T19:24:13.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 20 client.26726.objecter _get_session s=0x7f4c180a20b0 osd=11 3 2026-02-24T19:24:13.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 20 client.26726.objecter put_session s=0x7f4c180a20b0 osd=11 3 2026-02-24T19:24:13.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 20 client.26726.objecter _get_session s=0x7f4c180a20b0 osd=11 3 2026-02-24T19:24:13.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 15 client.26726.objecter _session_command_op_remove -1 2 2026-02-24T19:24:13.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 20 client.26726.objecter get_session s=0x7f4c180a20b0 osd=11 3 2026-02-24T19:24:13.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 15 client.26726.objecter _session_command_op_assign 11 2 2026-02-24T19:24:13.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 20 client.26726.objecter put_session s=0x7f4c180a20b0 osd=11 4 2026-02-24T19:24:13.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 10 client.26726.objecter _send_command 2 2026-02-24T19:24:13.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.091+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 --> v1:10.20.193.194:6812/1154629099 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4c48160770 con 0x7f4c180a2760 2026-02-24T19:24:13.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c367fc640 1 -- 10.20.193.45:0/1237804746 <== osd.11 v1:10.20.193.194:6812/1154629099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f4c48160770 con 0x7f4c180a2760 2026-02-24T19:24:13.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c367fc640 10 client.26726.objecter ms_dispatch2 0x7f4c48000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:13.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c367fc640 10 client.26726.objecter _finish_command 2 = system:0 2026-02-24T19:24:13.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c367fc640 20 client.26726.objecter put_session s=0x7f4c180a20b0 osd=11 4 2026-02-24T19:24:13.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c367fc640 15 client.26726.objecter _session_command_op_remove 11 2 2026-02-24T19:24:13.103 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:13.103 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:13.103 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:13.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 10 librados: watch_flush enter 2026-02-24T19:24:13.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 10 librados: watch_flush exit 2026-02-24T19:24:13.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 10 client.26726.objecter close_session for osd.11 2026-02-24T19:24:13.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 >> v1:10.20.193.194:6812/1154629099 conn(0x7f4c180a2760 legacy=0x7f4c180c2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 20 client.26726.objecter put_session s=0x7f4c180a20b0 osd=11 1 2026-02-24T19:24:13.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 20 client.26726.objecter shutdown clearing up homeless session... 2026-02-24T19:24:13.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 10 client.26726.objecter successfully canceled tick 2026-02-24T19:24:13.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 >> v1:10.20.193.45:6800/1599977652 conn(0x7f4c18077e00 legacy=0x7f4c180982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 10 monclient: shutdown 2026-02-24T19:24:13.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:13.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 >> v1:10.20.193.179:6789/0 conn(0x7f4c481a5660 legacy=0x7f4c4812b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4e2dd640 1 -- 10.20.193.45:0/1237804746 reap_dead start 2026-02-24T19:24:13.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 shutdown_connections 2026-02-24T19:24:13.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 >> 10.20.193.45:0/1237804746 conn(0x7f4c480b2f60 msgr2=0x7f4c480b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:13.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 shutdown_connections 2026-02-24T19:24:13.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 1 -- 10.20.193.45:0/1237804746 wait complete. 2026-02-24T19:24:13.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.099+0000 7f4c4fd67640 1 librados: shutdown 2026-02-24T19:24:13.110 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-24T19:24:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.175+0000 7f2ec91cf640 10 monclient: get_monmap_and_config 2026-02-24T19:24:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.175+0000 7f2ec91cf640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.175+0000 7f2ec91cf640 10 monclient: monmap: 2026-02-24T19:24:13.179 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.180 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.180 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:13.176987+0000 2026-02-24T19:24:13.180 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:13.176987+0000 2026-02-24T19:24:13.180 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.180 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.180 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.180 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.180 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 1 Processor -- start 2026-02-24T19:24:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 1 -- start start 2026-02-24T19:24:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 10 monclient: init 2026-02-24T19:24:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 10 monclient(hunting): picked mon.noname-b con 0x7f2ec4157780 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 10 monclient(hunting): picked mon.noname-c con 0x7f2ec4157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 10 monclient(hunting): picked mon.noname-a con 0x7f2ec4164d00 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec405de70 con 0x7f2ec4164d00 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec4055b20 con 0x7f2ec4157780 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec4055e00 con 0x7f2ec4157b50 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.176+0000 7f2ec91cf640 10 monclient(hunting): authenticate will time out at 4024.815967s 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.177+0000 7f2ec3577640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f2ec4164d00 0x7f2ec41c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41412/0 (socket says 10.20.193.45:41412) 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.177+0000 7f2ec3577640 1 -- 10.20.193.45:0/1711721023 learned_addr learned my addr 10.20.193.45:0/1711721023 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379517356 0 0) 0x7f2ec405de70 con 0x7f2ec4164d00 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): my global_id is 30789 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eb0003610 con 0x7f2ec4164d00 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274378033 0 0) 0x7f2ec4055b20 con 0x7f2ec4157780 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): my global_id is 28255 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ec405de70 con 0x7f2ec4157780 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3746530181 0 0) 0x7f2ec4055e00 con 0x7f2ec4157b50 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 10 monclient(hunting): my global_id is 26729 2026-02-24T19:24:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.178+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ec4055b20 con 0x7f2ec4157b50 2026-02-24T19:24:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3245731956 0 0) 0x7f2eb0003610 con 0x7f2ec4164d00 2026-02-24T19:24:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 >> v1:10.20.193.179:6789/0 conn(0x7f2ec4157b50 legacy=0x7f2ec41645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 >> v1:10.20.193.114:6789/0 conn(0x7f2ec4157780 legacy=0x7f2ec4056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 1 monclient: found mon.noname-a 2026-02-24T19:24:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec40560e0 con 0x7f2ec4164d00 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec91cf640 5 monclient: authenticate success, global_id 30789 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec91cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2eb4003170 con 0x7f2ec4164d00 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec1d74640 10 monclient: dump: 2026-02-24T19:24:13.192 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.180+0000 7f2ec91cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2eb40033c0 con 0x7f2ec4164d00 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec1d74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec1d74640 1 -- 10.20.193.45:0/1711721023 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2eb40037c0 con 0x7f2ec4164d00 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec91cf640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec91cf640 4 set_mon_vals no callback set 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec1d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec1d74640 10 monclient: dump: 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.194 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec91cf640 10 monclient: shutdown 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec91cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1711721023 >> v1:10.20.193.45:6789/0 conn(0x7f2ec4164d00 legacy=0x7f2ec41c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1711721023 shutdown_connections 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1711721023 >> 10.20.193.45:0/1711721023 conn(0x7f2ec40b2ef0 msgr2=0x7f2ec40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1711721023 shutdown_connections 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.181+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1711721023 wait complete. 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 10 monclient: monmap: 2026-02-24T19:24:13.195 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 1 librados: starting msgr at 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 1 librados: starting objecter 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 1 Processor -- start 2026-02-24T19:24:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 1 -- start start 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 1 librados: setting wanted keys 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 1 librados: calling monclient init 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 10 monclient: init 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.182+0000 7f2ec91cf640 10 monclient(hunting): picked mon.noname-a con 0x7f2ec4157780 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ec91cf640 10 monclient(hunting): picked mon.noname-c con 0x7f2ec4157b50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ec91cf640 10 monclient(hunting): picked mon.noname-b con 0x7f2ec4164d00 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ec91cf640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec413cab0 con 0x7f2ec4157780 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ec91cf640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec413cd90 con 0x7f2ec4164d00 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ec91cf640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec413d070 con 0x7f2ec4157b50 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ec91cf640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ec91cf640 10 monclient(hunting): authenticate will time out at 4024.822028s 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ec2d76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f2ec4157780 0x7f2ec4138d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41416/0 (socket says 10.20.193.45:41416) 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ec2d76640 1 -- 10.20.193.45:0/1723762847 learned_addr learned my addr 10.20.193.45:0/1723762847 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ea37fe640 10 client.?.objecter ms_handle_connect 0x7f2ec4157780 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ea37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ea37fe640 10 client.?.objecter ms_handle_connect 0x7f2ec4164d00 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ea37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ea37fe640 10 client.?.objecter ms_handle_connect 0x7f2ec4157b50 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.183+0000 7f2ea37fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1950068083 0 0) 0x7f2ec413cab0 con 0x7f2ec4157780 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): my global_id is 30792 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e90003610 con 0x7f2ec4157780 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089827061 0 0) 0x7f2ec413d070 con 0x7f2ec4157b50 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): my global_id is 26732 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ec413cab0 con 0x7f2ec4157b50 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181755240 0 0) 0x7f2ec413cd90 con 0x7f2ec4164d00 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 10 monclient(hunting): my global_id is 28258 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.184+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ec413d070 con 0x7f2ec4164d00 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.186+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1187687403 0 0) 0x7f2e90003610 con 0x7f2ec4157780 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.186+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ec413cd90 con 0x7f2ec4157780 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.186+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2eb80030e0 con 0x7f2ec4157780 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.186+0000 7f2ea37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.186+0000 7f2ea37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.186+0000 7f2ea37fe640 10 monclient(hunting): dump: 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.200 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.186+0000 7f2ea37fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 828846756 0 0) 0x7f2ec413cab0 con 0x7f2ec4157b50 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e90003610 con 0x7f2ec4157b50 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2eac003060 con 0x7f2ec4157b50 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 10 monclient(hunting): dump: 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.201 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2791234438 0 0) 0x7f2ec413d070 con 0x7f2ec4164d00 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ec413cab0 con 0x7f2ec4164d00 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2eb4003710 con 0x7f2ec4164d00 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.187+0000 7f2ea37fe640 10 monclient(hunting): dump: 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.203 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.2 v1:10.20.193.179:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1477696087 0 0) 0x7f2e90003610 con 0x7f2ec4157b50 2026-02-24T19:24:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 >> v1:10.20.193.114:6789/0 conn(0x7f2ec4164d00 legacy=0x7f2ec4149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 >> v1:10.20.193.45:6789/0 conn(0x7f2ec4157780 legacy=0x7f2ec4138d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 1 monclient: found mon.c 2026-02-24T19:24:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec413d350 con 0x7f2ec4157b50 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ea37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ec91cf640 5 monclient: authenticate success, global_id 26732 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ec91cf640 10 monclient: _renew_subs 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ec91cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.179:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec41478f0 con 0x7f2ec4157b50 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ec91cf640 10 client.26732.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ec91cf640 10 monclient: _renew_subs 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ec91cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.179:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ec4149bf0 con 0x7f2ec4157b50 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.188+0000 7f2ec91cf640 1 librados: init done 2026-02-24T19:24:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.189+0000 7f2ec91cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.189+0000 7f2ec91cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.189+0000 7f2ec91cf640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.189+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.179:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec415ea20 con 0x7f2ec4157b50 2026-02-24T19:24:13.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.277+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.2 v1:10.20.193.179:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2eac003700 con 0x7f2ec4157b50 2026-02-24T19:24:13.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.277+0000 7f2ea37fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.277+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.2 v1:10.20.193.179:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f2eac003a50 con 0x7f2ec4157b50 2026-02-24T19:24:13.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.277+0000 7f2ea37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.277+0000 7f2ea37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:13.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.277+0000 7f2ec1573640 4 set_mon_vals no callback set 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.277+0000 7f2ea37fe640 10 monclient: dump: 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.282 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.278+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.2 v1:10.20.193.179:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f2eac01c8c0 con 0x7f2ec4157b50 2026-02-24T19:24:13.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.278+0000 7f2ec2d76640 10 monclient: get_auth_request con 0x7f2e90077e70 auth_method 0 2026-02-24T19:24:13.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.279+0000 7f2ea37fe640 10 client.26732.objecter ms_handle_connect 0x7f2e90077e70 2026-02-24T19:24:13.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.279+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.2 v1:10.20.193.179:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f2eac091fa0 con 0x7f2ec4157b50 2026-02-24T19:24:13.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.279+0000 7f2ea37fe640 10 client.26732.objecter ms_dispatch2 0x7f2ec4000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:13.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.279+0000 7f2ea37fe640 3 client.26732.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:13.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.279+0000 7f2ea37fe640 3 client.26732.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:13.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.279+0000 7f2ea37fe640 20 client.26732.objecter dump_active .. 0 homeless 2026-02-24T19:24:13.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.280+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mon.2 v1:10.20.193.179:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2eac05c9d0 con 0x7f2ec4157b50 2026-02-24T19:24:13.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.280+0000 7f2ea37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.280+0000 7f2ea37fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:13.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.385+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7f2ec4059e10 con 0x7f2e90077e70 2026-02-24T19:24:13.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.386+0000 7f2ea37fe640 1 -- 10.20.193.45:0/1723762847 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (unknown 2412662492 0 0) 0x7f2ec4059e10 con 0x7f2e90077e70 2026-02-24T19:24:13.389 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 11 to deep-scrub 2026-02-24T19:24:13.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 10 librados: watch_flush enter 2026-02-24T19:24:13.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 10 librados: watch_flush exit 2026-02-24T19:24:13.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 20 client.26732.objecter shutdown clearing up homeless session... 2026-02-24T19:24:13.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 10 client.26732.objecter successfully canceled tick 2026-02-24T19:24:13.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 >> v1:10.20.193.45:6800/1599977652 conn(0x7f2e90077e70 legacy=0x7f2e90098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 10 monclient: shutdown 2026-02-24T19:24:13.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:13.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 >> v1:10.20.193.179:6789/0 conn(0x7f2ec4157b50 legacy=0x7f2ec413b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 shutdown_connections 2026-02-24T19:24:13.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 >> 10.20.193.45:0/1723762847 conn(0x7f2ec40b2ef0 msgr2=0x7f2ec40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:13.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 shutdown_connections 2026-02-24T19:24:13.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 1 -- 10.20.193.45:0/1723762847 wait complete. 2026-02-24T19:24:13.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.387+0000 7f2ec91cf640 1 librados: shutdown 2026-02-24T19:24:13.399 INFO:tasks.ceph:Scrubbing osd.15 2026-02-24T19:24:13.399 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:13.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.465+0000 7f545fa9d640 10 monclient: get_monmap_and_config 2026-02-24T19:24:13.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.465+0000 7f545fa9d640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.465+0000 7f545fa9d640 10 monclient: monmap: 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:13.466225+0000 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:13.466225+0000 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.469 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.465+0000 7f545fa9d640 1 Processor -- start 2026-02-24T19:24:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.465+0000 7f545fa9d640 1 -- start start 2026-02-24T19:24:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.465+0000 7f545fa9d640 10 monclient: init 2026-02-24T19:24:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 10 monclient(hunting): picked mon.noname-b con 0x7f545815b220 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 10 monclient(hunting): picked mon.noname-a con 0x7f5458059470 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 10 monclient(hunting): picked mon.noname-c con 0x7f5458055f60 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5458165110 con 0x7f5458059470 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54581653f0 con 0x7f545815b220 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5458161050 con 0x7f5458055f60 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545fa9d640 10 monclient(hunting): authenticate will time out at 4025.105436s 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545d011640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f5458059470 0x7f54581a5950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41430/0 (socket says 10.20.193.45:41430) 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.466+0000 7f545d011640 1 -- 10.20.193.45:0/15923404 learned_addr learned my addr 10.20.193.45:0/15923404 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722230229 0 0) 0x7f5458165110 con 0x7f5458059470 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): my global_id is 30795 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5440003610 con 0x7f5458059470 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292524315 0 0) 0x7f5458161050 con 0x7f5458055f60 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): my global_id is 26735 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5458165110 con 0x7f5458055f60 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641996825 0 0) 0x7f54581653f0 con 0x7f545815b220 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 10 monclient(hunting): my global_id is 28261 2026-02-24T19:24:13.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.468+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5458161050 con 0x7f545815b220 2026-02-24T19:24:13.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3970170755 0 0) 0x7f5440003610 con 0x7f5458059470 2026-02-24T19:24:13.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 >> v1:10.20.193.179:6789/0 conn(0x7f5458055f60 legacy=0x7f54581c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 >> v1:10.20.193.114:6789/0 conn(0x7f545815b220 legacy=0x7f5458058d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 1 monclient: found mon.noname-a 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.45:6789/0 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5458161330 con 0x7f5458059470 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f544c002df0 con 0x7f5458059470 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.469+0000 7f545c810640 10 monclient: dump: 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.481 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545fa9d640 5 monclient: authenticate success, global_id 30795 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545fa9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 <== mon.0 v1:10.20.193.45:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f544c002fc0 con 0x7f5458059470 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545c810640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545c810640 1 -- 10.20.193.45:0/15923404 <== mon.0 v1:10.20.193.45:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f544c003400 con 0x7f5458059470 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545c810640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545c810640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545c810640 10 monclient: dump: 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.482 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545fa9d640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.470+0000 7f545fa9d640 4 set_mon_vals no callback set 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.471+0000 7f545fa9d640 10 monclient: shutdown 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.471+0000 7f545fa9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:13.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.471+0000 7f545fa9d640 1 -- 10.20.193.45:0/15923404 >> v1:10.20.193.45:6789/0 conn(0x7f5458059470 legacy=0x7f54581a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.471+0000 7f545fa9d640 1 -- 10.20.193.45:0/15923404 shutdown_connections 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.471+0000 7f545fa9d640 1 -- 10.20.193.45:0/15923404 >> 10.20.193.45:0/15923404 conn(0x7f54580b4100 msgr2=0x7f54580b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.471+0000 7f545fa9d640 1 -- 10.20.193.45:0/15923404 shutdown_connections 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.471+0000 7f545fa9d640 1 -- 10.20.193.45:0/15923404 wait complete. 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.471+0000 7f545fa9d640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.471+0000 7f545fa9d640 10 monclient: monmap: 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.484 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 1 librados: starting msgr at 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 1 librados: starting objecter 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 1 Processor -- start 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 1 -- start start 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 1 librados: setting wanted keys 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 1 librados: calling monclient init 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 10 monclient: init 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 10 monclient(hunting): picked mon.noname-c con 0x7f5458055f60 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 10 monclient(hunting): picked mon.noname-a con 0x7f5458059470 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 10 monclient(hunting): picked mon.noname-b con 0x7f545815b220 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5458138c60 con 0x7f5458059470 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5458056bc0 con 0x7f545815b220 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5458058ee0 con 0x7f5458055f60 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545fa9d640 10 monclient(hunting): authenticate will time out at 4025.111616s 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545d011640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f5458059470 0x7f5458057940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41442/0 (socket says 10.20.193.45:41442) 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f545d011640 1 -- 10.20.193.45:0/2692533177 learned_addr learned my addr 10.20.193.45:0/2692533177 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.472+0000 7f54467fc640 10 client.?.objecter ms_handle_connect 0x7f5458059470 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.473+0000 7f54467fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.473+0000 7f54467fc640 10 client.?.objecter ms_handle_connect 0x7f545815b220 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.473+0000 7f54467fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.473+0000 7f54467fc640 10 client.?.objecter ms_handle_connect 0x7f5458055f60 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.473+0000 7f54467fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945125416 0 0) 0x7f5458056bc0 con 0x7f545815b220 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 10 monclient(hunting): my global_id is 28264 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5428003610 con 0x7f545815b220 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3800262275 0 0) 0x7f5458058ee0 con 0x7f5458055f60 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 10 monclient(hunting): my global_id is 26738 2026-02-24T19:24:13.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.474+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5458056bc0 con 0x7f5458055f60 2026-02-24T19:24:13.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.475+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3120180384 0 0) 0x7f5458161330 con 0x7f5458059470 2026-02-24T19:24:13.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.475+0000 7f54467fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.475+0000 7f54467fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.475+0000 7f54467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.475+0000 7f54467fc640 10 monclient(hunting): my global_id is 30798 2026-02-24T19:24:13.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.475+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5458058ee0 con 0x7f5458059470 2026-02-24T19:24:13.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.476+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3384632573 0 0) 0x7f5428003610 con 0x7f545815b220 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.476+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5458161330 con 0x7f545815b220 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.476+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f54540032f0 con 0x7f545815b220 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.476+0000 7f54467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.476+0000 7f54467fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.476+0000 7f54467fc640 10 monclient(hunting): dump: 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.491 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.476+0000 7f54467fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.477+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1015106160 0 0) 0x7f5458056bc0 con 0x7f5458055f60 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.477+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5428003610 con 0x7f5458055f60 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.477+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5448003060 con 0x7f5458055f60 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.477+0000 7f54467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.477+0000 7f54467fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.477+0000 7f54467fc640 10 monclient(hunting): dump: 2026-02-24T19:24:13.492 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3877647028 0 0) 0x7f5458161330 con 0x7f545815b220 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 >> v1:10.20.193.179:6789/0 conn(0x7f5458055f60 legacy=0x7f5458138550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 >> v1:10.20.193.45:6789/0 conn(0x7f5458059470 legacy=0x7f5458057940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 1 monclient: found mon.b 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5458058c00 con 0x7f545815b220 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f54467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 5 monclient: authenticate success, global_id 28264 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 10 monclient: _renew_subs 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5458056e60 con 0x7f545815b220 2026-02-24T19:24:13.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 10 client.28264.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 10 monclient: _renew_subs 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5458057420 con 0x7f545815b220 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 1 librados: init done 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 10 client.28264.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 15 client.28264.objecter _session_command_op_assign -1 1 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 20 client.28264.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 10 client.28264.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.478+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.114:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5458055260 con 0x7f545815b220 2026-02-24T19:24:13.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.488+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5458055260 con 0x7f545815b220 2026-02-24T19:24:13.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.488+0000 7f54467fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.488+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f5454003ab0 con 0x7f545815b220 2026-02-24T19:24:13.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.488+0000 7f54467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.488+0000 7f54467fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.488+0000 7f54467fc640 10 monclient: dump: 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.498 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.488+0000 7f5447fff640 4 set_mon_vals no callback set 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.488+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f545401c920 con 0x7f545815b220 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.489+0000 7f545d812640 10 monclient: get_auth_request con 0x7f5428077c80 auth_method 0 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.489+0000 7f54467fc640 10 client.28264.objecter ms_handle_connect 0x7f5428077c80 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f5454092160 con 0x7f545815b220 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 10 client.28264.objecter ms_dispatch2 0x7f5458000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 3 client.28264.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 3 client.28264.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 10 client.28264.objecter checking command 1 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 20 client.28264.objecter _get_session s=0x7f54280a1f50 osd=15 3 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 20 client.28264.objecter put_session s=0x7f54280a1f50 osd=15 3 2026-02-24T19:24:13.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 15 client.28264.objecter _session_command_op_remove -1 1 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 20 client.28264.objecter _get_session s=0x7f54280a1f50 osd=15 3 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 20 client.28264.objecter get_session s=0x7f54280a1f50 osd=15 3 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 15 client.28264.objecter _session_command_op_assign 15 1 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 20 client.28264.objecter put_session s=0x7f54280a1f50 osd=15 4 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 10 client.28264.objecter _send_command 1 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.194:6808/4057136445 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54280c4300 con 0x7f54280a2600 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 20 client.28264.objecter dump_active .. 0 homeless 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f545405c260 con 0x7f545815b220 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f54467fc640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.490+0000 7f545d011640 10 monclient: get_auth_request con 0x7f54280a2600 auth_method 0 2026-02-24T19:24:13.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.492+0000 7f54467fc640 10 client.28264.objecter ms_handle_connect 0x7f54280a2600 2026-02-24T19:24:13.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.502+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== osd.15 v1:10.20.193.194:6808/4057136445 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f54280c4300 con 0x7f54280a2600 2026-02-24T19:24:13.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.502+0000 7f54467fc640 10 client.28264.objecter ms_dispatch2 0x7f5458000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:13.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.502+0000 7f54467fc640 10 client.28264.objecter _finish_command 1 = system:0 2026-02-24T19:24:13.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.502+0000 7f54467fc640 20 client.28264.objecter put_session s=0x7f54280a1f50 osd=15 4 2026-02-24T19:24:13.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.502+0000 7f54467fc640 15 client.28264.objecter _session_command_op_remove 15 1 2026-02-24T19:24:13.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 10 client.28264.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:13.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 15 client.28264.objecter _session_command_op_assign -1 2 2026-02-24T19:24:13.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 20 client.28264.objecter _get_session s=0x7f54280a1f50 osd=15 3 2026-02-24T19:24:13.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 20 client.28264.objecter put_session s=0x7f54280a1f50 osd=15 3 2026-02-24T19:24:13.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 20 client.28264.objecter _get_session s=0x7f54280a1f50 osd=15 3 2026-02-24T19:24:13.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 15 client.28264.objecter _session_command_op_remove -1 2 2026-02-24T19:24:13.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 20 client.28264.objecter get_session s=0x7f54280a1f50 osd=15 3 2026-02-24T19:24:13.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 15 client.28264.objecter _session_command_op_assign 15 2 2026-02-24T19:24:13.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 20 client.28264.objecter put_session s=0x7f54280a1f50 osd=15 4 2026-02-24T19:24:13.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 10 client.28264.objecter _send_command 2 2026-02-24T19:24:13.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.509+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 --> v1:10.20.193.194:6808/4057136445 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54580b4ec0 con 0x7f54280a2600 2026-02-24T19:24:13.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.516+0000 7f54467fc640 1 -- 10.20.193.45:0/2692533177 <== osd.15 v1:10.20.193.194:6808/4057136445 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f54580b4ec0 con 0x7f54280a2600 2026-02-24T19:24:13.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.516+0000 7f54467fc640 10 client.28264.objecter ms_dispatch2 0x7f5458000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:13.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.516+0000 7f54467fc640 10 client.28264.objecter _finish_command 2 = system:0 2026-02-24T19:24:13.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.516+0000 7f54467fc640 20 client.28264.objecter put_session s=0x7f54280a1f50 osd=15 4 2026-02-24T19:24:13.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.516+0000 7f54467fc640 15 client.28264.objecter _session_command_op_remove 15 2 2026-02-24T19:24:13.521 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-24T19:24:13.521 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:13.521 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-24T19:24:13.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 10 librados: watch_flush enter 2026-02-24T19:24:13.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 10 librados: watch_flush exit 2026-02-24T19:24:13.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 10 client.28264.objecter close_session for osd.15 2026-02-24T19:24:13.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 >> v1:10.20.193.194:6808/4057136445 conn(0x7f54280a2600 legacy=0x7f54280c2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 20 client.28264.objecter put_session s=0x7f54280a1f50 osd=15 1 2026-02-24T19:24:13.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 20 client.28264.objecter shutdown clearing up homeless session... 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 10 client.28264.objecter successfully canceled tick 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 >> v1:10.20.193.45:6800/1599977652 conn(0x7f5428077c80 legacy=0x7f5428098130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 10 monclient: shutdown 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 >> v1:10.20.193.114:6789/0 conn(0x7f545815b220 legacy=0x7f54581fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545e013640 1 -- 10.20.193.45:0/2692533177 reap_dead start 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 shutdown_connections 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 >> 10.20.193.45:0/2692533177 conn(0x7f54580b4100 msgr2=0x7f5458160620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 shutdown_connections 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 1 -- 10.20.193.45:0/2692533177 wait complete. 2026-02-24T19:24:13.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.517+0000 7f545fa9d640 1 librados: shutdown 2026-02-24T19:24:13.529 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-24T19:24:13.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.593+0000 7fdb2b113640 10 monclient: get_monmap_and_config 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.593+0000 7fdb2b113640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.593+0000 7fdb2b113640 10 monclient: monmap: 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:13.594439+0000 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:13.594439+0000 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.597 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.598 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.593+0000 7fdb2b113640 1 Processor -- start 2026-02-24T19:24:13.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.593+0000 7fdb2b113640 1 -- start start 2026-02-24T19:24:13.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.593+0000 7fdb2b113640 10 monclient: init 2026-02-24T19:24:13.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:13.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 10 monclient(hunting): picked mon.noname-a con 0x7fdb241566e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 10 monclient(hunting): picked mon.noname-c con 0x7fdb24160c00 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 10 monclient(hunting): picked mon.noname-b con 0x7fdb24156ab0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb24058480 con 0x7fdb241566e0 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb24058760 con 0x7fdb24156ab0 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb240b0f90 con 0x7fdb24160c00 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb2b113640 10 monclient(hunting): authenticate will time out at 4025.233442s 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb28e88640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fdb241566e0 0x7fdb240b4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41452/0 (socket says 10.20.193.45:41452) 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.594+0000 7fdb28e88640 1 -- 10.20.193.45:0/2627693013 learned_addr learned my addr 10.20.193.45:0/2627693013 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4254751188 0 0) 0x7fdb24058760 con 0x7fdb24156ab0 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): my global_id is 28267 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb10003610 con 0x7fdb24156ab0 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1667630062 0 0) 0x7fdb240b0f90 con 0x7fdb24160c00 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): my global_id is 26741 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb24058760 con 0x7fdb24160c00 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419227296 0 0) 0x7fdb24058480 con 0x7fdb241566e0 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 10 monclient(hunting): my global_id is 30801 2026-02-24T19:24:13.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.596+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb240b0f90 con 0x7fdb241566e0 2026-02-24T19:24:13.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 758323854 0 0) 0x7fdb10003610 con 0x7fdb24156ab0 2026-02-24T19:24:13.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 >> v1:10.20.193.179:6789/0 conn(0x7fdb24160c00 legacy=0x7fdb24057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 >> v1:10.20.193.45:6789/0 conn(0x7fdb241566e0 legacy=0x7fdb240b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 1 monclient: found mon.noname-b 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb240b1270 con 0x7fdb24156ab0 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdb20003170 con 0x7fdb24156ab0 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:13.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb1b7fe640 10 monclient: dump: 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb2b113640 5 monclient: authenticate success, global_id 28267 2026-02-24T19:24:13.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.597+0000 7fdb2b113640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.598+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 <== mon.1 v1:10.20.193.114:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb20003340 con 0x7fdb24156ab0 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.598+0000 7fdb1b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.598+0000 7fdb1b7fe640 1 -- 10.20.193.45:0/2627693013 <== mon.1 v1:10.20.193.114:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdb20003780 con 0x7fdb24156ab0 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.598+0000 7fdb1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.598+0000 7fdb1b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.598+0000 7fdb1b7fe640 10 monclient: dump: 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.611 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.598+0000 7fdb2b113640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.598+0000 7fdb2b113640 4 set_mon_vals no callback set 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 10 monclient: shutdown 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 1 -- 10.20.193.45:0/2627693013 >> v1:10.20.193.114:6789/0 conn(0x7fdb24156ab0 legacy=0x7fdb24055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 1 -- 10.20.193.45:0/2627693013 shutdown_connections 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 1 -- 10.20.193.45:0/2627693013 >> 10.20.193.45:0/2627693013 conn(0x7fdb240b2ef0 msgr2=0x7fdb240b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 1 -- 10.20.193.45:0/2627693013 shutdown_connections 2026-02-24T19:24:13.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 1 -- 10.20.193.45:0/2627693013 wait complete. 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 10 monclient: monmap: 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 1 librados: starting msgr at 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 1 librados: starting objecter 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.599+0000 7fdb2b113640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 1 Processor -- start 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 1 -- start start 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 1 librados: setting wanted keys 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 1 librados: calling monclient init 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 10 monclient: init 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 10 monclient(hunting): picked mon.noname-c con 0x7fdb241566e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 10 monclient(hunting): picked mon.noname-a con 0x7fdb24156ab0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 10 monclient(hunting): picked mon.noname-b con 0x7fdb24160c00 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb240b0020 con 0x7fdb24156ab0 2026-02-24T19:24:13.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb240aeca0 con 0x7fdb24160c00 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb240aef80 con 0x7fdb241566e0 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb2b113640 10 monclient(hunting): authenticate will time out at 4025.239416s 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb1bfff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fdb24156ab0 0x7fdb240a40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41458/0 (socket says 10.20.193.45:41458) 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb1bfff640 1 -- 10.20.193.45:0/2446044271 learned_addr learned my addr 10.20.193.45:0/2446044271 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb197fa640 10 client.?.objecter ms_handle_connect 0x7fdb24156ab0 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb197fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb197fa640 10 client.?.objecter ms_handle_connect 0x7fdb24160c00 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb197fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb197fa640 10 client.?.objecter ms_handle_connect 0x7fdb241566e0 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.600+0000 7fdb197fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980138572 0 0) 0x7fdb240aeca0 con 0x7fdb24160c00 2026-02-24T19:24:13.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): my global_id is 28270 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaf4003610 con 0x7fdb24160c00 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233414602 0 0) 0x7fdb240b0020 con 0x7fdb24156ab0 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): my global_id is 30804 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb240aeca0 con 0x7fdb24156ab0 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653229028 0 0) 0x7fdb240aef80 con 0x7fdb241566e0 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 10 monclient(hunting): my global_id is 26744 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.601+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb240b0020 con 0x7fdb241566e0 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 217437801 0 0) 0x7fdaf4003610 con 0x7fdb24160c00 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb240aef80 con 0x7fdb24160c00 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdb200034f0 con 0x7fdb24160c00 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): dump: 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.617 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 434648454 0 0) 0x7fdb240b0020 con 0x7fdb241566e0 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdaf4003610 con 0x7fdb241566e0 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdb14003060 con 0x7fdb241566e0 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): dump: 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2536879327 0 0) 0x7fdb240aeca0 con 0x7fdb24156ab0 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb240b0020 con 0x7fdb24156ab0 2026-02-24T19:24:13.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdb0c0030a0 con 0x7fdb24156ab0 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.604+0000 7fdb197fa640 10 monclient(hunting): dump: 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.620 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 191068754 0 0) 0x7fdb240aef80 con 0x7fdb24160c00 2026-02-24T19:24:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 >> v1:10.20.193.179:6789/0 conn(0x7fdb241566e0 legacy=0x7fdb24128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 >> v1:10.20.193.45:6789/0 conn(0x7fdb24156ab0 legacy=0x7fdb240a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 1 monclient: found mon.b 2026-02-24T19:24:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb240af260 con 0x7fdb24160c00 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb2b113640 5 monclient: authenticate success, global_id 28270 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb2b113640 10 monclient: _renew_subs 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb2b113640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb240af540 con 0x7fdb24160c00 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb2b113640 10 client.28270.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb2b113640 10 monclient: _renew_subs 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb2b113640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb240afb00 con 0x7fdb24160c00 2026-02-24T19:24:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.605+0000 7fdb2b113640 1 librados: init done 2026-02-24T19:24:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.606+0000 7fdb2b113640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.606+0000 7fdb2b113640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.606+0000 7fdb2b113640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.606+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb241289a0 con 0x7fdb24160c00 2026-02-24T19:24:13.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.705+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb200032f0 con 0x7fdb24160c00 2026-02-24T19:24:13.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.705+0000 7fdb197fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.705+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fdb20003e80 con 0x7fdb24160c00 2026-02-24T19:24:13.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.705+0000 7fdb197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.705+0000 7fdb197fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:13.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.705+0000 7fdb197fa640 10 monclient: dump: 2026-02-24T19:24:13.709 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.705+0000 7fdb1affd640 4 set_mon_vals no callback set 2026-02-24T19:24:13.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.706+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fdb2001ccf0 con 0x7fdb24160c00 2026-02-24T19:24:13.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.707+0000 7fdb28e88640 10 monclient: get_auth_request con 0x7fdaf4077d80 auth_method 0 2026-02-24T19:24:13.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.707+0000 7fdb197fa640 10 client.28270.objecter ms_handle_connect 0x7fdaf4077d80 2026-02-24T19:24:13.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.708+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fdb20092160 con 0x7fdb24160c00 2026-02-24T19:24:13.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.708+0000 7fdb197fa640 10 client.28270.objecter ms_dispatch2 0x7fdb24000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:13.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.708+0000 7fdb197fa640 3 client.28270.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:13.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.708+0000 7fdb197fa640 3 client.28270.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:13.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.708+0000 7fdb197fa640 20 client.28270.objecter dump_active .. 0 homeless 2026-02-24T19:24:13.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.710+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fdb2005cb90 con 0x7fdb24160c00 2026-02-24T19:24:13.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.710+0000 7fdb197fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.710+0000 7fdb197fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:13.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.815+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7fdb2415a520 con 0x7fdaf4077d80 2026-02-24T19:24:13.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.815+0000 7fdb197fa640 1 -- 10.20.193.45:0/2446044271 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (unknown 337234985 0 0) 0x7fdb2415a520 con 0x7fdaf4077d80 2026-02-24T19:24:13.819 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 15 to deep-scrub 2026-02-24T19:24:13.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 10 librados: watch_flush enter 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 10 librados: watch_flush exit 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 20 client.28270.objecter shutdown clearing up homeless session... 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 10 client.28270.objecter successfully canceled tick 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 >> v1:10.20.193.45:6800/1599977652 conn(0x7fdaf4077d80 legacy=0x7fdaf4098230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 10 monclient: shutdown 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 >> v1:10.20.193.114:6789/0 conn(0x7fdb24160c00 legacy=0x7fdb2412a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 shutdown_connections 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 >> 10.20.193.45:0/2446044271 conn(0x7fdb240b2ef0 msgr2=0x7fdb24155c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 shutdown_connections 2026-02-24T19:24:13.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.816+0000 7fdb2b113640 1 -- 10.20.193.45:0/2446044271 wait complete. 2026-02-24T19:24:13.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.817+0000 7fdb2b113640 1 librados: shutdown 2026-02-24T19:24:13.828 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:13.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.892+0000 7f13db309640 10 monclient: get_monmap_and_config 2026-02-24T19:24:13.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.892+0000 7f13db309640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.892+0000 7f13db309640 10 monclient: monmap: 2026-02-24T19:24:13.896 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.896 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.896 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:13.893739+0000 2026-02-24T19:24:13.896 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:13.893739+0000 2026-02-24T19:24:13.896 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.896 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.897 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.897 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.897 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.897 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 1 Processor -- start 2026-02-24T19:24:13.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 1 -- start start 2026-02-24T19:24:13.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 10 monclient: init 2026-02-24T19:24:13.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 10 monclient(hunting): picked mon.noname-b con 0x7f13d415afb0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 10 monclient(hunting): picked mon.noname-a con 0x7f13d40a9e80 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 10 monclient(hunting): picked mon.noname-c con 0x7f13d4164a50 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d40b0e70 con 0x7f13d40a9e80 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d40b1150 con 0x7f13d415afb0 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d40b1430 con 0x7f13d4164a50 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.893+0000 7f13db309640 10 monclient(hunting): authenticate will time out at 4025.532750s 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.894+0000 7f13dab08640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f13d4164a50 0x7f13d40ac300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:53326/0 (socket says 10.20.193.45:53326) 2026-02-24T19:24:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.894+0000 7f13dab08640 1 -- 10.20.193.45:0/3517368188 learned_addr learned my addr 10.20.193.45:0/3517368188 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1930577105 0 0) 0x7f13d40b1430 con 0x7f13d4164a50 2026-02-24T19:24:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 10 monclient(hunting): my global_id is 26747 2026-02-24T19:24:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13bc003610 con 0x7f13d4164a50 2026-02-24T19:24:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065222187 0 0) 0x7f13d40b1150 con 0x7f13d415afb0 2026-02-24T19:24:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 10 monclient(hunting): my global_id is 28273 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.895+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d40b1430 con 0x7f13d415afb0 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.896+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565153718 0 0) 0x7f13d40b0e70 con 0x7f13d40a9e80 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.896+0000 7f13d9305640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.896+0000 7f13d9305640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.896+0000 7f13d9305640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.896+0000 7f13d9305640 10 monclient(hunting): my global_id is 30807 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.896+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d40b1150 con 0x7f13d40a9e80 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 537489696 0 0) 0x7f13bc003610 con 0x7f13d4164a50 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 >> v1:10.20.193.114:6789/0 conn(0x7f13d415afb0 legacy=0x7f13d40b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 >> v1:10.20.193.45:6789/0 conn(0x7f13d40a9e80 legacy=0x7f13d4164340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 1 monclient: found mon.noname-c 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d40b1710 con 0x7f13d4164a50 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13d0003170 con 0x7f13d4164a50 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13d9305640 10 monclient: dump: 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13db309640 5 monclient: authenticate success, global_id 26747 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.897+0000 7f13db309640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13d00033b0 con 0x7f13d4164a50 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13d9305640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13d9305640 1 -- 10.20.193.45:0/3517368188 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13d00037f0 con 0x7f13d4164a50 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13d9305640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13d9305640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13d9305640 10 monclient: dump: 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.908 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 4 set_mon_vals no callback set 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 10 monclient: shutdown 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 1 -- 10.20.193.45:0/3517368188 >> v1:10.20.193.179:6789/0 conn(0x7f13d4164a50 legacy=0x7f13d40ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 1 -- 10.20.193.45:0/3517368188 shutdown_connections 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 1 -- 10.20.193.45:0/3517368188 >> 10.20.193.45:0/3517368188 conn(0x7f13d40b42c0 msgr2=0x7f13d40b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 1 -- 10.20.193.45:0/3517368188 shutdown_connections 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 1 -- 10.20.193.45:0/3517368188 wait complete. 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 10 monclient: build_initial_monmap 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.898+0000 7f13db309640 10 monclient: monmap: 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:13.910 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 1 librados: starting msgr at 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 1 librados: starting objecter 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 1 Processor -- start 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 1 -- start start 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 1 librados: setting wanted keys 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 1 librados: calling monclient init 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 10 monclient: init 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 10 monclient(hunting): picked mon.noname-b con 0x7f13d40a9e80 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 10 monclient(hunting): picked mon.noname-c con 0x7f13d415afb0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 10 monclient(hunting): picked mon.noname-a con 0x7f13d4164a50 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d405c300 con 0x7f13d4164a50 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d40af530 con 0x7f13d40a9e80 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d405b780 con 0x7f13d415afb0 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13db309640 10 monclient(hunting): authenticate will time out at 4025.538708s 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13dab08640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f13d4164a50 0x7f13d4156c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41480/0 (socket says 10.20.193.45:41480) 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.899+0000 7f13dab08640 1 -- 10.20.193.45:0/3201251520 learned_addr learned my addr 10.20.193.45:0/3201251520 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.900+0000 7f13baffd640 10 client.?.objecter ms_handle_connect 0x7f13d4164a50 2026-02-24T19:24:13.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.900+0000 7f13baffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.900+0000 7f13baffd640 10 client.?.objecter ms_handle_connect 0x7f13d40a9e80 2026-02-24T19:24:13.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.900+0000 7f13baffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.900+0000 7f13baffd640 10 client.?.objecter ms_handle_connect 0x7f13d415afb0 2026-02-24T19:24:13.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.900+0000 7f13baffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:13.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537012754 0 0) 0x7f13d405c300 con 0x7f13d4164a50 2026-02-24T19:24:13.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): my global_id is 30810 2026-02-24T19:24:13.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13a4003610 con 0x7f13d4164a50 2026-02-24T19:24:13.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727022822 0 0) 0x7f13d40af530 con 0x7f13d40a9e80 2026-02-24T19:24:13.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): my global_id is 28276 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d405c300 con 0x7f13d40a9e80 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523720799 0 0) 0x7f13d405b780 con 0x7f13d415afb0 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 10 monclient(hunting): my global_id is 26750 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.901+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d40af530 con 0x7f13d415afb0 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 903835925 0 0) 0x7f13d405c300 con 0x7f13d40a9e80 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13d405b780 con 0x7f13d40a9e80 2026-02-24T19:24:13.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13c40030b0 con 0x7f13d40a9e80 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 10 monclient(hunting): dump: 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.919 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 442273989 0 0) 0x7f13a4003610 con 0x7f13d4164a50 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13d405c300 con 0x7f13d4164a50 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13d0003700 con 0x7f13d4164a50 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.903+0000 7f13baffd640 10 monclient(hunting): dump: 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.920 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.904+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3680031721 0 0) 0x7f13d40af530 con 0x7f13d415afb0 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.904+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13a4003610 con 0x7f13d415afb0 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.904+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13c8003060 con 0x7f13d415afb0 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.904+0000 7f13baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.904+0000 7f13baffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.904+0000 7f13baffd640 10 monclient(hunting): dump: 2026-02-24T19:24:13.921 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.1 v1:10.20.193.114:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1321216859 0 0) 0x7f13d405b780 con 0x7f13d40a9e80 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 >> v1:10.20.193.179:6789/0 conn(0x7f13d415afb0 legacy=0x7f13d415bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 >> v1:10.20.193.45:6789/0 conn(0x7f13d4164a50 legacy=0x7f13d4156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:13.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 1 monclient: found mon.b 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d405ba60 con 0x7f13d40a9e80 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 5 monclient: authenticate success, global_id 28276 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 10 monclient: _renew_subs 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.114:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13d405bd40 con 0x7f13d40a9e80 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 10 client.28276.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 10 monclient: _renew_subs 2026-02-24T19:24:13.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.114:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f13d415b770 con 0x7f13d40a9e80 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 1 librados: init done 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.114:6789/0 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.905+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.114:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d40b50d0 con 0x7f13d40a9e80 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.912+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.1 v1:10.20.193.114:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13c40036b0 con 0x7f13d40a9e80 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.912+0000 7f13baffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.912+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.1 v1:10.20.193.114:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f13c4003a00 con 0x7f13d40a9e80 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.912+0000 7f13baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.912+0000 7f13baffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:13.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.912+0000 7f13baffd640 10 monclient: dump: 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.912+0000 7f13d8b04640 4 set_mon_vals no callback set 2026-02-24T19:24:13.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.913+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.1 v1:10.20.193.114:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f13c401c870 con 0x7f13d40a9e80 2026-02-24T19:24:13.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.914+0000 7f13d9b06640 10 monclient: get_auth_request con 0x7f13a4077e60 auth_method 0 2026-02-24T19:24:13.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.914+0000 7f13baffd640 10 client.28276.objecter ms_handle_connect 0x7f13a4077e60 2026-02-24T19:24:13.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.914+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.1 v1:10.20.193.114:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f13c4091f70 con 0x7f13d40a9e80 2026-02-24T19:24:13.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.914+0000 7f13baffd640 10 client.28276.objecter ms_dispatch2 0x7f13d4000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:13.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.914+0000 7f13baffd640 3 client.28276.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:13.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.914+0000 7f13baffd640 3 client.28276.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:13.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.914+0000 7f13baffd640 20 client.28276.objecter dump_active .. 0 homeless 2026-02-24T19:24:14.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.998+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mon.1 v1:10.20.193.114:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f13c405c9a0 con 0x7f13d40a9e80 2026-02-24T19:24:14.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.998+0000 7f13baffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:14.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:13.998+0000 7f13baffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:14.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.100+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13d40b4df0 con 0x7f13a4077e60 2026-02-24T19:24:14.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.101+0000 7f13baffd640 1 -- 10.20.193.45:0/3201251520 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125359 (unknown 2965378022 0 202839094) 0x7f13d40b4df0 con 0x7f13a4077e60 2026-02-24T19:24:14.106 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:24:14.107 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-24T19:24:14.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 10 librados: watch_flush enter 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 10 librados: watch_flush exit 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 20 client.28276.objecter shutdown clearing up homeless session... 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 10 client.28276.objecter successfully canceled tick 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 >> v1:10.20.193.45:6800/1599977652 conn(0x7f13a4077e60 legacy=0x7f13a4098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 10 monclient: shutdown 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 >> v1:10.20.193.114:6789/0 conn(0x7f13d40a9e80 legacy=0x7f13d40aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 shutdown_connections 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 >> 10.20.193.45:0/3201251520 conn(0x7f13d40b42c0 msgr2=0x7f13d4139a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 shutdown_connections 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 1 -- 10.20.193.45:0/3201251520 wait complete. 2026-02-24T19:24:14.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:14.103+0000 7f13db309640 1 librados: shutdown 2026-02-24T19:24:14.115 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2026-02-24T19:24:13.717806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":541916,"kb_used_data":110556,"kb_used_omap":25382,"kb_used_meta":405721,"kb_avail":1509407524,"statfs":{"total":1546188226560,"available":1545633304576,"internally_reserved":0,"allocated":113209344,"data_stored":69905440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25991197,"internal_metadata":415459299},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":77,"apply_latency_ms":77,"commit_latency_ns":77000000,"apply_latency_ns":77000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001482"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:09.620387+0000","last_change":"2026-02-24T19:24:09.620387+0000","last_active":"2026-02-24T19:24:09.620387+0000","last_peered":"2026-02-24T19:24:09.620387+0000","last_clean":"2026-02-24T19:24:09.620387+0000","last_became_active":"2026-02-24T19:18:30.038497+0000","last_became_peered":"2026-02-24T19:18:30.038497+0000","last_unstale":"2026-02-24T19:24:09.620387+0000","last_undegraded":"2026-02-24T19:24:09.620387+0000","last_fullsized":"2026-02-24T19:24:09.620387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:09.618429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:09.618429+0000","last_clean_scrub_stamp":"2026-02-24T19:24:09.618429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:52:29.670810+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":629,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.118328+0000","last_change":"2026-02-24T19:18:28.471116+0000","last_active":"2026-02-24T19:24:04.118328+0000","last_peered":"2026-02-24T19:24:04.118328+0000","last_clean":"2026-02-24T19:24:04.118328+0000","last_became_active":"2026-02-24T19:18:28.441755+0000","last_became_peered":"2026-02-24T19:18:28.441755+0000","last_unstale":"2026-02-24T19:24:04.118328+0000","last_undegraded":"2026-02-24T19:24:04.118328+0000","last_fullsized":"2026-02-24T19:24:04.118328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:31:02.204366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.105542+0000","last_change":"2026-02-24T19:18:28.672244+0000","last_active":"2026-02-24T19:24:04.105542+0000","last_peered":"2026-02-24T19:24:04.105542+0000","last_clean":"2026-02-24T19:24:04.105542+0000","last_became_active":"2026-02-24T19:18:28.670036+0000","last_became_peered":"2026-02-24T19:18:28.670036+0000","last_unstale":"2026-02-24T19:24:04.105542+0000","last_undegraded":"2026-02-24T19:24:04.105542+0000","last_fullsized":"2026-02-24T19:24:04.105542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:13:54.603079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:08.585011+0000","last_change":"2026-02-24T19:24:08.585011+0000","last_active":"2026-02-24T19:24:08.585011+0000","last_peered":"2026-02-24T19:24:08.585011+0000","last_clean":"2026-02-24T19:24:08.585011+0000","last_became_active":"2026-02-24T19:18:29.297442+0000","last_became_peered":"2026-02-24T19:18:29.297442+0000","last_unstale":"2026-02-24T19:24:08.585011+0000","last_undegraded":"2026-02-24T19:24:08.585011+0000","last_fullsized":"2026-02-24T19:24:08.585011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:08.583259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:08.583259+0000","last_clean_scrub_stamp":"2026-02-24T19:24:08.583259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:39:45.866441+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.288203+0000","last_change":"2026-02-24T19:18:29.545106+0000","last_active":"2026-02-24T19:24:04.288203+0000","last_peered":"2026-02-24T19:24:04.288203+0000","last_clean":"2026-02-24T19:24:04.288203+0000","last_became_active":"2026-02-24T19:18:29.539772+0000","last_became_peered":"2026-02-24T19:18:29.539772+0000","last_unstale":"2026-02-24T19:24:04.288203+0000","last_undegraded":"2026-02-24T19:24:04.288203+0000","last_fullsized":"2026-02-24T19:24:04.288203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:13:08.139044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":625,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:05.130946+0000","last_change":"2026-02-24T19:18:28.594138+0000","last_active":"2026-02-24T19:24:05.130946+0000","last_peered":"2026-02-24T19:24:05.130946+0000","last_clean":"2026-02-24T19:24:05.130946+0000","last_became_active":"2026-02-24T19:18:28.575721+0000","last_became_peered":"2026-02-24T19:18:28.575721+0000","last_unstale":"2026-02-24T19:24:05.130946+0000","last_undegraded":"2026-02-24T19:24:05.130946+0000","last_fullsized":"2026-02-24T19:24:05.130946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:15:36.359081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.345823+0000","last_change":"2026-02-24T19:18:28.208160+0000","last_active":"2026-02-24T19:24:04.345823+0000","last_peered":"2026-02-24T19:24:04.345823+0000","last_clean":"2026-02-24T19:24:04.345823+0000","last_became_active":"2026-02-24T19:18:28.189388+0000","last_became_peered":"2026-02-24T19:18:28.189388+0000","last_unstale":"2026-02-24T19:24:04.345823+0000","last_undegraded":"2026-02-24T19:24:04.345823+0000","last_fullsized":"2026-02-24T19:24:04.345823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:38:11.940782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":625,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.267535+0000","last_change":"2026-02-24T19:18:30.249532+0000","last_active":"2026-02-24T19:24:04.267535+0000","last_peered":"2026-02-24T19:24:04.267535+0000","last_clean":"2026-02-24T19:24:04.267535+0000","last_became_active":"2026-02-24T19:18:30.247456+0000","last_became_peered":"2026-02-24T19:18:30.247456+0000","last_unstale":"2026-02-24T19:24:04.267535+0000","last_undegraded":"2026-02-24T19:24:04.267535+0000","last_fullsized":"2026-02-24T19:24:04.267535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:38:54.762951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.132303+0000","last_change":"2026-02-24T19:18:29.118353+0000","last_active":"2026-02-24T19:24:04.132303+0000","last_peered":"2026-02-24T19:24:04.132303+0000","last_clean":"2026-02-24T19:24:04.132303+0000","last_became_active":"2026-02-24T19:18:29.115400+0000","last_became_peered":"2026-02-24T19:18:29.115400+0000","last_unstale":"2026-02-24T19:24:04.132303+0000","last_undegraded":"2026-02-24T19:24:04.132303+0000","last_fullsized":"2026-02-24T19:24:04.132303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:24:41.375916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.357384+0000","last_change":"2026-02-24T19:18:28.592539+0000","last_active":"2026-02-24T19:24:04.357384+0000","last_peered":"2026-02-24T19:24:04.357384+0000","last_clean":"2026-02-24T19:24:04.357384+0000","last_became_active":"2026-02-24T19:18:28.565625+0000","last_became_peered":"2026-02-24T19:18:28.565625+0000","last_unstale":"2026-02-24T19:24:04.357384+0000","last_undegraded":"2026-02-24T19:24:04.357384+0000","last_fullsized":"2026-02-24T19:24:04.357384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:42:03.341148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:07.423461+0000","last_change":"2026-02-24T19:24:07.423461+0000","last_active":"2026-02-24T19:24:07.423461+0000","last_peered":"2026-02-24T19:24:07.423461+0000","last_clean":"2026-02-24T19:24:07.423461+0000","last_became_active":"2026-02-24T19:18:28.626150+0000","last_became_peered":"2026-02-24T19:18:28.626150+0000","last_unstale":"2026-02-24T19:24:07.423461+0000","last_undegraded":"2026-02-24T19:24:07.423461+0000","last_fullsized":"2026-02-24T19:24:07.423461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:07.418632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:07.418632+0000","last_clean_scrub_stamp":"2026-02-24T19:24:07.418632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:24:45.639416+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.309472+0000","last_change":"2026-02-24T19:18:30.388644+0000","last_active":"2026-02-24T19:24:04.309472+0000","last_peered":"2026-02-24T19:24:04.309472+0000","last_clean":"2026-02-24T19:24:04.309472+0000","last_became_active":"2026-02-24T19:18:30.386561+0000","last_became_peered":"2026-02-24T19:18:30.386561+0000","last_unstale":"2026-02-24T19:24:04.309472+0000","last_undegraded":"2026-02-24T19:24:04.309472+0000","last_fullsized":"2026-02-24T19:24:04.309472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:24:18.512374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"25'32","reported_seq":686,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:05.130134+0000","last_change":"2026-02-24T19:17:41.855813+0000","last_active":"2026-02-24T19:24:05.130134+0000","last_peered":"2026-02-24T19:24:05.130134+0000","last_clean":"2026-02-24T19:24:05.130134+0000","last_became_active":"2026-02-24T19:17:41.834152+0000","last_became_peered":"2026-02-24T19:17:41.834152+0000","last_unstale":"2026-02-24T19:24:05.130134+0000","last_undegraded":"2026-02-24T19:24:05.130134+0000","last_fullsized":"2026-02-24T19:24:05.130134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:39.980633+0000","last_clean_scrub_stamp":"2026-02-24T19:17:39.980633+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:41:22.029311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":646,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.120662+0000","last_change":"2026-02-24T19:17:51.734383+0000","last_active":"2026-02-24T19:24:04.120662+0000","last_peered":"2026-02-24T19:24:04.120662+0000","last_clean":"2026-02-24T19:24:04.120662+0000","last_became_active":"2026-02-24T19:17:49.844588+0000","last_became_peered":"2026-02-24T19:17:49.844588+0000","last_unstale":"2026-02-24T19:24:04.120662+0000","last_undegraded":"2026-02-24T19:24:04.120662+0000","last_fullsized":"2026-02-24T19:24:04.120662+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:26:51.919573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039325629000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":625,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:05.167270+0000","last_change":"2026-02-24T19:18:28.881103+0000","last_active":"2026-02-24T19:24:05.167270+0000","last_peered":"2026-02-24T19:24:05.167270+0000","last_clean":"2026-02-24T19:24:05.167270+0000","last_became_active":"2026-02-24T19:18:28.879013+0000","last_became_peered":"2026-02-24T19:18:28.879013+0000","last_unstale":"2026-02-24T19:24:05.167270+0000","last_undegraded":"2026-02-24T19:24:05.167270+0000","last_fullsized":"2026-02-24T19:24:05.167270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:34:10.611706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":651,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:08.474800+0000","last_change":"2026-02-24T19:24:08.474800+0000","last_active":"2026-02-24T19:24:08.474800+0000","last_peered":"2026-02-24T19:24:08.474800+0000","last_clean":"2026-02-24T19:24:08.474800+0000","last_became_active":"2026-02-24T19:17:49.829989+0000","last_became_peered":"2026-02-24T19:17:49.829989+0000","last_unstale":"2026-02-24T19:24:08.474800+0000","last_undegraded":"2026-02-24T19:24:08.474800+0000","last_fullsized":"2026-02-24T19:24:08.474800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:08.469843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:08.469843+0000","last_clean_scrub_stamp":"2026-02-24T19:24:08.469843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:53:41.316225+0000","scrub_duration":117,"objects_trimmed":0,"snaptrim_duration":0.032260351999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":629,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.139688+0000","last_change":"2026-02-24T19:18:28.728380+0000","last_active":"2026-02-24T19:24:04.139688+0000","last_peered":"2026-02-24T19:24:04.139688+0000","last_clean":"2026-02-24T19:24:04.139688+0000","last_became_active":"2026-02-24T19:18:28.725927+0000","last_became_peered":"2026-02-24T19:18:28.725927+0000","last_unstale":"2026-02-24T19:24:04.139688+0000","last_undegraded":"2026-02-24T19:24:04.139688+0000","last_fullsized":"2026-02-24T19:24:04.139688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:22:34.338905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":642,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.748084+0000","last_change":"2026-02-24T19:17:51.909002+0000","last_active":"2026-02-24T19:24:04.748084+0000","last_peered":"2026-02-24T19:24:04.748084+0000","last_clean":"2026-02-24T19:24:04.748084+0000","last_became_active":"2026-02-24T19:17:50.962180+0000","last_became_peered":"2026-02-24T19:17:50.962180+0000","last_unstale":"2026-02-24T19:24:04.748084+0000","last_undegraded":"2026-02-24T19:24:04.748084+0000","last_fullsized":"2026-02-24T19:24:04.748084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:55:24.848537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034127616999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,14],"acting":[6,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":625,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:05.172786+0000","last_change":"2026-02-24T19:18:29.244450+0000","last_active":"2026-02-24T19:24:05.172786+0000","last_peered":"2026-02-24T19:24:05.172786+0000","last_clean":"2026-02-24T19:24:05.172786+0000","last_became_active":"2026-02-24T19:18:29.241947+0000","last_became_peered":"2026-02-24T19:18:29.241947+0000","last_unstale":"2026-02-24T19:24:05.172786+0000","last_undegraded":"2026-02-24T19:24:05.172786+0000","last_fullsized":"2026-02-24T19:24:05.172786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:17:14.369011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":647,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.108085+0000","last_change":"2026-02-24T19:17:51.726046+0000","last_active":"2026-02-24T19:24:04.108085+0000","last_peered":"2026-02-24T19:24:04.108085+0000","last_clean":"2026-02-24T19:24:04.108085+0000","last_became_active":"2026-02-24T19:17:49.831395+0000","last_became_peered":"2026-02-24T19:17:49.831395+0000","last_unstale":"2026-02-24T19:24:04.108085+0000","last_undegraded":"2026-02-24T19:24:04.108085+0000","last_fullsized":"2026-02-24T19:24:04.108085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:45:35.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.057363406999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.133230+0000","last_change":"2026-02-24T19:18:29.174512+0000","last_active":"2026-02-24T19:24:04.133230+0000","last_peered":"2026-02-24T19:24:04.133230+0000","last_clean":"2026-02-24T19:24:04.133230+0000","last_became_active":"2026-02-24T19:18:29.172298+0000","last_became_peered":"2026-02-24T19:18:29.172298+0000","last_unstale":"2026-02-24T19:24:04.133230+0000","last_undegraded":"2026-02-24T19:24:04.133230+0000","last_fullsized":"2026-02-24T19:24:04.133230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:53:31.634265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15],"acting":[8,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":647,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.126316+0000","last_change":"2026-02-24T19:17:51.889910+0000","last_active":"2026-02-24T19:24:04.126316+0000","last_peered":"2026-02-24T19:24:04.126316+0000","last_clean":"2026-02-24T19:24:04.126316+0000","last_became_active":"2026-02-24T19:17:49.867737+0000","last_became_peered":"2026-02-24T19:17:49.867737+0000","last_unstale":"2026-02-24T19:24:04.126316+0000","last_undegraded":"2026-02-24T19:24:04.126316+0000","last_fullsized":"2026-02-24T19:24:04.126316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:43:43.357779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041050483999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.113636+0000","last_change":"2026-02-24T19:18:29.018360+0000","last_active":"2026-02-24T19:24:04.113636+0000","last_peered":"2026-02-24T19:24:04.113636+0000","last_clean":"2026-02-24T19:24:04.113636+0000","last_became_active":"2026-02-24T19:18:29.015809+0000","last_became_peered":"2026-02-24T19:18:29.015809+0000","last_unstale":"2026-02-24T19:24:04.113636+0000","last_undegraded":"2026-02-24T19:24:04.113636+0000","last_fullsized":"2026-02-24T19:24:04.113636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:52:29.814745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9],"acting":[15,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":647,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.128547+0000","last_change":"2026-02-24T19:17:51.895025+0000","last_active":"2026-02-24T19:24:04.128547+0000","last_peered":"2026-02-24T19:24:04.128547+0000","last_clean":"2026-02-24T19:24:04.128547+0000","last_became_active":"2026-02-24T19:17:49.822380+0000","last_became_peered":"2026-02-24T19:17:49.822380+0000","last_unstale":"2026-02-24T19:24:04.128547+0000","last_undegraded":"2026-02-24T19:24:04.128547+0000","last_fullsized":"2026-02-24T19:24:04.128547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:22:04.516051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031009920999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":625,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:05.141971+0000","last_change":"2026-02-24T19:18:28.599982+0000","last_active":"2026-02-24T19:24:05.141971+0000","last_peered":"2026-02-24T19:24:05.141971+0000","last_clean":"2026-02-24T19:24:05.141971+0000","last_became_active":"2026-02-24T19:18:28.578714+0000","last_became_peered":"2026-02-24T19:18:28.578714+0000","last_unstale":"2026-02-24T19:24:05.141971+0000","last_undegraded":"2026-02-24T19:24:05.141971+0000","last_fullsized":"2026-02-24T19:24:05.141971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:11:52.417883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":645,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.771040+0000","last_change":"2026-02-24T19:17:51.929779+0000","last_active":"2026-02-24T19:24:04.771040+0000","last_peered":"2026-02-24T19:24:04.771040+0000","last_clean":"2026-02-24T19:24:04.771040+0000","last_became_active":"2026-02-24T19:17:49.636104+0000","last_became_peered":"2026-02-24T19:17:49.636104+0000","last_unstale":"2026-02-24T19:24:04.771040+0000","last_undegraded":"2026-02-24T19:24:04.771040+0000","last_fullsized":"2026-02-24T19:24:04.771040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:53:57.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036145872000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":635,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:09.360961+0000","last_change":"2026-02-24T19:24:09.360961+0000","last_active":"2026-02-24T19:24:09.360961+0000","last_peered":"2026-02-24T19:24:09.360961+0000","last_clean":"2026-02-24T19:24:09.360961+0000","last_became_active":"2026-02-24T19:18:28.629954+0000","last_became_peered":"2026-02-24T19:18:28.629954+0000","last_unstale":"2026-02-24T19:24:09.360961+0000","last_undegraded":"2026-02-24T19:24:09.360961+0000","last_fullsized":"2026-02-24T19:24:09.360961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:09.359047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:09.359047+0000","last_clean_scrub_stamp":"2026-02-24T19:24:09.359047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:49:29.436096+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":644,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.138957+0000","last_change":"2026-02-24T19:17:51.735983+0000","last_active":"2026-02-24T19:24:04.138957+0000","last_peered":"2026-02-24T19:24:04.138957+0000","last_clean":"2026-02-24T19:24:04.138957+0000","last_became_active":"2026-02-24T19:17:49.848509+0000","last_became_peered":"2026-02-24T19:17:49.848509+0000","last_unstale":"2026-02-24T19:24:04.138957+0000","last_undegraded":"2026-02-24T19:24:04.138957+0000","last_fullsized":"2026-02-24T19:24:04.138957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:48.135131+0000","last_clean_scrub_stamp":"2026-02-24T19:17:48.135131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:59:49.327706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032515259999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.754451+0000","last_change":"2026-02-24T19:18:29.182530+0000","last_active":"2026-02-24T19:24:04.754451+0000","last_peered":"2026-02-24T19:24:04.754451+0000","last_clean":"2026-02-24T19:24:04.754451+0000","last_became_active":"2026-02-24T19:18:29.176942+0000","last_became_peered":"2026-02-24T19:18:29.176942+0000","last_unstale":"2026-02-24T19:24:04.754451+0000","last_undegraded":"2026-02-24T19:24:04.754451+0000","last_fullsized":"2026-02-24T19:24:04.754451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:20:26.047180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,12],"acting":[9,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.093960+0000","last_change":"2026-02-24T19:18:29.901720+0000","last_active":"2026-02-24T19:24:04.093960+0000","last_peered":"2026-02-24T19:24:04.093960+0000","last_clean":"2026-02-24T19:24:04.093960+0000","last_became_active":"2026-02-24T19:18:29.899492+0000","last_became_peered":"2026-02-24T19:18:29.899492+0000","last_unstale":"2026-02-24T19:24:04.093960+0000","last_undegraded":"2026-02-24T19:24:04.093960+0000","last_fullsized":"2026-02-24T19:24:04.093960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:46:01.639570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14],"acting":[13,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.095439+0000","last_change":"2026-02-24T19:18:28.454346+0000","last_active":"2026-02-24T19:24:04.095439+0000","last_peered":"2026-02-24T19:24:04.095439+0000","last_clean":"2026-02-24T19:24:04.095439+0000","last_became_active":"2026-02-24T19:18:28.448515+0000","last_became_peered":"2026-02-24T19:18:28.448515+0000","last_unstale":"2026-02-24T19:24:04.095439+0000","last_undegraded":"2026-02-24T19:24:04.095439+0000","last_fullsized":"2026-02-24T19:24:04.095439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:54.317986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":624,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.118203+0000","last_change":"2026-02-24T19:18:28.813537+0000","last_active":"2026-02-24T19:24:04.118203+0000","last_peered":"2026-02-24T19:24:04.118203+0000","last_clean":"2026-02-24T19:24:04.118203+0000","last_became_active":"2026-02-24T19:18:28.805888+0000","last_became_peered":"2026-02-24T19:18:28.805888+0000","last_unstale":"2026-02-24T19:24:04.118203+0000","last_undegraded":"2026-02-24T19:24:04.118203+0000","last_fullsized":"2026-02-24T19:24:04.118203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:21:32.488493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1","version":"33'11","reported_seq":655,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.100811+0000","last_change":"2026-02-24T19:18:28.660457+0000","last_active":"2026-02-24T19:24:04.100811+0000","last_peered":"2026-02-24T19:24:04.100811+0000","last_clean":"2026-02-24T19:24:04.100811+0000","last_became_active":"2026-02-24T19:18:28.658257+0000","last_became_peered":"2026-02-24T19:18:28.658257+0000","last_unstale":"2026-02-24T19:24:04.100811+0000","last_undegraded":"2026-02-24T19:24:04.100811+0000","last_fullsized":"2026-02-24T19:24:04.100811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:56:37.770223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.406657+0000","last_change":"2026-02-24T19:18:28.336280+0000","last_active":"2026-02-24T19:24:04.406657+0000","last_peered":"2026-02-24T19:24:04.406657+0000","last_clean":"2026-02-24T19:24:04.406657+0000","last_became_active":"2026-02-24T19:18:28.334029+0000","last_became_peered":"2026-02-24T19:18:28.334029+0000","last_unstale":"2026-02-24T19:24:04.406657+0000","last_undegraded":"2026-02-24T19:24:04.406657+0000","last_fullsized":"2026-02-24T19:24:04.406657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:54:32.836654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.146371+0000","last_change":"2026-02-24T19:18:28.729903+0000","last_active":"2026-02-24T19:24:04.146371+0000","last_peered":"2026-02-24T19:24:04.146371+0000","last_clean":"2026-02-24T19:24:04.146371+0000","last_became_active":"2026-02-24T19:18:28.727493+0000","last_became_peered":"2026-02-24T19:18:28.727493+0000","last_unstale":"2026-02-24T19:24:04.146371+0000","last_undegraded":"2026-02-24T19:24:04.146371+0000","last_fullsized":"2026-02-24T19:24:04.146371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:30:30.028759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.358977+0000","last_change":"2026-02-24T19:18:29.352492+0000","last_active":"2026-02-24T19:24:04.358977+0000","last_peered":"2026-02-24T19:24:04.358977+0000","last_clean":"2026-02-24T19:24:04.358977+0000","last_became_active":"2026-02-24T19:18:29.350423+0000","last_became_peered":"2026-02-24T19:18:29.350423+0000","last_unstale":"2026-02-24T19:24:04.358977+0000","last_undegraded":"2026-02-24T19:24:04.358977+0000","last_fullsized":"2026-02-24T19:24:04.358977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:16:25.791348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.316811+0000","last_change":"2026-02-24T19:18:29.505834+0000","last_active":"2026-02-24T19:24:04.316811+0000","last_peered":"2026-02-24T19:24:04.316811+0000","last_clean":"2026-02-24T19:24:04.316811+0000","last_became_active":"2026-02-24T19:18:29.503545+0000","last_became_peered":"2026-02-24T19:18:29.503545+0000","last_unstale":"2026-02-24T19:24:04.316811+0000","last_undegraded":"2026-02-24T19:24:04.316811+0000","last_fullsized":"2026-02-24T19:24:04.316811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:38:03.828269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.300755+0000","last_change":"2026-02-24T19:18:28.360041+0000","last_active":"2026-02-24T19:24:04.300755+0000","last_peered":"2026-02-24T19:24:04.300755+0000","last_clean":"2026-02-24T19:24:04.300755+0000","last_became_active":"2026-02-24T19:18:28.357637+0000","last_became_peered":"2026-02-24T19:18:28.357637+0000","last_unstale":"2026-02-24T19:24:04.300755+0000","last_undegraded":"2026-02-24T19:24:04.300755+0000","last_fullsized":"2026-02-24T19:24:04.300755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:35:29.378705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":625,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:05.158497+0000","last_change":"2026-02-24T19:18:30.010817+0000","last_active":"2026-02-24T19:24:05.158497+0000","last_peered":"2026-02-24T19:24:05.158497+0000","last_clean":"2026-02-24T19:24:05.158497+0000","last_became_active":"2026-02-24T19:18:30.008609+0000","last_became_peered":"2026-02-24T19:18:30.008609+0000","last_unstale":"2026-02-24T19:24:05.158497+0000","last_undegraded":"2026-02-24T19:24:05.158497+0000","last_fullsized":"2026-02-24T19:24:05.158497+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:45:00.289172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.344341+0000","last_change":"2026-02-24T19:18:29.239229+0000","last_active":"2026-02-24T19:24:04.344341+0000","last_peered":"2026-02-24T19:24:04.344341+0000","last_clean":"2026-02-24T19:24:04.344341+0000","last_became_active":"2026-02-24T19:18:29.237008+0000","last_became_peered":"2026-02-24T19:18:29.237008+0000","last_unstale":"2026-02-24T19:24:04.344341+0000","last_undegraded":"2026-02-24T19:24:04.344341+0000","last_fullsized":"2026-02-24T19:24:04.344341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:19:19.633721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":625,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:04.274842+0000","last_change":"2026-02-24T19:18:28.794132+0000","last_active":"2026-02-24T19:24:04.274842+0000","last_peered":"2026-02-24T19:24:04.274842+0000","last_clean":"2026-02-24T19:24:04.274842+0000","last_became_active":"2026-02-24T19:18:28.791994+0000","last_became_peered":"2026-02-24T19:18:28.791994+0000","last_unstale":"2026-02-24T19:24:04.274842+0000","last_undegraded":"2026-02-24T19:24:04.274842+0000","last_fullsized":"2026-02-24T19:24:04.274842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:26.226040+0000","last_clean_scrub_stamp":"2026-02-24T19:18:26.226040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:37:30.793100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":864256,"data_stored":857120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280592,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":3014,"kb_used_meta":23929,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087173,"internal_metadata":24503483},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313296,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214720,"internal_metadata":27375936},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214938,"internal_metadata":27375718},"hb_peers":[0,1,2,3,5,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":3015,"kb_used_meta":23928,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087459,"internal_metadata":24503197},"hb_peers":[1,2,4,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214257,"internal_metadata":27376399},"hb_peers":[0,2,4,5,6,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":110,"kb_used_meta":26833,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113659,"internal_metadata":27476997},"hb_peers":[0,1,3,4,5,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":207,"kb_used_meta":26736,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":212874,"internal_metadata":27377782},"hb_peers":[0,1,2,3,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313297,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":3015,"kb_used_meta":23928,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087799,"internal_metadata":24502857},"hb_peers":[1,2,3,4,5,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":6864,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":7028736,"data_stored":4315541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216546,"internal_metadata":27374110},"hb_peers":[0,1,2,3,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":2961,"kb_used_meta":23982,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3032367,"internal_metadata":24558289},"hb_peers":[0,1,3,4,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33820,"kb_used_data":6860,"kb_used_omap":173,"kb_used_meta":26770,"kb_avail":94338020,"statfs":{"total":96636764160,"available":96602132480,"internally_reserved":0,"allocated":7024640,"data_stored":4315522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":177496,"internal_metadata":27413160},"hb_peers":[0,1,3,4,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214322,"internal_metadata":27376334},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313296,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34208,"kb_used_data":7248,"kb_used_omap":2877,"kb_used_meta":24066,"kb_avail":94337632,"statfs":{"total":96636764160,"available":96601735168,"internally_reserved":0,"allocated":7421952,"data_stored":4713357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2946222,"internal_metadata":24644434},"hb_peers":[0,2,3,4,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280592,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34268,"kb_used_data":7308,"kb_used_omap":5769,"kb_used_meta":21174,"kb_avail":94337572,"statfs":{"total":96636764160,"available":96601673728,"internally_reserved":0,"allocated":7483392,"data_stored":4774797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5908416,"internal_metadata":21682240},"hb_peers":[0,1,2,4,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":167,"kb_used_meta":26776,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":172019,"internal_metadata":27418637},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280593,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33820,"kb_used_data":6860,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94338020,"statfs":{"total":96636764160,"available":96602132480,"internally_reserved":0,"allocated":7024640,"data_stored":4315536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3090930,"internal_metadata":24499726},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:14.123 INFO:tasks.ceph:pgid 21.4 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.123 INFO:tasks.ceph:pgid 21.7 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.123 INFO:tasks.ceph:pgid 21.19 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.124 INFO:tasks.ceph:pgid 21.18 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.124 INFO:tasks.ceph:pgid 21.1b last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.124 INFO:tasks.ceph:pgid 21.1a last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.124 INFO:tasks.ceph:pgid 21.1d last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.124 INFO:tasks.ceph:pgid 21.1c last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.124 INFO:tasks.ceph:pgid 21.1e last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.125 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-24T19:17:39.980633+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=39, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.125 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-24T19:17:48.135131+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=48, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.125 INFO:tasks.ceph:pgid 21.14 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.125 INFO:tasks.ceph:pgid 21.17 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.125 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-24T19:17:48.135131+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=48, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.125 INFO:tasks.ceph:pgid 21.16 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.125 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-24T19:17:48.135131+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=48, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.126 INFO:tasks.ceph:pgid 21.15 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.126 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-24T19:17:48.135131+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=48, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.126 INFO:tasks.ceph:pgid 21.13 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.126 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-24T19:17:48.135131+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=48, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.126 INFO:tasks.ceph:pgid 21.12 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.126 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-24T19:17:48.135131+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=48, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.126 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-24T19:17:48.135131+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=17, tm_sec=48, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.126 INFO:tasks.ceph:pgid 21.10 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.127 INFO:tasks.ceph:pgid 21.2 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.127 INFO:tasks.ceph:pgid 21.3 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.127 INFO:tasks.ceph:pgid 21.0 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.127 INFO:tasks.ceph:pgid 21.1 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.127 INFO:tasks.ceph:pgid 21.e last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.127 INFO:tasks.ceph:pgid 21.f last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.127 INFO:tasks.ceph:pgid 21.c last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.128 INFO:tasks.ceph:pgid 21.d last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.128 INFO:tasks.ceph:pgid 21.a last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.128 INFO:tasks.ceph:pgid 21.b last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.128 INFO:tasks.ceph:pgid 21.8 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.128 INFO:tasks.ceph:pgid 21.9 last_scrub_stamp 2026-02-24T19:18:26.226040+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=26, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=5, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:14.128 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-24T19:24:20.056 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:24.863 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:20.081 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:07:24.850 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:20.082 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:07:24.886 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:20.082 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:07:24.850 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:20.082 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:24.890 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:20.083 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:07:24.888 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:20.094 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:07:24.900 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:20.095 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:07:24.863 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:20.095 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:24.903 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:34.129 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:34.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.194+0000 7fc22d074640 10 monclient: get_monmap_and_config 2026-02-24T19:24:34.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.194+0000 7fc22d074640 10 monclient: build_initial_monmap 2026-02-24T19:24:34.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.194+0000 7fc22d074640 10 monclient: monmap: 2026-02-24T19:24:34.198 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:34.198 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.198 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:34.195703+0000 2026-02-24T19:24:34.198 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:34.195703+0000 2026-02-24T19:24:34.198 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:34.198 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.199 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:34.199 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:34.199 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:34.199 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 1 Processor -- start 2026-02-24T19:24:34.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 1 -- start start 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 10 monclient: init 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 10 monclient(hunting): picked mon.noname-b con 0x7fc228058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 10 monclient(hunting): picked mon.noname-c con 0x7fc2280b0410 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 10 monclient(hunting): picked mon.noname-a con 0x7fc2281626a0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2281655c0 con 0x7fc2281626a0 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2280b12b0 con 0x7fc228058da0 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2280b1590 con 0x7fc2280b0410 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.195+0000 7fc22d074640 10 monclient(hunting): authenticate will time out at 4045.834657s 2026-02-24T19:24:34.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.196+0000 7fc226575640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7fc2280b0410 0x7fc228164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:41498/0 (socket says 10.20.193.45:41498) 2026-02-24T19:24:34.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.196+0000 7fc226575640 1 -- 10.20.193.45:0/3817376235 learned_addr learned my addr 10.20.193.45:0/3817376235 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004889334 0 0) 0x7fc2280b1590 con 0x7fc2280b0410 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 10 monclient(hunting): my global_id is 26753 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc214003610 con 0x7fc2280b0410 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956852502 0 0) 0x7fc2281655c0 con 0x7fc2281626a0 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 10 monclient(hunting): my global_id is 30813 2026-02-24T19:24:34.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.198+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2280b1590 con 0x7fc2281626a0 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 42924568 0 0) 0x7fc214003610 con 0x7fc2280b0410 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 >> v1:10.20.193.114:6789/0 conn(0x7fc228058da0 legacy=0x7fc2281647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 >> v1:10.20.193.45:6789/0 conn(0x7fc2281626a0 legacy=0x7fc2281c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 10 monclient: _finish_hunting 0 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 1 monclient: found mon.noname-c 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2280b1870 con 0x7fc2280b0410 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 10 monclient: _finish_auth 0 2026-02-24T19:24:34.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 10 monclient: _check_auth_tickets 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc210002df0 con 0x7fc2280b0410 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc225d74640 10 monclient: dump: 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.209 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc22d074640 5 monclient: authenticate success, global_id 26753 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.200+0000 7fc22d074640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc210003000 con 0x7fc2280b0410 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc225d74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc225d74640 1 -- 10.20.193.45:0/3817376235 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc210003440 con 0x7fc2280b0410 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc225d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc225d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc225d74640 10 monclient: dump: 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.210 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc22d074640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc22d074640 4 set_mon_vals no callback set 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc22d074640 10 monclient: shutdown 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc22d074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:34.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc22d074640 1 -- 10.20.193.45:0/3817376235 >> v1:10.20.193.179:6789/0 conn(0x7fc2280b0410 legacy=0x7fc228164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc22d074640 1 -- 10.20.193.45:0/3817376235 shutdown_connections 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc22d074640 1 -- 10.20.193.45:0/3817376235 >> 10.20.193.45:0/3817376235 conn(0x7fc2280b65f0 msgr2=0x7fc2280b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc22d074640 1 -- 10.20.193.45:0/3817376235 shutdown_connections 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.201+0000 7fc22d074640 1 -- 10.20.193.45:0/3817376235 wait complete. 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient: build_initial_monmap 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient: monmap: 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:34.212 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 1 librados: starting msgr at 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 1 librados: starting objecter 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 1 Processor -- start 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 1 -- start start 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 1 librados: setting wanted keys 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 1 librados: calling monclient init 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient: init 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:34.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient(hunting): picked mon.noname-b con 0x7fc228058da0 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient(hunting): picked mon.noname-a con 0x7fc2280b0410 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient(hunting): picked mon.noname-c con 0x7fc2281626a0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc22813ae90 con 0x7fc2280b0410 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc228119c80 con 0x7fc228058da0 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2280af5b0 con 0x7fc2281626a0 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc22d074640 10 monclient(hunting): authenticate will time out at 4045.841778s 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc226575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc2280b0410 0x7fc2280aeea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:47834/0 (socket says 10.20.193.45:47834) 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.202+0000 7fc226575640 1 -- 10.20.193.45:0/363270784 learned_addr learned my addr 10.20.193.45:0/363270784 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.203+0000 7fc2077fe640 10 client.?.objecter ms_handle_connect 0x7fc2280b0410 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.203+0000 7fc2077fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:34.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.203+0000 7fc2077fe640 10 client.?.objecter ms_handle_connect 0x7fc2281626a0 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.203+0000 7fc2077fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3435524474 0 0) 0x7fc22813ae90 con 0x7fc2280b0410 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 monclient(hunting): my global_id is 30816 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1f4003610 con 0x7fc2280b0410 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 client.?.objecter ms_handle_connect 0x7fc228058da0 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360288956 0 0) 0x7fc2280af5b0 con 0x7fc2281626a0 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 10 monclient(hunting): my global_id is 26756 2026-02-24T19:24:34.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.204+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc22813ae90 con 0x7fc2281626a0 2026-02-24T19:24:34.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.205+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045237395 0 0) 0x7fc228119c80 con 0x7fc228058da0 2026-02-24T19:24:34.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.205+0000 7fc2077fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.205+0000 7fc2077fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.205+0000 7fc2077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.205+0000 7fc2077fe640 10 monclient(hunting): my global_id is 28282 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.205+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2280af5b0 con 0x7fc228058da0 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.206+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3093420264 0 0) 0x7fc1f4003610 con 0x7fc2280b0410 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.206+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc228119c80 con 0x7fc2280b0410 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.206+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc210003350 con 0x7fc2280b0410 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.206+0000 7fc2077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.206+0000 7fc2077fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.206+0000 7fc2077fe640 10 monclient(hunting): dump: 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.219 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.206+0000 7fc2077fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4150025920 0 0) 0x7fc22813ae90 con 0x7fc2281626a0 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1f4003610 con 0x7fc2281626a0 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc218003370 con 0x7fc2281626a0 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:34.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 10 monclient(hunting): dump: 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1898700675 0 0) 0x7fc2280af5b0 con 0x7fc228058da0 2026-02-24T19:24:34.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc22813ae90 con 0x7fc228058da0 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc21c003090 con 0x7fc228058da0 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.207+0000 7fc2077fe640 10 monclient(hunting): dump: 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.222 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 671058496 0 0) 0x7fc228119c80 con 0x7fc2280b0410 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 >> v1:10.20.193.179:6789/0 conn(0x7fc2281626a0 legacy=0x7fc22813b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 >> v1:10.20.193.114:6789/0 conn(0x7fc228058da0 legacy=0x7fc22813a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 1 monclient: found mon.a 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22813bd20 con 0x7fc2280b0410 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc2077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:34.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc22d074640 5 monclient: authenticate success, global_id 30816 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc22d074640 10 monclient: _renew_subs 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc22d074640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc22813c000 con 0x7fc2280b0410 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc22d074640 10 client.30816.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc22d074640 10 monclient: _renew_subs 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc22d074640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc228137df0 con 0x7fc2280b0410 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.208+0000 7fc22d074640 1 librados: init done 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.209+0000 7fc22d074640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.209+0000 7fc22d074640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.209+0000 7fc22d074640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:34.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.209+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc228137bf0 con 0x7fc2280b0410 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.217+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc210002f80 con 0x7fc2280b0410 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.217+0000 7fc2077fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.217+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7fc2100028e0 con 0x7fc2280b0410 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.217+0000 7fc2077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.217+0000 7fc2077fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.217+0000 7fc2077fe640 10 monclient: dump: 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.226 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.217+0000 7fc225573640 4 set_mon_vals no callback set 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.217+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7fc21001d9b0 con 0x7fc2280b0410 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.218+0000 7fc226d76640 10 monclient: get_auth_request con 0x7fc1f4077e70 auth_method 0 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.218+0000 7fc2077fe640 10 client.30816.objecter ms_handle_connect 0x7fc1f4077e70 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.219+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7fc210002960 con 0x7fc2280b0410 2026-02-24T19:24:34.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.219+0000 7fc2077fe640 10 client.30816.objecter ms_dispatch2 0x7fc228000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:34.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.219+0000 7fc2077fe640 3 client.30816.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:34.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.219+0000 7fc2077fe640 3 client.30816.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:34.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.219+0000 7fc2077fe640 20 client.30816.objecter dump_active .. 0 homeless 2026-02-24T19:24:34.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.342+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc21005dbd0 con 0x7fc2280b0410 2026-02-24T19:24:34.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.342+0000 7fc2077fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:34.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.342+0000 7fc2077fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:34.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.444+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 --> v1:10.20.193.45:6800/1599977652 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2280b6d40 con 0x7fc1f4077e70 2026-02-24T19:24:34.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.445+0000 7fc2077fe640 1 -- 10.20.193.45:0/363270784 <== mgr.4107 v1:10.20.193.45:6800/1599977652 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125273 (unknown 2965378022 0 1270581976) 0x7fc2280b6d40 con 0x7fc1f4077e70 2026-02-24T19:24:34.450 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-24T19:24:34.451 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-24T19:24:34.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 10 librados: watch_flush enter 2026-02-24T19:24:34.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 10 librados: watch_flush exit 2026-02-24T19:24:34.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 20 client.30816.objecter shutdown clearing up homeless session... 2026-02-24T19:24:34.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 10 client.30816.objecter successfully canceled tick 2026-02-24T19:24:34.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 >> v1:10.20.193.45:6800/1599977652 conn(0x7fc1f4077e70 legacy=0x7fc1f4098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 10 monclient: shutdown 2026-02-24T19:24:34.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:34.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 >> v1:10.20.193.45:6789/0 conn(0x7fc2280b0410 legacy=0x7fc2280aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 shutdown_connections 2026-02-24T19:24:34.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 >> 10.20.193.45:0/363270784 conn(0x7fc2280b65f0 msgr2=0x7fc228055b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:34.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.446+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 shutdown_connections 2026-02-24T19:24:34.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.447+0000 7fc22d074640 1 -- 10.20.193.45:0/363270784 wait complete. 2026-02-24T19:24:34.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.447+0000 7fc22d074640 1 librados: shutdown 2026-02-24T19:24:34.459 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":554,"stamp":"2026-02-24T19:24:33.720815+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":541916,"kb_used_data":110556,"kb_used_omap":25382,"kb_used_meta":405721,"kb_avail":1509407524,"statfs":{"total":1546188226560,"available":1545633304576,"internally_reserved":0,"allocated":113209344,"data_stored":69905440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25991197,"internal_metadata":415459299},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001806"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:09.620387+0000","last_change":"2026-02-24T19:24:09.620387+0000","last_active":"2026-02-24T19:24:09.620387+0000","last_peered":"2026-02-24T19:24:09.620387+0000","last_clean":"2026-02-24T19:24:09.620387+0000","last_became_active":"2026-02-24T19:18:30.038497+0000","last_became_peered":"2026-02-24T19:18:30.038497+0000","last_unstale":"2026-02-24T19:24:09.620387+0000","last_undegraded":"2026-02-24T19:24:09.620387+0000","last_fullsized":"2026-02-24T19:24:09.620387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:09.618429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:09.618429+0000","last_clean_scrub_stamp":"2026-02-24T19:24:09.618429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:52:29.670810+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":637,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:17.890376+0000","last_change":"2026-02-24T19:24:17.890376+0000","last_active":"2026-02-24T19:24:17.890376+0000","last_peered":"2026-02-24T19:24:17.890376+0000","last_clean":"2026-02-24T19:24:17.890376+0000","last_became_active":"2026-02-24T19:18:28.441755+0000","last_became_peered":"2026-02-24T19:18:28.441755+0000","last_unstale":"2026-02-24T19:24:17.890376+0000","last_undegraded":"2026-02-24T19:24:17.890376+0000","last_fullsized":"2026-02-24T19:24:17.890376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:17.889662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:17.889662+0000","last_clean_scrub_stamp":"2026-02-24T19:24:17.889662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:54:07.145953+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:13.232102+0000","last_change":"2026-02-24T19:24:13.232102+0000","last_active":"2026-02-24T19:24:13.232102+0000","last_peered":"2026-02-24T19:24:13.232102+0000","last_clean":"2026-02-24T19:24:13.232102+0000","last_became_active":"2026-02-24T19:18:28.670036+0000","last_became_peered":"2026-02-24T19:18:28.670036+0000","last_unstale":"2026-02-24T19:24:13.232102+0000","last_undegraded":"2026-02-24T19:24:13.232102+0000","last_fullsized":"2026-02-24T19:24:13.232102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:13.230498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:13.230498+0000","last_clean_scrub_stamp":"2026-02-24T19:24:13.230498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:51:53.989869+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:08.585011+0000","last_change":"2026-02-24T19:24:08.585011+0000","last_active":"2026-02-24T19:24:08.585011+0000","last_peered":"2026-02-24T19:24:08.585011+0000","last_clean":"2026-02-24T19:24:08.585011+0000","last_became_active":"2026-02-24T19:18:29.297442+0000","last_became_peered":"2026-02-24T19:18:29.297442+0000","last_unstale":"2026-02-24T19:24:08.585011+0000","last_undegraded":"2026-02-24T19:24:08.585011+0000","last_fullsized":"2026-02-24T19:24:08.585011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:08.583259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:08.583259+0000","last_clean_scrub_stamp":"2026-02-24T19:24:08.583259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:39:45.866441+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:12.746080+0000","last_change":"2026-02-24T19:24:12.746080+0000","last_active":"2026-02-24T19:24:12.746080+0000","last_peered":"2026-02-24T19:24:12.746080+0000","last_clean":"2026-02-24T19:24:12.746080+0000","last_became_active":"2026-02-24T19:18:29.539772+0000","last_became_peered":"2026-02-24T19:18:29.539772+0000","last_unstale":"2026-02-24T19:24:12.746080+0000","last_undegraded":"2026-02-24T19:24:12.746080+0000","last_fullsized":"2026-02-24T19:24:12.746080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:12.744400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:12.744400+0000","last_clean_scrub_stamp":"2026-02-24T19:24:12.744400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:26:43.783088+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:15.646075+0000","last_change":"2026-02-24T19:24:15.646075+0000","last_active":"2026-02-24T19:24:15.646075+0000","last_peered":"2026-02-24T19:24:15.646075+0000","last_clean":"2026-02-24T19:24:15.646075+0000","last_became_active":"2026-02-24T19:18:28.575721+0000","last_became_peered":"2026-02-24T19:18:28.575721+0000","last_unstale":"2026-02-24T19:24:15.646075+0000","last_undegraded":"2026-02-24T19:24:15.646075+0000","last_fullsized":"2026-02-24T19:24:15.646075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:15.645258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:15.645258+0000","last_clean_scrub_stamp":"2026-02-24T19:24:15.645258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:15:55.546964+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:10.530893+0000","last_change":"2026-02-24T19:24:10.530893+0000","last_active":"2026-02-24T19:24:10.530893+0000","last_peered":"2026-02-24T19:24:10.530893+0000","last_clean":"2026-02-24T19:24:10.530893+0000","last_became_active":"2026-02-24T19:18:28.189388+0000","last_became_peered":"2026-02-24T19:18:28.189388+0000","last_unstale":"2026-02-24T19:24:10.530893+0000","last_undegraded":"2026-02-24T19:24:10.530893+0000","last_fullsized":"2026-02-24T19:24:10.530893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:10.529052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:10.529052+0000","last_clean_scrub_stamp":"2026-02-24T19:24:10.529052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:59:16.012448+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:11.027243+0000","last_change":"2026-02-24T19:24:11.027243+0000","last_active":"2026-02-24T19:24:11.027243+0000","last_peered":"2026-02-24T19:24:11.027243+0000","last_clean":"2026-02-24T19:24:11.027243+0000","last_became_active":"2026-02-24T19:18:30.247456+0000","last_became_peered":"2026-02-24T19:18:30.247456+0000","last_unstale":"2026-02-24T19:24:11.027243+0000","last_undegraded":"2026-02-24T19:24:11.027243+0000","last_fullsized":"2026-02-24T19:24:11.027243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:11.022334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:11.022334+0000","last_clean_scrub_stamp":"2026-02-24T19:24:11.022334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:28:39.299656+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:11.647989+0000","last_change":"2026-02-24T19:24:11.647989+0000","last_active":"2026-02-24T19:24:11.647989+0000","last_peered":"2026-02-24T19:24:11.647989+0000","last_clean":"2026-02-24T19:24:11.647989+0000","last_became_active":"2026-02-24T19:18:29.115400+0000","last_became_peered":"2026-02-24T19:18:29.115400+0000","last_unstale":"2026-02-24T19:24:11.647989+0000","last_undegraded":"2026-02-24T19:24:11.647989+0000","last_fullsized":"2026-02-24T19:24:11.647989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:11.646184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:11.646184+0000","last_clean_scrub_stamp":"2026-02-24T19:24:11.646184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:18:46.879262+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:12.515624+0000","last_change":"2026-02-24T19:24:12.515624+0000","last_active":"2026-02-24T19:24:12.515624+0000","last_peered":"2026-02-24T19:24:12.515624+0000","last_clean":"2026-02-24T19:24:12.515624+0000","last_became_active":"2026-02-24T19:18:28.565625+0000","last_became_peered":"2026-02-24T19:18:28.565625+0000","last_unstale":"2026-02-24T19:24:12.515624+0000","last_undegraded":"2026-02-24T19:24:12.515624+0000","last_fullsized":"2026-02-24T19:24:12.515624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:12.514033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:12.514033+0000","last_clean_scrub_stamp":"2026-02-24T19:24:12.514033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:17:42.627800+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:07.423461+0000","last_change":"2026-02-24T19:24:07.423461+0000","last_active":"2026-02-24T19:24:07.423461+0000","last_peered":"2026-02-24T19:24:07.423461+0000","last_clean":"2026-02-24T19:24:07.423461+0000","last_became_active":"2026-02-24T19:18:28.626150+0000","last_became_peered":"2026-02-24T19:18:28.626150+0000","last_unstale":"2026-02-24T19:24:07.423461+0000","last_undegraded":"2026-02-24T19:24:07.423461+0000","last_fullsized":"2026-02-24T19:24:07.423461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:07.418632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:07.418632+0000","last_clean_scrub_stamp":"2026-02-24T19:24:07.418632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:24:45.639416+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":640,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:13.726561+0000","last_change":"2026-02-24T19:24:13.725897+0000","last_active":"2026-02-24T19:24:13.726561+0000","last_peered":"2026-02-24T19:24:13.726561+0000","last_clean":"2026-02-24T19:24:13.726561+0000","last_became_active":"2026-02-24T19:18:30.386561+0000","last_became_peered":"2026-02-24T19:18:30.386561+0000","last_unstale":"2026-02-24T19:24:13.726561+0000","last_undegraded":"2026-02-24T19:24:13.726561+0000","last_fullsized":"2026-02-24T19:24:13.726561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:13.724372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:13.724372+0000","last_clean_scrub_stamp":"2026-02-24T19:24:13.724372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:36:45.648205+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"342'34","reported_seq":696,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:10.676532+0000","last_change":"2026-02-24T19:24:10.676532+0000","last_active":"2026-02-24T19:24:10.676532+0000","last_peered":"2026-02-24T19:24:10.676532+0000","last_clean":"2026-02-24T19:24:10.676532+0000","last_became_active":"2026-02-24T19:17:41.834152+0000","last_became_peered":"2026-02-24T19:17:41.834152+0000","last_unstale":"2026-02-24T19:24:10.676532+0000","last_undegraded":"2026-02-24T19:24:10.676532+0000","last_fullsized":"2026-02-24T19:24:10.676532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"342'34","last_scrub_stamp":"2026-02-24T19:24:10.674362+0000","last_deep_scrub":"342'34","last_deep_scrub_stamp":"2026-02-24T19:24:10.674362+0000","last_clean_scrub_stamp":"2026-02-24T19:24:10.674362+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:17:15.395481+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"342'2","reported_seq":655,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:14.907971+0000","last_change":"2026-02-24T19:24:14.907971+0000","last_active":"2026-02-24T19:24:14.907971+0000","last_peered":"2026-02-24T19:24:14.907971+0000","last_clean":"2026-02-24T19:24:14.907971+0000","last_became_active":"2026-02-24T19:17:49.844588+0000","last_became_peered":"2026-02-24T19:17:49.844588+0000","last_unstale":"2026-02-24T19:24:14.907971+0000","last_undegraded":"2026-02-24T19:24:14.907971+0000","last_fullsized":"2026-02-24T19:24:14.907971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"342'2","last_scrub_stamp":"2026-02-24T19:24:14.906591+0000","last_deep_scrub":"342'2","last_deep_scrub_stamp":"2026-02-24T19:24:14.906591+0000","last_clean_scrub_stamp":"2026-02-24T19:24:14.906591+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:48:13.235305+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.039325629000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:13.643812+0000","last_change":"2026-02-24T19:24:13.643812+0000","last_active":"2026-02-24T19:24:13.643812+0000","last_peered":"2026-02-24T19:24:13.643812+0000","last_clean":"2026-02-24T19:24:13.643812+0000","last_became_active":"2026-02-24T19:18:28.879013+0000","last_became_peered":"2026-02-24T19:18:28.879013+0000","last_unstale":"2026-02-24T19:24:13.643812+0000","last_undegraded":"2026-02-24T19:24:13.643812+0000","last_fullsized":"2026-02-24T19:24:13.643812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:13.642098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:13.642098+0000","last_clean_scrub_stamp":"2026-02-24T19:24:13.642098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:06:22.677564+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":651,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:08.474800+0000","last_change":"2026-02-24T19:24:08.474800+0000","last_active":"2026-02-24T19:24:08.474800+0000","last_peered":"2026-02-24T19:24:08.474800+0000","last_clean":"2026-02-24T19:24:08.474800+0000","last_became_active":"2026-02-24T19:17:49.829989+0000","last_became_peered":"2026-02-24T19:17:49.829989+0000","last_unstale":"2026-02-24T19:24:08.474800+0000","last_undegraded":"2026-02-24T19:24:08.474800+0000","last_fullsized":"2026-02-24T19:24:08.474800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:08.469843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:08.469843+0000","last_clean_scrub_stamp":"2026-02-24T19:24:08.469843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:53:41.316225+0000","scrub_duration":117,"objects_trimmed":0,"snaptrim_duration":0.032260351999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":637,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:18.873590+0000","last_change":"2026-02-24T19:24:18.873590+0000","last_active":"2026-02-24T19:24:18.873590+0000","last_peered":"2026-02-24T19:24:18.873590+0000","last_clean":"2026-02-24T19:24:18.873590+0000","last_became_active":"2026-02-24T19:18:28.725927+0000","last_became_peered":"2026-02-24T19:18:28.725927+0000","last_unstale":"2026-02-24T19:24:18.873590+0000","last_undegraded":"2026-02-24T19:24:18.873590+0000","last_fullsized":"2026-02-24T19:24:18.873590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:18.871643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:18.871643+0000","last_clean_scrub_stamp":"2026-02-24T19:24:18.871643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:49:43.755601+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":650,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:12.060860+0000","last_change":"2026-02-24T19:24:12.060860+0000","last_active":"2026-02-24T19:24:12.060860+0000","last_peered":"2026-02-24T19:24:12.060860+0000","last_clean":"2026-02-24T19:24:12.060860+0000","last_became_active":"2026-02-24T19:17:50.962180+0000","last_became_peered":"2026-02-24T19:17:50.962180+0000","last_unstale":"2026-02-24T19:24:12.060860+0000","last_undegraded":"2026-02-24T19:24:12.060860+0000","last_fullsized":"2026-02-24T19:24:12.060860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:12.056038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:12.056038+0000","last_clean_scrub_stamp":"2026-02-24T19:24:12.056038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:40:38.742237+0000","scrub_duration":85,"objects_trimmed":0,"snaptrim_duration":0.034127616999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,14],"acting":[6,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:14.691471+0000","last_change":"2026-02-24T19:24:14.691471+0000","last_active":"2026-02-24T19:24:14.691471+0000","last_peered":"2026-02-24T19:24:14.691471+0000","last_clean":"2026-02-24T19:24:14.691471+0000","last_became_active":"2026-02-24T19:18:29.241947+0000","last_became_peered":"2026-02-24T19:18:29.241947+0000","last_unstale":"2026-02-24T19:24:14.691471+0000","last_undegraded":"2026-02-24T19:24:14.691471+0000","last_fullsized":"2026-02-24T19:24:14.691471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:14.689748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:14.689748+0000","last_clean_scrub_stamp":"2026-02-24T19:24:14.689748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:02:31.027968+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"342'3","reported_seq":656,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:14.086070+0000","last_change":"2026-02-24T19:24:14.086070+0000","last_active":"2026-02-24T19:24:14.086070+0000","last_peered":"2026-02-24T19:24:14.086070+0000","last_clean":"2026-02-24T19:24:14.086070+0000","last_became_active":"2026-02-24T19:17:49.831395+0000","last_became_peered":"2026-02-24T19:17:49.831395+0000","last_unstale":"2026-02-24T19:24:14.086070+0000","last_undegraded":"2026-02-24T19:24:14.086070+0000","last_fullsized":"2026-02-24T19:24:14.086070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"342'3","last_scrub_stamp":"2026-02-24T19:24:14.079832+0000","last_deep_scrub":"342'3","last_deep_scrub_stamp":"2026-02-24T19:24:14.079832+0000","last_clean_scrub_stamp":"2026-02-24T19:24:14.079832+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:51:52.938868+0000","scrub_duration":166,"objects_trimmed":0,"snaptrim_duration":0.057363406999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:10.610598+0000","last_change":"2026-02-24T19:24:10.610598+0000","last_active":"2026-02-24T19:24:10.610598+0000","last_peered":"2026-02-24T19:24:10.610598+0000","last_clean":"2026-02-24T19:24:10.610598+0000","last_became_active":"2026-02-24T19:18:29.172298+0000","last_became_peered":"2026-02-24T19:18:29.172298+0000","last_unstale":"2026-02-24T19:24:10.610598+0000","last_undegraded":"2026-02-24T19:24:10.610598+0000","last_fullsized":"2026-02-24T19:24:10.610598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:10.608771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:10.608771+0000","last_clean_scrub_stamp":"2026-02-24T19:24:10.608771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:07:38.180030+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,15],"acting":[8,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":655,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:14.630223+0000","last_change":"2026-02-24T19:24:14.630223+0000","last_active":"2026-02-24T19:24:14.630223+0000","last_peered":"2026-02-24T19:24:14.630223+0000","last_clean":"2026-02-24T19:24:14.630223+0000","last_became_active":"2026-02-24T19:17:49.867737+0000","last_became_peered":"2026-02-24T19:17:49.867737+0000","last_unstale":"2026-02-24T19:24:14.630223+0000","last_undegraded":"2026-02-24T19:24:14.630223+0000","last_fullsized":"2026-02-24T19:24:14.630223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:14.628440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:14.628440+0000","last_clean_scrub_stamp":"2026-02-24T19:24:14.628440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:22:02.756442+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.041050483999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,12],"acting":[15,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:16.614204+0000","last_change":"2026-02-24T19:24:16.614204+0000","last_active":"2026-02-24T19:24:16.614204+0000","last_peered":"2026-02-24T19:24:16.614204+0000","last_clean":"2026-02-24T19:24:16.614204+0000","last_became_active":"2026-02-24T19:18:29.015809+0000","last_became_peered":"2026-02-24T19:18:29.015809+0000","last_unstale":"2026-02-24T19:24:16.614204+0000","last_undegraded":"2026-02-24T19:24:16.614204+0000","last_fullsized":"2026-02-24T19:24:16.614204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:16.612669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:16.612669+0000","last_clean_scrub_stamp":"2026-02-24T19:24:16.612669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:14:14.853380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9],"acting":[15,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":655,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:15.660535+0000","last_change":"2026-02-24T19:24:15.660535+0000","last_active":"2026-02-24T19:24:15.660535+0000","last_peered":"2026-02-24T19:24:15.660535+0000","last_clean":"2026-02-24T19:24:15.660535+0000","last_became_active":"2026-02-24T19:17:49.822380+0000","last_became_peered":"2026-02-24T19:17:49.822380+0000","last_unstale":"2026-02-24T19:24:15.660535+0000","last_undegraded":"2026-02-24T19:24:15.660535+0000","last_fullsized":"2026-02-24T19:24:15.660535+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:15.658748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:15.658748+0000","last_clean_scrub_stamp":"2026-02-24T19:24:15.658748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:10:42.997513+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.031009920999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:12.625238+0000","last_change":"2026-02-24T19:24:12.625238+0000","last_active":"2026-02-24T19:24:12.625238+0000","last_peered":"2026-02-24T19:24:12.625238+0000","last_clean":"2026-02-24T19:24:12.625238+0000","last_became_active":"2026-02-24T19:18:28.578714+0000","last_became_peered":"2026-02-24T19:18:28.578714+0000","last_unstale":"2026-02-24T19:24:12.625238+0000","last_undegraded":"2026-02-24T19:24:12.625238+0000","last_fullsized":"2026-02-24T19:24:12.625238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:12.623538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:12.623538+0000","last_clean_scrub_stamp":"2026-02-24T19:24:12.623538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:02:07.548763+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,12],"acting":[1,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":654,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:10.021401+0000","last_change":"2026-02-24T19:24:10.020719+0000","last_active":"2026-02-24T19:24:10.021401+0000","last_peered":"2026-02-24T19:24:10.021401+0000","last_clean":"2026-02-24T19:24:10.021401+0000","last_became_active":"2026-02-24T19:17:49.636104+0000","last_became_peered":"2026-02-24T19:17:49.636104+0000","last_unstale":"2026-02-24T19:24:10.021401+0000","last_undegraded":"2026-02-24T19:24:10.021401+0000","last_fullsized":"2026-02-24T19:24:10.021401+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:10.019650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:10.019650+0000","last_clean_scrub_stamp":"2026-02-24T19:24:10.019650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:13:58.626158+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0.036145872000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":635,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:09.360961+0000","last_change":"2026-02-24T19:24:09.360961+0000","last_active":"2026-02-24T19:24:09.360961+0000","last_peered":"2026-02-24T19:24:09.360961+0000","last_clean":"2026-02-24T19:24:09.360961+0000","last_became_active":"2026-02-24T19:18:28.629954+0000","last_became_peered":"2026-02-24T19:18:28.629954+0000","last_unstale":"2026-02-24T19:24:09.360961+0000","last_undegraded":"2026-02-24T19:24:09.360961+0000","last_fullsized":"2026-02-24T19:24:09.360961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:09.359047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:09.359047+0000","last_clean_scrub_stamp":"2026-02-24T19:24:09.359047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:49:29.436096+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":653,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:15.898671+0000","last_change":"2026-02-24T19:24:15.898037+0000","last_active":"2026-02-24T19:24:15.898671+0000","last_peered":"2026-02-24T19:24:15.898671+0000","last_clean":"2026-02-24T19:24:15.898671+0000","last_became_active":"2026-02-24T19:17:49.848509+0000","last_became_peered":"2026-02-24T19:17:49.848509+0000","last_unstale":"2026-02-24T19:24:15.898671+0000","last_undegraded":"2026-02-24T19:24:15.898671+0000","last_fullsized":"2026-02-24T19:24:15.898671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:15.897217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:15.897217+0000","last_clean_scrub_stamp":"2026-02-24T19:24:15.897217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:53:34.153752+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.032515259999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":638,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:11.025666+0000","last_change":"2026-02-24T19:24:11.025666+0000","last_active":"2026-02-24T19:24:11.025666+0000","last_peered":"2026-02-24T19:24:11.025666+0000","last_clean":"2026-02-24T19:24:11.025666+0000","last_became_active":"2026-02-24T19:18:29.176942+0000","last_became_peered":"2026-02-24T19:18:29.176942+0000","last_unstale":"2026-02-24T19:24:11.025666+0000","last_undegraded":"2026-02-24T19:24:11.025666+0000","last_fullsized":"2026-02-24T19:24:11.025666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:11.023507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:11.023507+0000","last_clean_scrub_stamp":"2026-02-24T19:24:11.023507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:21:45.203381+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,12],"acting":[9,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:11.341925+0000","last_change":"2026-02-24T19:24:11.341925+0000","last_active":"2026-02-24T19:24:11.341925+0000","last_peered":"2026-02-24T19:24:11.341925+0000","last_clean":"2026-02-24T19:24:11.341925+0000","last_became_active":"2026-02-24T19:18:29.899492+0000","last_became_peered":"2026-02-24T19:18:29.899492+0000","last_unstale":"2026-02-24T19:24:11.341925+0000","last_undegraded":"2026-02-24T19:24:11.341925+0000","last_fullsized":"2026-02-24T19:24:11.341925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:11.336838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:11.336838+0000","last_clean_scrub_stamp":"2026-02-24T19:24:11.336838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:02:25.509928+0000","scrub_duration":124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14],"acting":[13,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:12.198726+0000","last_change":"2026-02-24T19:24:12.198726+0000","last_active":"2026-02-24T19:24:12.198726+0000","last_peered":"2026-02-24T19:24:12.198726+0000","last_clean":"2026-02-24T19:24:12.198726+0000","last_became_active":"2026-02-24T19:18:28.448515+0000","last_became_peered":"2026-02-24T19:18:28.448515+0000","last_unstale":"2026-02-24T19:24:12.198726+0000","last_undegraded":"2026-02-24T19:24:12.198726+0000","last_fullsized":"2026-02-24T19:24:12.198726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:12.196870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:12.196870+0000","last_clean_scrub_stamp":"2026-02-24T19:24:12.196870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:01:09.197659+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2],"acting":[13,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:13.302122+0000","last_change":"2026-02-24T19:24:13.301485+0000","last_active":"2026-02-24T19:24:13.302122+0000","last_peered":"2026-02-24T19:24:13.302122+0000","last_clean":"2026-02-24T19:24:13.302122+0000","last_became_active":"2026-02-24T19:18:28.805888+0000","last_became_peered":"2026-02-24T19:18:28.805888+0000","last_unstale":"2026-02-24T19:24:13.302122+0000","last_undegraded":"2026-02-24T19:24:13.302122+0000","last_fullsized":"2026-02-24T19:24:13.302122+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:13.299765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:13.299765+0000","last_clean_scrub_stamp":"2026-02-24T19:24:13.299765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:33:37.191002+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1","version":"342'12","reported_seq":664,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:16.875781+0000","last_change":"2026-02-24T19:24:16.875781+0000","last_active":"2026-02-24T19:24:16.875781+0000","last_peered":"2026-02-24T19:24:16.875781+0000","last_clean":"2026-02-24T19:24:16.875781+0000","last_became_active":"2026-02-24T19:18:28.658257+0000","last_became_peered":"2026-02-24T19:18:28.658257+0000","last_unstale":"2026-02-24T19:24:16.875781+0000","last_undegraded":"2026-02-24T19:24:16.875781+0000","last_fullsized":"2026-02-24T19:24:16.875781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"342'12","last_scrub_stamp":"2026-02-24T19:24:16.874161+0000","last_deep_scrub":"342'12","last_deep_scrub_stamp":"2026-02-24T19:24:16.874161+0000","last_clean_scrub_stamp":"2026-02-24T19:24:16.874161+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:51:41.259851+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":638,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:12.318747+0000","last_change":"2026-02-24T19:24:12.318747+0000","last_active":"2026-02-24T19:24:12.318747+0000","last_peered":"2026-02-24T19:24:12.318747+0000","last_clean":"2026-02-24T19:24:12.318747+0000","last_became_active":"2026-02-24T19:18:28.334029+0000","last_became_peered":"2026-02-24T19:18:28.334029+0000","last_unstale":"2026-02-24T19:24:12.318747+0000","last_undegraded":"2026-02-24T19:24:12.318747+0000","last_fullsized":"2026-02-24T19:24:12.318747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:12.313660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:12.313660+0000","last_clean_scrub_stamp":"2026-02-24T19:24:12.313660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:47:41.998036+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,4],"acting":[14,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:09.598704+0000","last_change":"2026-02-24T19:24:09.598704+0000","last_active":"2026-02-24T19:24:09.598704+0000","last_peered":"2026-02-24T19:24:09.598704+0000","last_clean":"2026-02-24T19:24:09.598704+0000","last_became_active":"2026-02-24T19:18:28.727493+0000","last_became_peered":"2026-02-24T19:18:28.727493+0000","last_unstale":"2026-02-24T19:24:09.598704+0000","last_undegraded":"2026-02-24T19:24:09.598704+0000","last_fullsized":"2026-02-24T19:24:09.598704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:09.597579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:09.597579+0000","last_clean_scrub_stamp":"2026-02-24T19:24:09.597579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:48:31.394300+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:11.542504+0000","last_change":"2026-02-24T19:24:11.542504+0000","last_active":"2026-02-24T19:24:11.542504+0000","last_peered":"2026-02-24T19:24:11.542504+0000","last_clean":"2026-02-24T19:24:11.542504+0000","last_became_active":"2026-02-24T19:18:29.350423+0000","last_became_peered":"2026-02-24T19:18:29.350423+0000","last_unstale":"2026-02-24T19:24:11.542504+0000","last_undegraded":"2026-02-24T19:24:11.542504+0000","last_fullsized":"2026-02-24T19:24:11.542504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:11.541150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:11.541150+0000","last_clean_scrub_stamp":"2026-02-24T19:24:11.541150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:17:55.960426+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:11.731701+0000","last_change":"2026-02-24T19:24:11.731701+0000","last_active":"2026-02-24T19:24:11.731701+0000","last_peered":"2026-02-24T19:24:11.731701+0000","last_clean":"2026-02-24T19:24:11.731701+0000","last_became_active":"2026-02-24T19:18:29.503545+0000","last_became_peered":"2026-02-24T19:18:29.503545+0000","last_unstale":"2026-02-24T19:24:11.731701+0000","last_undegraded":"2026-02-24T19:24:11.731701+0000","last_fullsized":"2026-02-24T19:24:11.731701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:11.729869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:11.729869+0000","last_clean_scrub_stamp":"2026-02-24T19:24:11.729869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:06:39.240595+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":638,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:14.400334+0000","last_change":"2026-02-24T19:24:14.400334+0000","last_active":"2026-02-24T19:24:14.400334+0000","last_peered":"2026-02-24T19:24:14.400334+0000","last_clean":"2026-02-24T19:24:14.400334+0000","last_became_active":"2026-02-24T19:18:28.357637+0000","last_became_peered":"2026-02-24T19:18:28.357637+0000","last_unstale":"2026-02-24T19:24:14.400334+0000","last_undegraded":"2026-02-24T19:24:14.400334+0000","last_fullsized":"2026-02-24T19:24:14.400334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:14.398518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:14.398518+0000","last_clean_scrub_stamp":"2026-02-24T19:24:14.398518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:36:03.931763+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:11.653531+0000","last_change":"2026-02-24T19:24:11.653531+0000","last_active":"2026-02-24T19:24:11.653531+0000","last_peered":"2026-02-24T19:24:11.653531+0000","last_clean":"2026-02-24T19:24:11.653531+0000","last_became_active":"2026-02-24T19:18:30.008609+0000","last_became_peered":"2026-02-24T19:18:30.008609+0000","last_unstale":"2026-02-24T19:24:11.653531+0000","last_undegraded":"2026-02-24T19:24:11.653531+0000","last_fullsized":"2026-02-24T19:24:11.653531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:11.652119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:11.652119+0000","last_clean_scrub_stamp":"2026-02-24T19:24:11.652119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:51:14.222963+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9],"acting":[1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:09.555528+0000","last_change":"2026-02-24T19:24:09.555528+0000","last_active":"2026-02-24T19:24:09.555528+0000","last_peered":"2026-02-24T19:24:09.555528+0000","last_clean":"2026-02-24T19:24:09.555528+0000","last_became_active":"2026-02-24T19:18:29.237008+0000","last_became_peered":"2026-02-24T19:18:29.237008+0000","last_unstale":"2026-02-24T19:24:09.555528+0000","last_undegraded":"2026-02-24T19:24:09.555528+0000","last_fullsized":"2026-02-24T19:24:09.555528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:09.551519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:09.551519+0000","last_clean_scrub_stamp":"2026-02-24T19:24:09.551519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:32:13.462396+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:11.926801+0000","last_change":"2026-02-24T19:24:11.926801+0000","last_active":"2026-02-24T19:24:11.926801+0000","last_peered":"2026-02-24T19:24:11.926801+0000","last_clean":"2026-02-24T19:24:11.926801+0000","last_became_active":"2026-02-24T19:18:28.791994+0000","last_became_peered":"2026-02-24T19:18:28.791994+0000","last_unstale":"2026-02-24T19:24:11.926801+0000","last_undegraded":"2026-02-24T19:24:11.926801+0000","last_fullsized":"2026-02-24T19:24:11.926801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:11.925203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:11.925203+0000","last_clean_scrub_stamp":"2026-02-24T19:24:11.925203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:44:26.038798+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":864256,"data_stored":857120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":16}],"osd_stats":[{"osd":15,"up_from":22,"seq":94489280596,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":3014,"kb_used_meta":23929,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087173,"internal_metadata":24503483},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313300,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214720,"internal_metadata":27375936},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280597,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214938,"internal_metadata":27375718},"hb_peers":[0,1,2,3,5,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313301,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":3015,"kb_used_meta":23928,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087459,"internal_metadata":24503197},"hb_peers":[1,2,4,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313300,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214257,"internal_metadata":27376399},"hb_peers":[0,2,4,5,6,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313300,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":110,"kb_used_meta":26833,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113659,"internal_metadata":27476997},"hb_peers":[0,1,3,4,5,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313301,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":207,"kb_used_meta":26736,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":212874,"internal_metadata":27377782},"hb_peers":[0,1,2,3,4,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313301,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":3015,"kb_used_meta":23928,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087799,"internal_metadata":24502857},"hb_peers":[1,2,3,4,5,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313301,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":6864,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":7028736,"data_stored":4315541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216546,"internal_metadata":27374110},"hb_peers":[0,1,2,3,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313300,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":2961,"kb_used_meta":23982,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3032367,"internal_metadata":24558289},"hb_peers":[0,1,3,4,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313300,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33820,"kb_used_data":6860,"kb_used_omap":173,"kb_used_meta":26770,"kb_avail":94338020,"statfs":{"total":96636764160,"available":96602132480,"internally_reserved":0,"allocated":7024640,"data_stored":4315522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":177496,"internal_metadata":27413160},"hb_peers":[0,1,3,4,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313301,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214322,"internal_metadata":27376334},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313300,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34208,"kb_used_data":7248,"kb_used_omap":2877,"kb_used_meta":24066,"kb_avail":94337632,"statfs":{"total":96636764160,"available":96601735168,"internally_reserved":0,"allocated":7421952,"data_stored":4713357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2946222,"internal_metadata":24644434},"hb_peers":[0,2,3,4,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280596,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34268,"kb_used_data":7308,"kb_used_omap":5769,"kb_used_meta":21174,"kb_avail":94337572,"statfs":{"total":96636764160,"available":96601673728,"internally_reserved":0,"allocated":7483392,"data_stored":4774797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5908416,"internal_metadata":21682240},"hb_peers":[0,1,2,4,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313300,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":167,"kb_used_meta":26776,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4315517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":172019,"internal_metadata":27418637},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280597,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33820,"kb_used_data":6860,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94338020,"statfs":{"total":96636764160,"available":96602132480,"internally_reserved":0,"allocated":7024640,"data_stored":4315536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3090930,"internal_metadata":24499726},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:34.464 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-24T19:24:34.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.527+0000 7f9ff5246640 10 monclient: get_monmap_and_config 2026-02-24T19:24:34.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.527+0000 7f9ff5246640 10 monclient: build_initial_monmap 2026-02-24T19:24:34.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.527+0000 7f9ff5246640 10 monclient: monmap: 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:24:34.528210+0000 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:24:34.528210+0000 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:34.531 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.527+0000 7f9ff5246640 1 Processor -- start 2026-02-24T19:24:34.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.527+0000 7f9ff5246640 1 -- start start 2026-02-24T19:24:34.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.527+0000 7f9ff5246640 10 monclient: init 2026-02-24T19:24:34.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:34.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:34.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 10 monclient(hunting): picked mon.noname-b con 0x7f9ff00b9f80 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:34.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 10 monclient(hunting): picked mon.noname-a con 0x7f9ff00ba350 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:34.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 10 monclient(hunting): picked mon.noname-c con 0x7f9ff00585e0 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff0163930 con 0x7f9ff00ba350 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff0163bb0 con 0x7f9ff00b9f80 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff0163e90 con 0x7f9ff00585e0 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9ff5246640 10 monclient(hunting): authenticate will time out at 4046.167394s 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9fef577640 1 --1- >> v1:10.20.193.179:6789/0 conn(0x7f9ff00585e0 0x7f9ff0166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.179:6789/0 says I am v1:10.20.193.45:41504/0 (socket says 10.20.193.45:41504) 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.528+0000 7f9fef577640 1 -- 10.20.193.45:0/573397849 learned_addr learned my addr 10.20.193.45:0/573397849 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.529+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920814746 0 0) 0x7f9ff0163e90 con 0x7f9ff00585e0 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.529+0000 7f9fedd74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.529+0000 7f9fedd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.529+0000 7f9fedd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 10 monclient(hunting): my global_id is 26759 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fdc003610 con 0x7f9ff00585e0 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561941321 0 0) 0x7f9fd8002910 con 0x7f9ff00ba350 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 10 monclient(hunting): my global_id is 30819 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ff0163e90 con 0x7f9ff00ba350 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96615285 0 0) 0x7f9ff0163bb0 con 0x7f9ff00b9f80 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 10 monclient(hunting): my global_id is 28285 2026-02-24T19:24:34.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.530+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fd8002910 con 0x7f9ff00b9f80 2026-02-24T19:24:34.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 762528349 0 0) 0x7f9fdc003610 con 0x7f9ff00585e0 2026-02-24T19:24:34.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 >> v1:10.20.193.114:6789/0 conn(0x7f9ff00b9f80 legacy=0x7f9ff0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 >> v1:10.20.193.45:6789/0 conn(0x7f9ff00ba350 legacy=0x7f9ff0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 10 monclient: _finish_hunting 0 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 1 monclient: found mon.noname-c 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.179:6789/0 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 --> v1:10.20.193.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff00573f0 con 0x7f9ff00585e0 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 10 monclient: _finish_auth 0 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 10 monclient: _check_auth_tickets 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9fe0003170 con 0x7f9ff00585e0 2026-02-24T19:24:34.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9fedd74640 10 monclient: dump: 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.544 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9ff5246640 5 monclient: authenticate success, global_id 26759 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.531+0000 7f9ff5246640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 <== mon.2 v1:10.20.193.179:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9fe0003340 con 0x7f9ff00585e0 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9fedd74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9fedd74640 1 -- 10.20.193.45:0/573397849 <== mon.2 v1:10.20.193.179:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9fe0003780 con 0x7f9ff00585e0 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9fedd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9fedd74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9fedd74640 10 monclient: dump: 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.545 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9ff5246640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9ff5246640 4 set_mon_vals no callback set 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9ff5246640 10 monclient: shutdown 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9ff5246640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9ff5246640 1 -- 10.20.193.45:0/573397849 >> v1:10.20.193.179:6789/0 conn(0x7f9ff00585e0 legacy=0x7f9ff0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9ff5246640 1 -- 10.20.193.45:0/573397849 shutdown_connections 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9ff5246640 1 -- 10.20.193.45:0/573397849 >> 10.20.193.45:0/573397849 conn(0x7f9ff00b7990 msgr2=0x7f9ff00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9ff5246640 1 -- 10.20.193.45:0/573397849 shutdown_connections 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.532+0000 7f9ff5246640 1 -- 10.20.193.45:0/573397849 wait complete. 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 10 monclient: build_initial_monmap 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 10 monclient: monmap: 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a 2026-02-24T19:24:34.547 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.noname-b 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.noname-c 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 1 librados: starting msgr at 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 1 librados: starting objecter 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 1 Processor -- start 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 1 -- start start 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 1 librados: setting wanted keys 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 1 librados: calling monclient init 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.533+0000 7f9ff5246640 10 monclient: init 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:34.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 10 monclient(hunting): picked mon.noname-a con 0x7f9ff00585e0 addr v1:10.20.193.45:6789/0 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 10 monclient(hunting): picked mon.noname-c con 0x7f9ff00b9f80 addr v1:10.20.193.179:6789/0 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 10 monclient(hunting): picked mon.noname-b con 0x7f9ff00ba350 addr v1:10.20.193.114:6789/0 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff00b2e00 con 0x7f9ff00585e0 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 1 -- --> v1:10.20.193.114:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff01660a0 con 0x7f9ff00ba350 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 1 -- --> v1:10.20.193.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff00b30a0 con 0x7f9ff00b9f80 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9ff5246640 10 monclient(hunting): authenticate will time out at 4046.173097s 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9feed76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9ff00585e0 0x7f9ff0165990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:47842/0 (socket says 10.20.193.45:47842) 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9feed76640 1 -- 10.20.193.45:0/2374052158 learned_addr learned my addr 10.20.193.45:0/2374052158 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9fcf7fe640 10 client.?.objecter ms_handle_connect 0x7f9ff00585e0 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9fcf7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:34.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9fcf7fe640 10 client.?.objecter ms_handle_connect 0x7f9ff00ba350 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.534+0000 7f9fcf7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 client.?.objecter ms_handle_connect 0x7f9ff00b9f80 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628220499 0 0) 0x7f9ff00b2e00 con 0x7f9ff00585e0 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 monclient(hunting): my global_id is 30822 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fbc003610 con 0x7f9ff00585e0 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.1 v1:10.20.193.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797602307 0 0) 0x7f9ff01660a0 con 0x7f9ff00ba350 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 10 monclient(hunting): my global_id is 28288 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.535+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.114:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ff00b2e00 con 0x7f9ff00ba350 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.536+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.2 v1:10.20.193.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461733874 0 0) 0x7f9ff00b30a0 con 0x7f9ff00b9f80 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.536+0000 7f9fcf7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.536+0000 7f9fcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.536+0000 7f9fcf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.536+0000 7f9fcf7fe640 10 monclient(hunting): my global_id is 26762 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.536+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ff01660a0 con 0x7f9ff00b9f80 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 542734763 0 0) 0x7f9fbc003610 con 0x7f9ff00585e0 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.45:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ff00b30a0 con 0x7f9ff00585e0 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9fe4003170 con 0x7f9ff00585e0 2026-02-24T19:24:34.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.552 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.1 v1:10.20.193.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3790720196 0 0) 0x7f9ff00b2e00 con 0x7f9ff00ba350 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.114:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9fbc003610 con 0x7f9ff00ba350 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.1 v1:10.20.193.114:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9fe00034f0 con 0x7f9ff00ba350 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.553 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.2 v1:10.20.193.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1494069798 0 0) 0x7f9ff01660a0 con 0x7f9ff00b9f80 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.179:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ff00b2e00 con 0x7f9ff00b9f80 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.2 v1:10.20.193.179:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9fd80041c0 con 0x7f9ff00b9f80 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.538+0000 7f9fcf7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.554 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.555 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.555 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.555 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.555 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.555 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.555 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.555 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.555 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2577302051 0 0) 0x7f9ff00b30a0 con 0x7f9ff00585e0 2026-02-24T19:24:34.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 >> v1:10.20.193.179:6789/0 conn(0x7f9ff00b9f80 legacy=0x7f9ff00b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 >> v1:10.20.193.114:6789/0 conn(0x7f9ff00ba350 legacy=0x7f9ff0156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:34.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 1 monclient: found mon.a 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff00b36b0 con 0x7f9ff00585e0 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9fcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9ff5246640 5 monclient: authenticate success, global_id 30822 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9ff5246640 10 monclient: _renew_subs 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9ff5246640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.45:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff00b3990 con 0x7f9ff00585e0 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9ff5246640 10 client.30822.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9ff5246640 10 monclient: _renew_subs 2026-02-24T19:24:34.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9ff5246640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:34.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.45:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9ff00b3f50 con 0x7f9ff00585e0 2026-02-24T19:24:34.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.539+0000 7f9ff5246640 1 librados: init done 2026-02-24T19:24:34.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.540+0000 7f9ff5246640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:34.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.540+0000 7f9ff5246640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:34.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.540+0000 7f9ff5246640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:34.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.540+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.45:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff015c630 con 0x7f9ff00585e0 2026-02-24T19:24:34.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.670+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9fe4003520 con 0x7f9ff00585e0 2026-02-24T19:24:34.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.670+0000 7f9fcf7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:34.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.670+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 4108825278 0 0) 0x7f9fe4003b50 con 0x7f9ff00585e0 2026-02-24T19:24:34.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.670+0000 7f9fcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:34.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.670+0000 7f9fcf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:34.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.670+0000 7f9fcf7fe640 10 monclient: dump: 2026-02-24T19:24:34.674 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr:fsid 738dd6f3-d81f-41eb-89dc-068883b21f11 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-24T19:16:27.833128+0000 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 3 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.a 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.114:6789/0 mon.b 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.179:6789/0 mon.c 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:24:34.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.670+0000 7f9fed573640 4 set_mon_vals no callback set 2026-02-24T19:24:34.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.671+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2944892309 0 0) 0x7f9fe4003d30 con 0x7f9ff00585e0 2026-02-24T19:24:34.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.671+0000 7f9fee575640 10 monclient: get_auth_request con 0x7f9fbc077e70 auth_method 0 2026-02-24T19:24:34.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.671+0000 7f9fcf7fe640 10 client.30822.objecter ms_handle_connect 0x7f9fbc077e70 2026-02-24T19:24:34.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.674+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8987+0+0 (unknown 3010361003 0 0) 0x7f9fe40932a0 con 0x7f9ff00585e0 2026-02-24T19:24:34.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.674+0000 7f9fcf7fe640 10 client.30822.objecter ms_dispatch2 0x7f9ff0000b90 osd_map(342..342 src has 1..342) 2026-02-24T19:24:34.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.674+0000 7f9fcf7fe640 3 client.30822.objecter handle_osd_map got epochs [342,342] > 0 2026-02-24T19:24:34.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.674+0000 7f9fcf7fe640 3 client.30822.objecter handle_osd_map decoding full epoch 342 2026-02-24T19:24:34.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.674+0000 7f9fcf7fe640 20 client.30822.objecter dump_active .. 0 homeless 2026-02-24T19:24:34.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.674+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9fe405dcd0 con 0x7f9ff00585e0 2026-02-24T19:24:34.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.674+0000 7f9fcf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:34.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.674+0000 7f9fcf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:34.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.778+0000 7f9ff5246640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-24T19:24:34.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.778+0000 7f9ff5246640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-24T19:24:34.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.778+0000 7f9ff5246640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.45:6789/0 2026-02-24T19:24:34.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.778+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 --> v1:10.20.193.45:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9ff00b4b80 con 0x7f9ff00585e0 2026-02-24T19:24:34.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.835+0000 7f9fcf7fe640 1 -- 10.20.193.45:0/2374052158 <== mon.0 v1:10.20.193.45:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7f9fe4003b50 con 0x7f9ff00585e0 2026-02-24T19:24:34.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.835+0000 7f9fcf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-24T19:24:34.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.835+0000 7f9fcf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:24:34.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 10 librados: watch_flush enter 2026-02-24T19:24:34.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 10 librados: watch_flush exit 2026-02-24T19:24:34.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 20 client.30822.objecter shutdown clearing up homeless session... 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 10 client.30822.objecter successfully canceled tick 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 >> v1:10.20.193.45:6800/1599977652 conn(0x7f9fbc077e70 legacy=0x7f9fbc098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 10 monclient: shutdown 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 >> v1:10.20.193.45:6789/0 conn(0x7f9ff00585e0 legacy=0x7f9ff0165990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 shutdown_connections 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 >> 10.20.193.45:0/2374052158 conn(0x7f9ff00b7990 msgr2=0x7f9ff00b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 shutdown_connections 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 1 -- 10.20.193.45:0/2374052158 wait complete. 2026-02-24T19:24:34.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-24T19:24:34.837+0000 7f9ff5246640 1 librados: shutdown 2026-02-24T19:24:34.850 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-24T19:24:34.850 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-24T19:24:34.850 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-24T19:24:34.850 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:34.860 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-24T19:24:34.852+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 45459) UID: 0 2026-02-24T19:24:34.860 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-24T19:24:34.853+0000 c765640 -1 osd.0 342 *** Got signal Terminated *** 2026-02-24T19:24:39.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-24T19:24:40.098 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:44.906 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.123 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:44.930 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.132 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:44.939 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.146 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:07:44.951 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.146 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:07:44.915 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.147 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:07:44.953 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.148 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:07:44.917 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.156 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:07:44.961 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.157 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:07:44.926 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:40.951 INFO:tasks.ceph.osd.0:Stopped 2026-02-24T19:24:40.952 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-24T19:24:40.952 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:40.959 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-24T19:24:40.951+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 45461) UID: 0 2026-02-24T19:24:40.960 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-24T19:24:40.952+0000 c765640 -1 osd.4 344 *** Got signal Terminated *** 2026-02-24T19:24:46.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2026-02-24T19:24:46.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-24T19:24:47.054 INFO:tasks.ceph.osd.4:Stopped 2026-02-24T19:24:47.054 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-24T19:24:47.054 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:47.061 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-24T19:24:47.055+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 45465) UID: 0 2026-02-24T19:24:47.062 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-24T19:24:47.055+0000 c765640 -1 osd.8 346 *** Got signal Terminated *** 2026-02-24T19:24:53.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 is failed for ~0s 2026-02-24T19:24:53.099 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2026-02-24T19:24:53.156 INFO:tasks.ceph.osd.8:Stopped 2026-02-24T19:24:53.156 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-24T19:24:53.156 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:53.164 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-24T19:24:53.156+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 45467) UID: 0 2026-02-24T19:24:53.164 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-24T19:24:53.157+0000 c765640 -1 osd.12 348 *** Got signal Terminated *** 2026-02-24T19:24:59.259 INFO:tasks.ceph.osd.12:Stopped 2026-02-24T19:24:59.259 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-24T19:24:59.259 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:59.267 INFO:tasks.ceph.osd.1.trial114.stderr:2026-02-24T19:24:59.261+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 43955) UID: 0 2026-02-24T19:24:59.267 INFO:tasks.ceph.osd.1.trial114.stderr:2026-02-24T19:24:59.262+0000 c765640 -1 osd.1 350 *** Got signal Terminated *** 2026-02-24T19:24:59.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 is failed for ~0s 2026-02-24T19:24:59.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 has been restored 2026-02-24T19:25:05.212 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:10.019 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:05.214 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:10.021 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:05.226 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:10.034 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:05.237 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:10.006 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:05.238 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:10.043 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:05.239 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:10.008 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:05.240 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:10.045 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:05.251 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:10.020 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:05.253 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:10.058 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:05.361 INFO:tasks.ceph.osd.1:Stopped 2026-02-24T19:25:05.361 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-24T19:25:05.361 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:05.368 INFO:tasks.ceph.osd.5.trial114.stderr:2026-02-24T19:25:05.362+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 43957) UID: 0 2026-02-24T19:25:05.369 INFO:tasks.ceph.osd.5.trial114.stderr:2026-02-24T19:25:05.363+0000 c765640 -1 osd.5 352 *** Got signal Terminated *** 2026-02-24T19:25:06.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-24T19:25:06.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 has been restored 2026-02-24T19:25:11.463 INFO:tasks.ceph.osd.5:Stopped 2026-02-24T19:25:11.463 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-24T19:25:11.463 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:11.470 INFO:tasks.ceph.osd.9.trial114.stderr:2026-02-24T19:25:11.462+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 43960) UID: 0 2026-02-24T19:25:11.470 INFO:tasks.ceph.osd.9.trial114.stderr:2026-02-24T19:25:11.463+0000 c765640 -1 osd.9 354 *** Got signal Terminated *** 2026-02-24T19:25:12.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2026-02-24T19:25:12.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2026-02-24T19:25:17.565 INFO:tasks.ceph.osd.9:Stopped 2026-02-24T19:25:17.565 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-24T19:25:17.565 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:17.572 INFO:tasks.ceph.osd.13.trial114.stderr:2026-02-24T19:25:17.565+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 43963) UID: 0 2026-02-24T19:25:17.573 INFO:tasks.ceph.osd.13.trial114.stderr:2026-02-24T19:25:17.566+0000 c765640 -1 osd.13 356 *** Got signal Terminated *** 2026-02-24T19:25:19.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2026-02-24T19:25:23.666 INFO:tasks.ceph.osd.13:Stopped 2026-02-24T19:25:23.667 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-24T19:25:23.667 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:23.674 INFO:tasks.ceph.osd.2.trial179.stderr:2026-02-24T19:25:23.668+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 43886) UID: 0 2026-02-24T19:25:23.676 INFO:tasks.ceph.osd.2.trial179.stderr:2026-02-24T19:25:23.669+0000 c765640 -1 osd.2 358 *** Got signal Terminated *** 2026-02-24T19:25:25.184 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:29.991 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:25.185 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:29.993 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:25.186 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:29.991 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:25.187 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:29.993 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:25.197 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:30.004 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:25.199 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:30.005 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:25.212 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:29.981 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:25.213 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:29.982 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:25.226 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:29.995 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:29.769 INFO:tasks.ceph.osd.2:Stopped 2026-02-24T19:25:29.769 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-24T19:25:29.769 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:29.776 INFO:tasks.ceph.osd.6.trial179.stderr:2026-02-24T19:25:29.770+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 43890) UID: 0 2026-02-24T19:25:29.777 INFO:tasks.ceph.osd.6.trial179.stderr:2026-02-24T19:25:29.770+0000 c765640 -1 osd.6 360 *** Got signal Terminated *** 2026-02-24T19:25:30.208 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:35.015 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:30.210 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:35.018 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:30.217 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:35.025 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:30.234 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:35.039 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:30.234 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:35.003 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:30.235 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:35.041 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:30.236 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:35.005 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:30.241 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:35.047 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:30.243 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:35.012 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:35.870 INFO:tasks.ceph.osd.6:Stopped 2026-02-24T19:25:35.870 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-24T19:25:35.870 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:35.877 INFO:tasks.ceph.osd.10.trial179.stderr:2026-02-24T19:25:35.871+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 43894) UID: 0 2026-02-24T19:25:35.878 INFO:tasks.ceph.osd.10.trial179.stderr:2026-02-24T19:25:35.871+0000 c765640 -1 osd.10 362 *** Got signal Terminated *** 2026-02-24T19:25:41.971 INFO:tasks.ceph.osd.10:Stopped 2026-02-24T19:25:41.972 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-24T19:25:41.972 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:41.980 INFO:tasks.ceph.osd.14.trial179.stderr:2026-02-24T19:25:41.973+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 43896) UID: 0 2026-02-24T19:25:41.980 INFO:tasks.ceph.osd.14.trial179.stderr:2026-02-24T19:25:41.974+0000 c765640 -1 osd.14 364 *** Got signal Terminated *** 2026-02-24T19:25:45.269 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:50.077 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:45.272 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:50.079 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:45.281 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:50.089 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:45.293 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:50.098 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:45.294 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:50.100 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:45.295 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:50.064 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:45.296 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:50.065 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:45.304 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:08:50.110 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:45.306 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:08:50.074 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:48.074 INFO:tasks.ceph.osd.14:Stopped 2026-02-24T19:25:48.074 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-24T19:25:48.074 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:48.081 INFO:tasks.ceph.osd.3.trial194.stderr:2026-02-24T19:25:48.075+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 44361) UID: 0 2026-02-24T19:25:48.081 INFO:tasks.ceph.osd.3.trial194.stderr:2026-02-24T19:25:48.076+0000 c765640 -1 osd.3 366 *** Got signal Terminated *** 2026-02-24T19:25:49.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-24T19:25:54.176 INFO:tasks.ceph.osd.3:Stopped 2026-02-24T19:25:54.177 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-24T19:25:54.177 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:54.183 INFO:tasks.ceph.osd.7.trial194.stderr:2026-02-24T19:25:54.178+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 44365) UID: 0 2026-02-24T19:25:54.184 INFO:tasks.ceph.osd.7.trial194.stderr:2026-02-24T19:25:54.178+0000 c765640 -1 osd.7 366 *** Got signal Terminated *** 2026-02-24T19:25:55.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2026-02-24T19:25:55.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-24T19:26:00.278 INFO:tasks.ceph.osd.7:Stopped 2026-02-24T19:26:00.278 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-24T19:26:00.278 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:00.286 INFO:tasks.ceph.osd.11.trial194.stderr:2026-02-24T19:26:00.280+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 44368) UID: 0 2026-02-24T19:26:00.286 INFO:tasks.ceph.osd.11.trial194.stderr:2026-02-24T19:26:00.280+0000 c765640 -1 osd.11 366 *** Got signal Terminated *** 2026-02-24T19:26:01.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2026-02-24T19:26:05.263 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:09:10.071 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:05.264 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:09:10.072 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:05.265 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:09:10.070 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:05.266 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:09:10.072 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:05.272 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:09:10.080 44996== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:05.273 INFO:tasks.ceph.mon.b.trial114.stderr:==00:00:09:10.079 43721== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:05.288 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:09:10.057 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:05.289 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:09:10.058 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:05.297 INFO:tasks.ceph.mon.c.trial179.stderr:==00:00:09:10.066 43655== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:06.380 INFO:tasks.ceph.osd.11:Stopped 2026-02-24T19:26:06.381 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-24T19:26:06.381 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:06.388 INFO:tasks.ceph.osd.15.trial194.stderr:2026-02-24T19:26:06.381+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 44370) UID: 0 2026-02-24T19:26:06.388 INFO:tasks.ceph.osd.15.trial194.stderr:2026-02-24T19:26:06.381+0000 c765640 -1 osd.15 366 *** Got signal Terminated *** 2026-02-24T19:26:06.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 is failed for ~0s 2026-02-24T19:26:12.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 is failed for ~0s 2026-02-24T19:26:12.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 has been restored 2026-02-24T19:26:12.482 INFO:tasks.ceph.osd.15:Stopped 2026-02-24T19:26:12.482 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-24T19:26:12.482 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-24T19:26:12.482 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:12.483 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-24T19:26:12.479+0000 7fef5cbc7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 45044) UID: 0 2026-02-24T19:26:12.483 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-24T19:26:12.479+0000 7fef5cbc7640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-24T19:26:12.511 INFO:tasks.ceph.mgr.y:Stopped 2026-02-24T19:26:12.511 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-24T19:26:12.511 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:12.541 INFO:tasks.ceph.mgr.x:Stopped 2026-02-24T19:26:12.541 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-24T19:26:12.541 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-24T19:26:12.541 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:12.559 INFO:tasks.ceph.mon.a.trial045.stderr:2026-02-24T19:26:12.551+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 44994) UID: 0 2026-02-24T19:26:12.559 INFO:tasks.ceph.mon.a.trial045.stderr:2026-02-24T19:26:12.551+0000 add7640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T19:26:17.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-24T19:26:17.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 has been restored 2026-02-24T19:26:18.643 INFO:tasks.ceph.mon.a:Stopped 2026-02-24T19:26:18.644 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-24T19:26:18.644 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:18.652 INFO:tasks.ceph.mon.b.trial114.stderr:2026-02-24T19:26:18.645+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 43719) UID: 0 2026-02-24T19:26:18.652 INFO:tasks.ceph.mon.b.trial114.stderr:2026-02-24T19:26:18.645+0000 add7640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-24T19:26:22.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-24T19:26:22.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-24T19:26:24.746 INFO:tasks.ceph.mon.b:Stopped 2026-02-24T19:26:24.746 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-24T19:26:24.746 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:24.755 INFO:tasks.ceph.mon.c.trial179.stderr:2026-02-24T19:26:24.747+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 43653) UID: 0 2026-02-24T19:26:24.756 INFO:tasks.ceph.mon.c.trial179.stderr:2026-02-24T19:26:24.748+0000 add7640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-24T19:26:27.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-24T19:26:27.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-24T19:26:30.848 INFO:tasks.ceph.mon.c:Stopped 2026-02-24T19:26:30.848 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-24T19:26:30.849 DEBUG:teuthology.orchestra.run.trial045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | egrep -v OSD_DOWN | head -n 1 2026-02-24T19:26:30.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:26:30.879 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-24T19:26:30.954 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:26:30.954 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-24T19:26:31.024 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:26:31.025 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-24T19:26:31.099 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:26:31.100 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-24T19:26:31.168 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:26:31.168 DEBUG:teuthology.orchestra.run.trial114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-24T19:26:31.208 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:26:31.208 DEBUG:teuthology.orchestra.run.trial114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-24T19:26:31.283 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:26:31.284 DEBUG:teuthology.orchestra.run.trial114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-24T19:26:31.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:26:31.359 DEBUG:teuthology.orchestra.run.trial114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-24T19:26:31.429 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:26:31.430 DEBUG:teuthology.orchestra.run.trial179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-24T19:26:31.471 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:26:31.472 DEBUG:teuthology.orchestra.run.trial179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-24T19:26:31.541 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:26:31.541 DEBUG:teuthology.orchestra.run.trial179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-24T19:26:31.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:26:31.611 DEBUG:teuthology.orchestra.run.trial179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-24T19:26:31.685 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:26:31.686 DEBUG:teuthology.orchestra.run.trial194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-24T19:26:31.724 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:26:31.724 DEBUG:teuthology.orchestra.run.trial194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-24T19:26:31.798 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:26:31.798 DEBUG:teuthology.orchestra.run.trial194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-24T19:26:31.868 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:26:31.868 DEBUG:teuthology.orchestra.run.trial194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-24T19:26:31.943 INFO:tasks.ceph:Archiving mon data... 2026-02-24T19:26:31.944 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/data/mon.a.tgz 2026-02-24T19:26:31.944 DEBUG:teuthology.orchestra.run.trial045:> mktemp 2026-02-24T19:26:31.962 INFO:teuthology.orchestra.run.trial045.stdout:/tmp/tmp.AyjYAhGFe8 2026-02-24T19:26:31.962 DEBUG:teuthology.orchestra.run.trial045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AyjYAhGFe8 2026-02-24T19:26:32.137 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0666 /tmp/tmp.AyjYAhGFe8 2026-02-24T19:26:32.219 DEBUG:teuthology.orchestra.remote:trial045:/tmp/tmp.AyjYAhGFe8 is 874KB 2026-02-24T19:26:32.322 DEBUG:teuthology.orchestra.run.trial045:> rm -fr /tmp/tmp.AyjYAhGFe8 2026-02-24T19:26:32.339 DEBUG:teuthology.misc:Transferring archived files from trial114:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/data/mon.b.tgz 2026-02-24T19:26:32.339 DEBUG:teuthology.orchestra.run.trial114:> mktemp 2026-02-24T19:26:32.357 INFO:teuthology.orchestra.run.trial114.stdout:/tmp/tmp.QueNC9hehi 2026-02-24T19:26:32.357 DEBUG:teuthology.orchestra.run.trial114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.QueNC9hehi 2026-02-24T19:26:32.532 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod 0666 /tmp/tmp.QueNC9hehi 2026-02-24T19:26:32.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-24T19:26:32.613 DEBUG:teuthology.orchestra.remote:trial114:/tmp/tmp.QueNC9hehi is 875KB 2026-02-24T19:26:32.712 DEBUG:teuthology.orchestra.run.trial114:> rm -fr /tmp/tmp.QueNC9hehi 2026-02-24T19:26:32.730 DEBUG:teuthology.misc:Transferring archived files from trial179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/data/mon.c.tgz 2026-02-24T19:26:32.730 DEBUG:teuthology.orchestra.run.trial179:> mktemp 2026-02-24T19:26:32.747 INFO:teuthology.orchestra.run.trial179.stdout:/tmp/tmp.G1BuoeFP4A 2026-02-24T19:26:32.748 DEBUG:teuthology.orchestra.run.trial179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.G1BuoeFP4A 2026-02-24T19:26:32.921 DEBUG:teuthology.orchestra.run.trial179:> sudo chmod 0666 /tmp/tmp.G1BuoeFP4A 2026-02-24T19:26:33.003 DEBUG:teuthology.orchestra.remote:trial179:/tmp/tmp.G1BuoeFP4A is 875KB 2026-02-24T19:26:33.104 DEBUG:teuthology.orchestra.run.trial179:> rm -fr /tmp/tmp.G1BuoeFP4A 2026-02-24T19:26:33.121 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-24T19:26:33.121 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:33.124 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:33.126 DEBUG:teuthology.orchestra.run.trial179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:33.162 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:33.444 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:33.702 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:33.958 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:34.170 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:34.170 INFO:tasks.ceph:Archiving crash dumps... 2026-02-24T19:26:34.172 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial045/crash 2026-02-24T19:26:34.173 DEBUG:teuthology.orchestra.run.trial045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:34.200 DEBUG:teuthology.misc:Transferring archived files from trial114:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial114/crash 2026-02-24T19:26:34.205 DEBUG:teuthology.orchestra.run.trial114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:34.231 DEBUG:teuthology.misc:Transferring archived files from trial179:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial179/crash 2026-02-24T19:26:34.233 DEBUG:teuthology.orchestra.run.trial179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:34.259 DEBUG:teuthology.misc:Transferring archived files from trial194:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial194/crash 2026-02-24T19:26:34.261 DEBUG:teuthology.orchestra.run.trial194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:34.287 INFO:tasks.ceph:Compressing logs... 2026-02-24T19:26:34.287 DEBUG:teuthology.orchestra.run.trial045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:34.289 DEBUG:teuthology.orchestra.run.trial114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:34.292 DEBUG:teuthology.orchestra.run.trial179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:34.304 DEBUG:teuthology.orchestra.run.trial194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:34.312 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50490.log 2026-02-24T19:26:34.326 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-24T19:26:34.326 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-24T19:26:34.326 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-24T19:26:34.326 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-24T19:26:34.326 INFO:teuthology.orchestra.run.trial114.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-24T19:26:34.326 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/valgrind/osd.13.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-24T19:26:34.327 INFO:teuthology.orchestra.run.trial114.stderr: 65.9%/var/log/ceph/valgrind/osd.1.log: -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-24T19:26:34.327 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-24T19:26:34.327 INFO:teuthology.orchestra.run.trial114.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-24T19:26:34.327 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/valgrind/osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T19:26:34.327 INFO:teuthology.orchestra.run.trial114.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-24T19:26:34.327 INFO:teuthology.orchestra.run.trial114.stderr:gzip/var/log/ceph/valgrind/mon.b.log: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-24T19:26:34.327 INFO:teuthology.orchestra.run.trial114.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-24T19:26:34.327 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-24T19:26:34.328 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-24T19:26:34.328 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T19:26:34.328 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-24T19:26:34.328 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T19:26:34.328 INFO:teuthology.orchestra.run.trial114.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T19:26:34.340 INFO:teuthology.orchestra.run.trial179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-24T19:26:34.340 INFO:teuthology.orchestra.run.trial179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-24T19:26:34.340 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-24T19:26:34.340 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-24T19:26:34.340 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-24T19:26:34.340 INFO:teuthology.orchestra.run.trial179.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-24T19:26:34.340 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-24T19:26:34.340 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/valgrind/osd.14.log: 65.7% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-24T19:26:34.340 INFO:teuthology.orchestra.run.trial179.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/valgrind/osd.10.log: 65.9% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr:gzip/var/log/ceph/ceph-osd.14.log: -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T19:26:34.341 INFO:teuthology.orchestra.run.trial179.stderr: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T19:26:34.360 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53542.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52610.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53542.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50490.log.gz 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53542.log.gz 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52610.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52218.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52610.log.gz 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49866.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49346.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49866.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.52218.log.gz 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52512.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49892.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49866.log.gz 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52512.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49346.log.gz 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49892.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52512.log.gz 2026-02-24T19:26:34.361 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50835.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50368.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49892.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51114.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50835.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52463.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50436.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50368.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50622.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51114.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51777.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52463.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50622.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50436.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50608.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50622.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49395.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49297.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50608.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51777.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50840.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.50608.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.49395.log.gz 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49888.log 2026-02-24T19:26:34.362 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52120.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49297.log.gz 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.50840.log.gz 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49861.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:gzip/var/log/ceph/ceph-client.admin.52120.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51302.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49888.log.gz 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49861.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52120.log.gz -5 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49867.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49861.log.gz 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50605.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51302.log: /var/log/ceph/ceph-client.admin.49867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52365.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50605.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51302.log.gz 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose 87.5% -- -- replaced with /var/log/ceph/ceph-client.admin.49867.log.gz /var/log/ceph/ceph-client.admin.49444.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.50605.log.gz 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50616.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49444.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52365.log.gz 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52855.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr:gzip/var/log/ceph/ceph-client.admin.50616.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49889.log 2026-02-24T19:26:34.363 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49444.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51404.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50616.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52855.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51875.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49889.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51404.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51875.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.51404.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/valgrind/osd.0.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51875.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/valgrind/osd.12.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45047.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53346.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38698.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45047.log: /var/log/ceph/ceph-client.admin.53346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49858.log 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph.tmp-client.admin.38698.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45047.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38698.log.gz 87.3% 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53346.log.gz 2026-02-24T19:26:34.364 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51973.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53444.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52071.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49858.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51973.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49897.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51403.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53444.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51145.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52071.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49897.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45522.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.51403.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52267.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50614.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51145.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45522.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50448.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49862.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52267.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50448.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50614.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49895.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49862.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.50448.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51453.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53248.log 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49862.log.gz 2026-02-24T19:26:34.365 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50630.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49895.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:gzip 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51453.log.gz -5 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52316.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53248.log: /var/log/ceph/ceph-client.admin.50630.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50630.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53248.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52708.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52561.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.12.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52316.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50601.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52561.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-osd.4.log -- replaced with /var/log/ceph/ceph-client.admin.52708.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50601.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52561.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52022.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50601.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53395.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49898.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49232.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52022.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49898.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53395.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45580.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49898.log.gz 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52414.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49232.log: /var/log/ceph/ceph-client.admin.45580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51066.log 2026-02-24T19:26:34.366 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49232.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49061.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52414.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45580.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47361.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52414.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.51066.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52757.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.49061.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.47361.log: /var/log/ceph/ceph-client.admin.52757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53052.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47361.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53297.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52757.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49135.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53297.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53052.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53150.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53297.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52953.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49135.log: /var/log/ceph/ceph-client.admin.53150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51552.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49135.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51350.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53150.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51552.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52953.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45499.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51552.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50609.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51350.log: /var/log/ceph/ceph-client.admin.45499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53493.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51350.log.gz 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51650.log 2026-02-24T19:26:34.367 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45499.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53493.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50609.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51199.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53493.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 91.7% --verbose -- -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr: /var/log/ceph/ceph-client.admin.50469.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51650.log: /var/log/ceph/ceph-client.admin.51199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51650.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50469.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51199.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49860.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49873.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50469.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49884.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49860.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49205.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49860.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51924.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49205.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49884.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53101.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.49205.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53589.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53101.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51924.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51601.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53589.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53101.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49887.log 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51601.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53589.log.gz 2026-02-24T19:26:34.368 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49896.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49887.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51601.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52904.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.49896.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49887.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49896.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51067.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52904.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52659.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52169.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.51067.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45153.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52659.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52169.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.45153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50582.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52169.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.45153.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51826.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.50582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53002.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51826.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50582.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51728.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51826.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.53002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53199.log 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.51728.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53002.log.gz 2026-02-24T19:26:34.369 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52806.log 2026-02-24T19:26:34.370 INFO:teuthology.orchestra.run.trial045.stderr: 87.1%/var/log/ceph/ceph-client.admin.53199.log: -- replaced with /var/log/ceph/ceph-client.admin.51728.log.gz 2026-02-24T19:26:34.370 INFO:teuthology.orchestra.run.trial045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53199.log.gz 2026-02-24T19:26:34.370 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.52806.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52806.log.gz 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50968.log 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50572.log 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48789.log 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48135.log 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50968.log.gz 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48985.log 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54343.log 2026-02-24T19:26:34.378 INFO:teuthology.orchestra.run.trial194.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48911.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.50572.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.54343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44010.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.48789.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48911.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.44010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48080.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.48135.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48399.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-osd.3.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44010.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.48080.log: /var/log/ceph/ceph-client.admin.50967.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48911.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.54343.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48848.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44198.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50969.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.44198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48525.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54345.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44198.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48525.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.48399.log.gz -5 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48531.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.50967.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.54345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48413.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.48848.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48757.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48413.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.50969.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50470.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43822.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48757.log: /var/log/ceph/ceph-client.admin.50470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50570.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.54345.log.gz 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43822.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-24T19:26:34.379 INFO:teuthology.orchestra.run.trial194.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43822.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48791.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48820.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48413.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48791.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.48757.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.50470.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48791.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48820.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/valgrind/osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.48525.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.50570.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48531.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/valgrind/osd.11.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48820.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/valgrind/osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49109.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43728.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.49109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48326.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43728.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.43728.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48854.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44104.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50313.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48854.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48356.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.44104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48684.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48356.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44104.log.gz 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43869.log 2026-02-24T19:26:34.380 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48228.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43869.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48684.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48439.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.43869.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49005.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59773.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.49005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48056.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.59773.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.48326.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44245.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.48985.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54341.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.44245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48627.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44245.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.54341.log: gzip -5 --verbose 90.0% -- /var/log/ceph/ceph-client.admin.48201.log -- replaced with /var/log/ceph/ceph-client.admin.59773.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48929.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43576.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48439.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48670.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.48627.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48101.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48670.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.54341.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43576.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44057.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48101.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48356.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59772.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.48201.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.44057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48769.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44057.log.gz 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.59772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43634.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43775.log 2026-02-24T19:26:34.381 INFO:teuthology.orchestra.run.trial194.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.49005.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50472.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48769.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43634.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43775.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43916.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.59772.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48101.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48497.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.48670.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.49098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43681.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.50472.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48497.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48792.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43681.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.44151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48643.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48760.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48643.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48164.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48269.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49053.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48269.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54344.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.49053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49039.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.48760.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.54344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50314.log 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48792.log.gz 2026-02-24T19:26:34.382 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.49039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50571.log 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49083.log 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50571.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48497.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50314.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48308.log 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.54344.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.49083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48566.log 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59774.log 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.48566.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49039.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50571.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.59774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54342.log 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50471.log 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.54342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43529.log 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.50471.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50471.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr:/var/log/ceph/ceph-client.admin.43529.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.59774.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43529.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.54342.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial194.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48308.log.gz 2026-02-24T19:26:34.383 INFO:teuthology.orchestra.run.trial045.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-24T19:26:34.384 INFO:teuthology.orchestra.run.trial194.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48566.log.gz 2026-02-24T19:26:34.384 INFO:teuthology.orchestra.run.trial194.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz 2026-02-24T19:26:34.384 INFO:teuthology.orchestra.run.trial194.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49083.log.gz 2026-02-24T19:26:34.384 INFO:teuthology.orchestra.run.trial194.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.49053.log.gz 2026-02-24T19:26:34.384 INFO:teuthology.orchestra.run.trial194.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.48929.log.gz 2026-02-24T19:26:34.384 INFO:teuthology.orchestra.run.trial194.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.49109.log.gz 2026-02-24T19:26:34.384 INFO:teuthology.orchestra.run.trial194.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48056.log.gz 2026-02-24T19:26:34.387 INFO:teuthology.orchestra.run.trial194.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.48080.log.gz 2026-02-24T19:26:34.393 INFO:teuthology.orchestra.run.trial194.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.48643.log.gz 2026-02-24T19:26:34.401 INFO:teuthology.orchestra.run.trial194.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.48164.log.gz 2026-02-24T19:26:34.417 INFO:teuthology.orchestra.run.trial194.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.48269.log.gz 2026-02-24T19:26:34.837 INFO:teuthology.orchestra.run.trial194.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48228.log.gz 2026-02-24T19:26:34.895 INFO:teuthology.orchestra.run.trial179.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-24T19:26:34.959 INFO:teuthology.orchestra.run.trial114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-24T19:26:35.031 INFO:teuthology.orchestra.run.trial045.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-24T19:26:35.040 INFO:teuthology.orchestra.run.trial179.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-24T19:26:35.051 INFO:teuthology.orchestra.run.trial114.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-24T19:26:35.067 INFO:teuthology.orchestra.run.trial045.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-24T19:26:35.074 INFO:teuthology.orchestra.run.trial114.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-24T19:26:35.095 INFO:teuthology.orchestra.run.trial179.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-24T19:26:35.100 INFO:teuthology.orchestra.run.trial114.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-24T19:26:35.118 INFO:teuthology.orchestra.run.trial114.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-24T19:26:35.120 INFO:teuthology.orchestra.run.trial114.stderr: 2026-02-24T19:26:35.121 INFO:teuthology.orchestra.run.trial114.stderr:real 0m0.815s 2026-02-24T19:26:35.121 INFO:teuthology.orchestra.run.trial114.stderr:user 0m3.560s 2026-02-24T19:26:35.121 INFO:teuthology.orchestra.run.trial114.stderr:sys 0m0.187s 2026-02-24T19:26:35.128 INFO:teuthology.orchestra.run.trial179.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-24T19:26:35.133 INFO:teuthology.orchestra.run.trial194.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-24T19:26:35.133 INFO:teuthology.orchestra.run.trial194.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-24T19:26:35.161 INFO:teuthology.orchestra.run.trial045.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-24T19:26:35.179 INFO:teuthology.orchestra.run.trial194.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-24T19:26:35.182 INFO:teuthology.orchestra.run.trial194.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-24T19:26:35.183 INFO:teuthology.orchestra.run.trial194.stderr: 2026-02-24T19:26:35.183 INFO:teuthology.orchestra.run.trial194.stderr:real 0m0.840s 2026-02-24T19:26:35.183 INFO:teuthology.orchestra.run.trial194.stderr:user 0m3.778s 2026-02-24T19:26:35.183 INFO:teuthology.orchestra.run.trial194.stderr:sys 0m0.243s 2026-02-24T19:26:35.200 INFO:teuthology.orchestra.run.trial045.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-24T19:26:35.276 INFO:teuthology.orchestra.run.trial179.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-24T19:26:35.278 INFO:teuthology.orchestra.run.trial179.stderr: 2026-02-24T19:26:35.278 INFO:teuthology.orchestra.run.trial179.stderr:real 0m0.961s 2026-02-24T19:26:35.278 INFO:teuthology.orchestra.run.trial179.stderr:user 0m3.617s 2026-02-24T19:26:35.278 INFO:teuthology.orchestra.run.trial179.stderr:sys 0m0.203s 2026-02-24T19:26:35.337 INFO:teuthology.orchestra.run.trial045.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-24T19:26:35.339 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-24T19:26:35.339 INFO:teuthology.orchestra.run.trial045.stderr:real 0m1.035s 2026-02-24T19:26:35.339 INFO:teuthology.orchestra.run.trial045.stderr:user 0m4.091s 2026-02-24T19:26:35.339 INFO:teuthology.orchestra.run.trial045.stderr:sys 0m0.254s 2026-02-24T19:26:35.340 INFO:tasks.ceph:Archiving logs... 2026-02-24T19:26:35.340 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial045/log 2026-02-24T19:26:35.341 DEBUG:teuthology.orchestra.run.trial045:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:35.868 DEBUG:teuthology.misc:Transferring archived files from trial114:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial114/log 2026-02-24T19:26:35.868 DEBUG:teuthology.orchestra.run.trial114:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:36.192 DEBUG:teuthology.misc:Transferring archived files from trial179:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial179/log 2026-02-24T19:26:36.193 DEBUG:teuthology.orchestra.run.trial179:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:36.527 DEBUG:teuthology.misc:Transferring archived files from trial194:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial194/log 2026-02-24T19:26:36.527 DEBUG:teuthology.orchestra.run.trial194:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:36.910 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T19:26:36.922 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T19:26:36.922 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:36.924 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:36.926 DEBUG:teuthology.orchestra.run.trial179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:36.928 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:37.187 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T19:26:37.198 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T19:26:37.198 DEBUG:teuthology.orchestra.run.trial045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:37.200 DEBUG:teuthology.orchestra.run.trial114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:37.202 DEBUG:teuthology.orchestra.run.trial179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:37.204 DEBUG:teuthology.orchestra.run.trial194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:37.214 INFO:teuthology.orchestra.run.trial045.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:37.216 INFO:teuthology.orchestra.run.trial114.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:37.218 INFO:teuthology.orchestra.run.trial179.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:37.219 INFO:teuthology.orchestra.run.trial114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:37.219 INFO:teuthology.orchestra.run.trial114.stdout:=============================================================================== 2026-02-24T19:26:37.219 INFO:teuthology.orchestra.run.trial114.stdout:^- 170-187-147-56.ip.linode> 2 9 377 24 -6513us[-6513us] +/- 83ms 2026-02-24T19:26:37.220 INFO:teuthology.orchestra.run.trial114.stdout:^* 50.218.103.254 2 7 377 96 +1508us[+1485us] +/- 35ms 2026-02-24T19:26:37.220 INFO:teuthology.orchestra.run.trial114.stdout:^+ lax1.us.ntp.li 2 9 377 476 -1964us[-2172us] +/- 34ms 2026-02-24T19:26:37.220 INFO:teuthology.orchestra.run.trial114.stdout:^+ 23.186.168.129 2 8 355 87 +119us[ +119us] +/- 56ms 2026-02-24T19:26:37.220 INFO:teuthology.orchestra.run.trial194.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:37.221 INFO:teuthology.orchestra.run.trial045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:37.221 INFO:teuthology.orchestra.run.trial045.stdout:=============================================================================== 2026-02-24T19:26:37.221 INFO:teuthology.orchestra.run.trial045.stdout:^- 170-187-147-56.ip.linode> 2 8 377 228 -8167us[-8167us] +/- 79ms 2026-02-24T19:26:37.221 INFO:teuthology.orchestra.run.trial045.stdout:^* 50.218.103.254 2 9 377 474 +430us[ +647us] +/- 30ms 2026-02-24T19:26:37.221 INFO:teuthology.orchestra.run.trial045.stdout:^+ lax1.us.ntp.li 2 9 377 479 +1173us[+1390us] +/- 36ms 2026-02-24T19:26:37.221 INFO:teuthology.orchestra.run.trial045.stdout:^- 23.186.168.129 2 8 327 221 -1492us[-1492us] +/- 55ms 2026-02-24T19:26:37.230 INFO:teuthology.orchestra.run.trial194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:37.230 INFO:teuthology.orchestra.run.trial194.stdout:=============================================================================== 2026-02-24T19:26:37.230 INFO:teuthology.orchestra.run.trial194.stdout:^+ wdc1.us.ntp.li 3 8 377 216 -306us[ -454us] +/- 31ms 2026-02-24T19:26:37.230 INFO:teuthology.orchestra.run.trial194.stdout:^* 50.218.103.254 2 6 377 24 +1439us[+1396us] +/- 36ms 2026-02-24T19:26:37.230 INFO:teuthology.orchestra.run.trial194.stdout:^+ lax1.us.ntp.li 2 9 377 90 -892us[ -944us] +/- 39ms 2026-02-24T19:26:37.230 INFO:teuthology.orchestra.run.trial194.stdout:^+ 23.186.168.129 2 8 377 154 -120us[ -268us] +/- 56ms 2026-02-24T19:26:37.241 INFO:teuthology.orchestra.run.trial179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:37.241 INFO:teuthology.orchestra.run.trial179.stdout:=============================================================================== 2026-02-24T19:26:37.241 INFO:teuthology.orchestra.run.trial179.stdout:^+ ntp.maxhost.io 2 7 377 86 -528us[ -528us] +/- 55ms 2026-02-24T19:26:37.241 INFO:teuthology.orchestra.run.trial179.stdout:^* 50.218.103.254 2 8 377 230 +1034us[+1170us] +/- 33ms 2026-02-24T19:26:37.241 INFO:teuthology.orchestra.run.trial179.stdout:^+ lax1.us.ntp.li 2 9 377 472 +455us[ +592us] +/- 34ms 2026-02-24T19:26:37.241 INFO:teuthology.orchestra.run.trial179.stdout:^+ 23.186.168.129 2 8 277 81 -651us[ -651us] +/- 56ms 2026-02-24T19:26:37.242 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T19:26:37.253 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T19:26:37.253 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T19:26:37.267 DEBUG:teuthology.orchestra.run.trial045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:37.322 DEBUG:teuthology.orchestra.run.trial114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:37.376 DEBUG:teuthology.orchestra.run.trial179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:37.431 DEBUG:teuthology.orchestra.run.trial194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:37.485 DEBUG:teuthology.orchestra.run.trial045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:37.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:37.513 DEBUG:teuthology.orchestra.run.trial114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:37.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:37.542 DEBUG:teuthology.orchestra.run.trial179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:37.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:37.569 DEBUG:teuthology.orchestra.run.trial194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:37.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:37.598 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T19:26:37.612 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T19:26:37.628 INFO:teuthology.task.internal:Duration was 3831.271909 seconds 2026-02-24T19:26:37.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T19:26:37.642 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T19:26:37.642 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:37.646 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:37.649 DEBUG:teuthology.orchestra.run.trial179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:37.651 DEBUG:teuthology.orchestra.run.trial194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:37.680 INFO:teuthology.orchestra.run.trial045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:37.684 INFO:teuthology.orchestra.run.trial114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:37.686 INFO:teuthology.orchestra.run.trial179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:37.688 INFO:teuthology.orchestra.run.trial194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:38.006 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T19:26:38.006 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial045.front.sepia.ceph.com 2026-02-24T19:26:38.006 DEBUG:teuthology.orchestra.run.trial045:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:38.037 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial114.front.sepia.ceph.com 2026-02-24T19:26:38.037 DEBUG:teuthology.orchestra.run.trial114:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:38.056 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial179.front.sepia.ceph.com 2026-02-24T19:26:38.057 DEBUG:teuthology.orchestra.run.trial179:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:38.075 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial194.front.sepia.ceph.com 2026-02-24T19:26:38.075 DEBUG:teuthology.orchestra.run.trial194:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:38.096 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T19:26:38.096 DEBUG:teuthology.orchestra.run.trial045:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:38.099 DEBUG:teuthology.orchestra.run.trial114:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:38.101 DEBUG:teuthology.orchestra.run.trial179:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:38.117 DEBUG:teuthology.orchestra.run.trial194:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:38.199 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T19:26:38.200 DEBUG:teuthology.orchestra.run.trial045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:38.202 DEBUG:teuthology.orchestra.run.trial114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:38.205 DEBUG:teuthology.orchestra.run.trial179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:38.207 DEBUG:teuthology.orchestra.run.trial194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:38.222 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:38.223 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:38.224 INFO:teuthology.orchestra.run.trial045.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:38.224 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:38.224 INFO:teuthology.orchestra.run.trial045.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:38.225 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:38.226 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:38.226 INFO:teuthology.orchestra.run.trial114.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:38.227 INFO:teuthology.orchestra.run.trial114.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:38.227 INFO:teuthology.orchestra.run.trial114.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:38.227 INFO:teuthology.orchestra.run.trial179.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:38.228 INFO:teuthology.orchestra.run.trial179.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:38.229 INFO:teuthology.orchestra.run.trial179.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:38.229 INFO:teuthology.orchestra.run.trial179.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:38.229 INFO:teuthology.orchestra.run.trial179.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:38.230 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:38.231 INFO:teuthology.orchestra.run.trial194.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:38.231 INFO:teuthology.orchestra.run.trial194.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:38.231 INFO:teuthology.orchestra.run.trial194.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:38.232 INFO:teuthology.orchestra.run.trial194.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:38.233 INFO:teuthology.orchestra.run.trial045.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:38.237 INFO:teuthology.orchestra.run.trial114.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:38.238 INFO:teuthology.orchestra.run.trial179.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:38.241 INFO:teuthology.orchestra.run.trial194.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:38.243 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T19:26:38.259 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T19:26:38.260 DEBUG:teuthology.orchestra.run.trial045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:38.299 DEBUG:teuthology.orchestra.run.trial114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:38.323 DEBUG:teuthology.orchestra.run.trial179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:38.349 DEBUG:teuthology.orchestra.run.trial194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:38.375 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T19:26:38.391 DEBUG:teuthology.orchestra.run.trial045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:38.394 DEBUG:teuthology.orchestra.run.trial114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:38.397 DEBUG:teuthology.orchestra.run.trial179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:38.399 DEBUG:teuthology.orchestra.run.trial194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:38.417 INFO:teuthology.orchestra.run.trial045.stdout:kernel.core_pattern = core 2026-02-24T19:26:38.420 INFO:teuthology.orchestra.run.trial114.stdout:kernel.core_pattern = core 2026-02-24T19:26:38.420 INFO:teuthology.orchestra.run.trial179.stdout:kernel.core_pattern = core 2026-02-24T19:26:38.439 INFO:teuthology.orchestra.run.trial194.stdout:kernel.core_pattern = core 2026-02-24T19:26:38.457 DEBUG:teuthology.orchestra.run.trial045:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:38.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:38.486 DEBUG:teuthology.orchestra.run.trial114:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:38.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:38.502 DEBUG:teuthology.orchestra.run.trial179:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:38.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:38.517 DEBUG:teuthology.orchestra.run.trial194:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:38.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:38.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T19:26:38.549 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T19:26:38.550 DEBUG:teuthology.misc:Transferring archived files from trial045:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial045 2026-02-24T19:26:38.550 DEBUG:teuthology.orchestra.run.trial045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:38.588 DEBUG:teuthology.misc:Transferring archived files from trial114:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial114 2026-02-24T19:26:38.589 DEBUG:teuthology.orchestra.run.trial114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:38.627 DEBUG:teuthology.misc:Transferring archived files from trial179:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial179 2026-02-24T19:26:38.627 DEBUG:teuthology.orchestra.run.trial179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:38.663 DEBUG:teuthology.misc:Transferring archived files from trial194:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68688/remote/trial194 2026-02-24T19:26:38.664 DEBUG:teuthology.orchestra.run.trial194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:38.715 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T19:26:38.715 DEBUG:teuthology.orchestra.run.trial045:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:38.718 DEBUG:teuthology.orchestra.run.trial114:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:38.721 DEBUG:teuthology.orchestra.run.trial179:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:38.724 DEBUG:teuthology.orchestra.run.trial194:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:38.749 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T19:26:38.772 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T19:26:38.772 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T19:26:38.792 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T19:26:38.792 DEBUG:teuthology.orchestra.run.trial045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:38.794 DEBUG:teuthology.orchestra.run.trial114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:38.797 DEBUG:teuthology.orchestra.run.trial179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:38.799 DEBUG:teuthology.orchestra.run.trial194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:38.808 INFO:teuthology.orchestra.run.trial045.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:38.811 INFO:teuthology.orchestra.run.trial114.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:38.813 INFO:teuthology.orchestra.run.trial179.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:38.815 INFO:teuthology.orchestra.run.trial194.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:38.816 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T19:26:38.833 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T19:26:38.870 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} duration: 3831.271908521652 flavor: default owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com success: true 2026-02-24T19:26:38.870 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T19:26:38.977 INFO:teuthology.run:pass